Nov 02 17:12:54 user nova-compute[74980]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74980) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74980) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74980) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 02 17:12:54 user nova-compute[74980]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:12:54 user nova-compute[74980]: INFO nova.virt.driver [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 02 17:12:54 user nova-compute[74980]: INFO nova.compute.provider_config [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] Acquiring lock "singleton_lock" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] Acquired lock "singleton_lock" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] Releasing lock "singleton_lock" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] Full set of CONF: {{(pid=74980) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ******************************************************************************** {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] Configuration options gathered from: {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ================================================================================ {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] allow_resize_to_same_host      = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] arq_binding_timeout            = 300 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] backdoor_port                  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] backdoor_socket                = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] block_device_allocate_retries  = 300 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] block_device_allocate_retries_interval = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cert                           = self.pem {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] compute_monitors               = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] config_dir                     = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] config_drive_format            = iso9660 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] config_source                  = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] console_host                   = user {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] control_exchange               = nova {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cpu_allocation_ratio           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] daemon                         = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] debug                          = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] default_access_ip_network_name = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] default_availability_zone      = nova {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] default_ephemeral_format       = ext4 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] default_green_pool_size        = 1000 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] default_schedule_zone          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] disk_allocation_ratio          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] enable_new_services            = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] enabled_ssl_apis               = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] flat_injected                  = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] force_config_drive             = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] force_raw_images               = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] graceful_shutdown_timeout      = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] heal_instance_info_cache_interval = 60 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] host                           = user {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] instance_build_timeout         = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] instance_delete_interval       = 300 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] instance_name_template         = instance-%08x {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] instance_usage_audit           = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] instance_usage_audit_period    = month {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] internal_service_availability_zone = internal {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] key                            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] live_migration_retry_count     = 30 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] log_config_append              = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] log_dir                        = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] log_file                       = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] log_options                    = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] log_rotate_interval            = 1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] log_rotate_interval_type       = days {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] log_rotation_type              = none {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] long_rpc_timeout               = 1800 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] max_concurrent_builds          = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] max_concurrent_live_migrations = 1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] max_concurrent_snapshots       = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] max_local_block_devices        = 3 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] max_logfile_count              = 30 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] max_logfile_size_mb            = 200 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] maximum_instance_delete_attempts = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] metadata_listen                = 0.0.0.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] metadata_listen_port           = 8775 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] metadata_workers               = 3 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] migrate_max_retries            = -1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] mkisofs_cmd                    = genisoimage {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] my_ip                          = 10.0.0.210 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] network_allocate_retries       = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] osapi_compute_listen_port      = 8774 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] osapi_compute_unique_server_name_scope =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] osapi_compute_workers          = 3 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] password_length                = 12 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] periodic_enable                = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] periodic_fuzzy_delay           = 60 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] pointer_model                  = ps2mouse {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] preallocate_images             = none {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] publish_errors                 = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] pybasedir                      = /opt/stack/nova {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ram_allocation_ratio           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] rate_limit_burst               = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] rate_limit_except_level        = CRITICAL {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] rate_limit_interval            = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] reboot_timeout                 = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] reclaim_instance_interval      = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] record                         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] reimage_timeout_per_gb         = 60 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] report_interval                = 120 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] rescue_timeout                 = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] reserved_host_cpus             = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] reserved_host_disk_mb          = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] reserved_host_memory_mb        = 512 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] reserved_huge_pages            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] resize_confirm_window          = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] resize_fs_using_block_device   = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] resume_guests_state_on_host_boot = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] rpc_response_timeout           = 60 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] run_external_periodic_tasks    = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] running_deleted_instance_action = reap {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] running_deleted_instance_timeout = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] scheduler_instance_sync_interval = 120 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] service_down_time              = 720 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] servicegroup_driver            = db {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] shelved_offload_time           = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] shelved_poll_interval          = 3600 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] shutdown_timeout               = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] source_is_ipv6                 = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ssl_only                       = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] state_path                     = /opt/stack/data/nova {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] sync_power_state_interval      = 600 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] sync_power_state_pool_size     = 1000 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] syslog_log_facility            = LOG_USER {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] tempdir                        = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] timeout_nbd                    = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] transport_url                  = **** {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] update_resources_interval      = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] use_cow_images                 = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] use_eventlog                   = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] use_journal                    = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] use_json                       = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] use_rootwrap_daemon            = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] use_stderr                     = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] use_syslog                     = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vcpu_pin_set                   = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vif_plugging_is_fatal          = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vif_plugging_timeout           = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] virt_mkfs                      = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] volume_usage_poll_interval     = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] watch_log_file                 = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] web                            = /usr/share/spice-html5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_concurrency.disable_process_locking = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.auth_strategy              = keystone {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.compute_link_prefix        = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.dhcp_domain                = novalocal {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.enable_instance_password   = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.glance_link_prefix         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.instance_list_per_project_cells = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.list_records_by_skipping_down_cells = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.local_metadata_per_cell    = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.max_limit                  = 1000 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.metadata_cache_expiration  = 15 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.neutron_default_tenant_id  = default {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.use_forwarded_for          = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.use_neutron_default_nets   = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.vendordata_dynamic_targets = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.vendordata_jsonfile_path   = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.backend_argument         = **** {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.config_prefix            = cache.oslo {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.dead_timeout             = 60.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.debug_cache_backend      = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.enable_retry_client      = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.enable_socket_keepalive  = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.enabled                  = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.expiration_time          = 600 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.hashclient_retry_attempts = 2 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.memcache_dead_retry      = 300 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.memcache_password        =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.memcache_sasl_enabled    = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.memcache_username        =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.proxies                  = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.retry_attempts           = 2 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.retry_delay              = 0.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.socket_keepalive_count   = 1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.socket_keepalive_idle    = 1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.socket_keepalive_interval = 1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.tls_allowed_ciphers      = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.tls_cafile               = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.tls_certfile             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.tls_enabled              = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cache.tls_keyfile              = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cinder.auth_section            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cinder.auth_type               = password {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cinder.cafile                  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cinder.certfile                = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cinder.collect_timing          = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cinder.cross_az_attach         = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cinder.debug                   = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cinder.endpoint_template       = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cinder.http_retries            = 3 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cinder.insecure                = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cinder.keyfile                 = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cinder.os_region_name          = RegionOne {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cinder.split_loggers           = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cinder.timeout                 = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] compute.cpu_dedicated_set      = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] compute.cpu_shared_set         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] compute.image_type_exclude_list = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] compute.resource_provider_association_refresh = 300 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] compute.shutdown_retry_interval = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] conductor.workers              = 3 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] console.allowed_origins        = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] console.ssl_ciphers            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] console.ssl_minimum_version    = default {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] consoleauth.token_ttl          = 600 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.cafile                  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.certfile                = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.collect_timing          = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.connect_retries         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.connect_retry_delay     = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.endpoint_override       = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.insecure                = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.keyfile                 = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.max_version             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.min_version             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.region_name             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.service_name            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.service_type            = accelerator {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.split_loggers           = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.status_code_retries     = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.status_code_retry_delay = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.timeout                 = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] cyborg.version                 = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.backend               = sqlalchemy {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.connection            = **** {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.connection_debug      = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.connection_parameters =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.connection_recycle_time = 3600 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.connection_trace      = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.db_inc_retry_interval = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.db_max_retries        = 20 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.db_max_retry_interval = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.db_retry_interval     = 1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.max_overflow          = 50 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.max_pool_size         = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.max_retries           = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.mysql_wsrep_sync_wait = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.pool_timeout          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.retry_interval        = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.slave_connection      = **** {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] database.sqlite_synchronous    = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.backend           = sqlalchemy {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.connection        = **** {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.connection_debug  = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.connection_parameters =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.connection_recycle_time = 3600 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.connection_trace  = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.db_inc_retry_interval = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.db_max_retries    = 20 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.db_max_retry_interval = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.db_retry_interval = 1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.max_overflow      = 50 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.max_pool_size     = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.max_retries       = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.pool_timeout      = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.retry_interval    = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.slave_connection  = **** {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] api_database.sqlite_synchronous = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] devices.enabled_mdev_types     = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ephemeral_storage_encryption.enabled = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.api_servers             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.cafile                  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.certfile                = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.collect_timing          = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.connect_retries         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.connect_retry_delay     = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.debug                   = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.default_trusted_certificate_ids = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.enable_certificate_validation = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.enable_rbd_download     = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.endpoint_override       = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.insecure                = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.keyfile                 = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.max_version             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.min_version             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.num_retries             = 3 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.rbd_ceph_conf           =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.rbd_connect_timeout     = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.rbd_pool                =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.rbd_user                =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.region_name             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.service_name            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.service_type            = image {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.split_loggers           = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.status_code_retries     = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.status_code_retry_delay = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.timeout                 = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.verify_glance_signatures = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] glance.version                 = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] guestfs.debug                  = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.config_drive_cdrom      = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.config_drive_inject_password = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.enable_remotefx         = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.instances_path_share    =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.limit_cpu_features      = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.use_multipath_io        = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.vswitch_name            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] mks.enabled                    = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] image_cache.manager_interval   = 2400 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] image_cache.precache_concurrency = 1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] image_cache.remove_unused_base_images = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] image_cache.subdirectory_name  = _base {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.api_max_retries         = 60 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.api_retry_interval      = 2 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.auth_section            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.auth_type               = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.cafile                  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.certfile                = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.collect_timing          = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.conductor_group         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.connect_retries         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.connect_retry_delay     = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.endpoint_override       = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.insecure                = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.keyfile                 = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.max_version             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.min_version             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.peer_list               = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.region_name             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.serial_console_state_timeout = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.service_name            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.service_type            = baremetal {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.split_loggers           = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.status_code_retries     = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.status_code_retry_delay = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.timeout                 = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ironic.version                 = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] key_manager.fixed_key          = **** {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.barbican_api_version  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.barbican_endpoint     = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.barbican_endpoint_type = public {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.barbican_region_name  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.cafile                = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.certfile              = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.collect_timing        = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.insecure              = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.keyfile               = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.number_of_retries     = 60 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.retry_delay           = 1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.send_service_user_token = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.split_loggers         = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.timeout               = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.verify_ssl            = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican.verify_ssl_path       = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican_service_user.auth_section = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican_service_user.auth_type = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican_service_user.cafile   = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican_service_user.certfile = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican_service_user.collect_timing = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican_service_user.insecure = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican_service_user.keyfile  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican_service_user.split_loggers = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] barbican_service_user.timeout  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.approle_role_id          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.approle_secret_id        = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.cafile                   = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.certfile                 = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.collect_timing           = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.insecure                 = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.keyfile                  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.kv_mountpoint            = secret {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.kv_path                  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.kv_version               = 2 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.namespace                = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.root_token_id            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.split_loggers            = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.ssl_ca_crt_file          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.timeout                  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.use_ssl                  = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.auth_section          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.auth_type             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.cafile                = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.certfile              = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.collect_timing        = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.connect_retries       = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.connect_retry_delay   = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.endpoint_override     = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.insecure              = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.keyfile               = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.max_version           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.min_version           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.region_name           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.service_name          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.service_type          = identity {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.split_loggers         = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.status_code_retries   = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.status_code_retry_delay = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.timeout               = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] keystone.version               = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.connection_uri         =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.cpu_mode               = custom {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: WARNING oslo_config.cfg [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.cpu_power_governor_high = performance {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.cpu_power_management   = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.device_detach_attempts = 8 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.device_detach_timeout  = 20 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.disk_cachemodes        = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.disk_prefix            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.enabled_perf_events    = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.file_backed_memory     = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.gid_maps               = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.hw_disk_discard        = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.hw_machine_type        = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.images_rbd_pool        = rbd {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.images_type            = default {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.images_volume_group    = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.inject_key             = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.inject_partition       = -2 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.inject_password        = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.iscsi_iface            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.iser_use_multipath     = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.live_migration_downtime = 500 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.live_migration_inbound_addr = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.live_migration_scheme  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.live_migration_timeout_action = abort {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.live_migration_tunnelled = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: WARNING oslo_config.cfg [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 02 17:12:54 user nova-compute[74980]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 02 17:12:54 user nova-compute[74980]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 02 17:12:54 user nova-compute[74980]: and ``live_migration_inbound_addr`` respectively.
Nov 02 17:12:54 user nova-compute[74980]: ).  Its value may be silently ignored in the future.
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.live_migration_with_native_tls = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.max_queues             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.nfs_mount_options      = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.num_pcie_ports         = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.pmem_namespaces        = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.quobyte_client_cfg     = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.rbd_secret_uuid        = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.rbd_user               = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.rescue_image_id        = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.rescue_kernel_id       = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.rx_queue_size          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.smbfs_mount_options    =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.snapshot_compression   = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.snapshot_image_format  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.sparse_logical_volumes = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.swtpm_enabled          = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.swtpm_group            = tss {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.swtpm_user             = tss {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.sysinfo_serial         = unique {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.tb_cache_size          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.tx_queue_size          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.uid_maps               = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.use_virtio_for_bridges = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.virt_type              = kvm {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.volume_clear           = zero {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.volume_clear_size      = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.volume_use_multipath   = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.vzstorage_cache_path   = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.auth_section           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.auth_type              = password {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.cafile                 = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.certfile               = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.collect_timing         = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.connect_retries        = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.connect_retry_delay    = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.default_floating_pool  = public {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.endpoint_override      = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.extension_sync_interval = 600 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.http_retries           = 3 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.insecure               = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.keyfile                = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.max_version            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.min_version            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.ovs_bridge             = br-int {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.physnets               = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.region_name            = RegionOne {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.service_metadata_proxy = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.service_name           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.service_type           = network {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.split_loggers          = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.status_code_retries    = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.status_code_retry_delay = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.timeout                = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] neutron.version                = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] notifications.bdms_in_notifications = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] notifications.default_level    = INFO {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] notifications.notification_format = unversioned {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] notifications.notify_on_state_change = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] pci.alias                      = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] pci.device_spec                = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] pci.report_in_placement        = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.auth_section         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.auth_type            = password {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.cafile               = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.certfile             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.collect_timing       = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.connect_retries      = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.connect_retry_delay  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.default_domain_id    = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.default_domain_name  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.domain_id            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.domain_name          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.endpoint_override    = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.insecure             = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.keyfile              = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.max_version          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.min_version          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.password             = **** {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.project_domain_id    = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.project_domain_name  = Default {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.project_id           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.project_name         = service {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.region_name          = RegionOne {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.service_name         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.service_type         = placement {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.split_loggers        = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:54 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.status_code_retries  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.status_code_retry_delay = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.system_scope         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.timeout              = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.trust_id             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.user_domain_id       = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.user_domain_name     = Default {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.user_id              = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.username             = placement {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] placement.version              = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] quota.cores                    = 20 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] quota.count_usage_from_placement = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] quota.injected_file_content_bytes = 10240 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] quota.injected_file_path_length = 255 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] quota.injected_files           = 5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] quota.instances                = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] quota.key_pairs                = 100 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] quota.metadata_items           = 128 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] quota.ram                      = 51200 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] quota.recheck_quota            = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] quota.server_group_members     = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] quota.server_groups            = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] rdp.enabled                    = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] scheduler.image_metadata_prefilter = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] scheduler.max_attempts         = 3 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] scheduler.max_placement_results = 1000 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] scheduler.workers              = 3 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.host_subset_size = 1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.isolated_hosts = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.isolated_images = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.pci_in_placement = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.track_instance_changes = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] metrics.required               = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] metrics.weight_multiplier      = 1.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] metrics.weight_setting         = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] serial_console.enabled         = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] serial_console.port_range      = 10000:20000 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] serial_console.serialproxy_port = 6083 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] service_user.auth_section      = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] service_user.auth_type         = password {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] service_user.cafile            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] service_user.certfile          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] service_user.collect_timing    = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] service_user.insecure          = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] service_user.keyfile           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] service_user.send_service_user_token = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] service_user.split_loggers     = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] service_user.timeout           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] spice.agent_enabled            = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] spice.enabled                  = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] spice.html5proxy_port          = 6082 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] spice.image_compression        = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] spice.jpeg_compression         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] spice.playback_compression     = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] spice.server_listen            = 127.0.0.1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] spice.streaming_mode           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] spice.zlib_compression         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] upgrade_levels.baseapi         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] upgrade_levels.cert            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] upgrade_levels.compute         = auto {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] upgrade_levels.conductor       = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] upgrade_levels.scheduler       = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vendordata_dynamic_auth.cafile = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vendordata_dynamic_auth.certfile = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vendordata_dynamic_auth.insecure = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vendordata_dynamic_auth.timeout = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.api_retry_count         = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.ca_file                 = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.cache_prefix            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.cluster_name            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.connection_pool_size    = 10 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.console_delay_seconds   = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.datastore_regex         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.host_ip                 = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.host_password           = **** {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.host_port               = 443 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.host_username           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.insecure                = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.integration_bridge      = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.maximum_objects         = 100 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.pbm_default_policy      = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.pbm_enabled             = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.pbm_wsdl_location       = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.serial_port_proxy_uri   = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.serial_port_service_uri = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.task_poll_interval      = 0.5 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.use_linked_clone        = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.vnc_keymap              = en-us {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.vnc_port                = 5900 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vmware.vnc_port_total          = 10000 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vnc.auth_schemes               = ['none'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vnc.enabled                    = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vnc.novncproxy_port            = 6080 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vnc.vencrypt_ca_certs          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vnc.vencrypt_client_cert       = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vnc.vencrypt_client_key        = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.disable_rootwrap   = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.enable_numa_live_migration = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.libvirt_disable_apic = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] wsgi.client_socket_timeout     = 900 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] wsgi.default_pool_size         = 1000 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] wsgi.keep_alive                = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] wsgi.max_header_line           = 16384 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] wsgi.ssl_ca_file               = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] wsgi.ssl_cert_file             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] wsgi.ssl_key_file              = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] wsgi.tcp_keepidle              = 600 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] zvm.ca_file                    = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] zvm.cloud_connector_url        = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] zvm.reachable_timeout          = 300 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_policy.enforce_new_defaults = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_policy.enforce_scope      = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_policy.policy_default_rule = default {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] profiler.connection_string     = messaging:// {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] profiler.enabled               = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] profiler.es_doc_type           = notification {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] profiler.es_scroll_size        = 10000 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] profiler.es_scroll_time        = 2m {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] profiler.filter_error_trace    = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] profiler.hmac_keys             = **** {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] profiler.sentinel_service_name = mymaster {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] profiler.socket_timeout        = 0.1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] profiler.trace_requests        = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] profiler.trace_sqlalchemy      = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] profiler_jaeger.process_tags   = {} {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] profiler_jaeger.service_name_prefix = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] profiler_otlp.service_name_prefix = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] remote_debug.host              = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] remote_debug.port              = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_notifications.retry = -1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.auth_section        = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.auth_type           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.cafile              = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.certfile            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.collect_timing      = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.connect_retries     = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.connect_retry_delay = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.endpoint_id         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.endpoint_override   = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.insecure            = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.keyfile             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.max_version         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.min_version         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.region_name         = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.service_name        = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.service_type        = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.split_loggers       = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.status_code_retries = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.status_code_retry_delay = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.timeout             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.valid_interfaces    = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_limit.version             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_reports.file_event_handler = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] oslo_reports.log_dir           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vif_plug_ovs_privileged.group  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] vif_plug_ovs_privileged.user   = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_vif_ovs.isolate_vif         = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] os_brick.lock_path             = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] privsep_osbrick.capabilities   = [21] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] privsep_osbrick.group          = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] privsep_osbrick.helper_command = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] privsep_osbrick.user           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] nova_sys_admin.group           = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] nova_sys_admin.helper_command  = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] nova_sys_admin.user            = None {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG oslo_service.service [None req-e0c8a137-dc46-40a3-98cc-458d43a0a4f5 None None] ******************************************************************************** {{(pid=74980) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 02 17:12:55 user nova-compute[74980]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 02 17:12:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Connecting to libvirt: qemu:///system {{(pid=74980) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f59c5de7070> {{(pid=74980) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 02 17:12:55 user nova-compute[74980]: libvirt:  error : internal error: could not initialize domain event timer
Nov 02 17:12:55 user nova-compute[74980]: WARNING nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 02 17:12:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f59c5de7070> {{(pid=74980) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Starting native event thread {{(pid=74980) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Starting green dispatch thread {{(pid=74980) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 02 17:12:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Starting connection event dispatch thread {{(pid=74980) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 02 17:12:55 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Connection event '1' reason 'None'
Nov 02 17:12:55 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 02 17:12:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.mount [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Initialising _HostMountState generation 0 {{(pid=74980) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 02 17:13:02 user nova-compute[74980]: INFO nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Libvirt host capabilities <capabilities>
Nov 02 17:13:02 user nova-compute[74980]:   <host>
Nov 02 17:13:02 user nova-compute[74980]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 02 17:13:02 user nova-compute[74980]:     <cpu>
Nov 02 17:13:02 user nova-compute[74980]:       <arch>x86_64</arch>
Nov 02 17:13:02 user nova-compute[74980]:       <model>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <vendor>Intel</vendor>
Nov 02 17:13:02 user nova-compute[74980]:       <microcode version='1070'/>
Nov 02 17:13:02 user nova-compute[74980]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 02 17:13:02 user nova-compute[74980]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature name='ss'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature name='vmx'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature name='pcid'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature name='osxsave'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature name='hypervisor'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature name='arat'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature name='tsc_adjust'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature name='md-clear'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature name='stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature name='arch-capabilities'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature name='ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature name='invtsc'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature name='rsba'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature name='skip-l1dfl-vmentry'/>
Nov 02 17:13:02 user nova-compute[74980]:       <pages unit='KiB' size='4'/>
Nov 02 17:13:02 user nova-compute[74980]:       <pages unit='KiB' size='2048'/>
Nov 02 17:13:02 user nova-compute[74980]:     </cpu>
Nov 02 17:13:02 user nova-compute[74980]:     <power_management>
Nov 02 17:13:02 user nova-compute[74980]:       <suspend_mem/>
Nov 02 17:13:02 user nova-compute[74980]:       <suspend_disk/>
Nov 02 17:13:02 user nova-compute[74980]:       <suspend_hybrid/>
Nov 02 17:13:02 user nova-compute[74980]:     </power_management>
Nov 02 17:13:02 user nova-compute[74980]:     <iommu support='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     <migration_features>
Nov 02 17:13:02 user nova-compute[74980]:       <live/>
Nov 02 17:13:02 user nova-compute[74980]:       <uri_transports>
Nov 02 17:13:02 user nova-compute[74980]:         <uri_transport>tcp</uri_transport>
Nov 02 17:13:02 user nova-compute[74980]:         <uri_transport>rdma</uri_transport>
Nov 02 17:13:02 user nova-compute[74980]:       </uri_transports>
Nov 02 17:13:02 user nova-compute[74980]:     </migration_features>
Nov 02 17:13:02 user nova-compute[74980]:     <topology>
Nov 02 17:13:02 user nova-compute[74980]:       <cells num='2'>
Nov 02 17:13:02 user nova-compute[74980]:         <cell id='0'>
Nov 02 17:13:02 user nova-compute[74980]:           <memory unit='KiB'>8140616</memory>
Nov 02 17:13:02 user nova-compute[74980]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 02 17:13:02 user nova-compute[74980]:           <pages unit='KiB' size='2048'>0</pages>
Nov 02 17:13:02 user nova-compute[74980]:           <distances>
Nov 02 17:13:02 user nova-compute[74980]:             <sibling id='0' value='10'/>
Nov 02 17:13:02 user nova-compute[74980]:             <sibling id='1' value='20'/>
Nov 02 17:13:02 user nova-compute[74980]:           </distances>
Nov 02 17:13:02 user nova-compute[74980]:           <cpus num='6'>
Nov 02 17:13:02 user nova-compute[74980]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 02 17:13:02 user nova-compute[74980]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 02 17:13:02 user nova-compute[74980]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 02 17:13:02 user nova-compute[74980]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 02 17:13:02 user nova-compute[74980]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 02 17:13:02 user nova-compute[74980]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 02 17:13:02 user nova-compute[74980]:           </cpus>
Nov 02 17:13:02 user nova-compute[74980]:         </cell>
Nov 02 17:13:02 user nova-compute[74980]:         <cell id='1'>
Nov 02 17:13:02 user nova-compute[74980]:           <memory unit='KiB'>8255100</memory>
Nov 02 17:13:02 user nova-compute[74980]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 02 17:13:02 user nova-compute[74980]:           <pages unit='KiB' size='2048'>0</pages>
Nov 02 17:13:02 user nova-compute[74980]:           <distances>
Nov 02 17:13:02 user nova-compute[74980]:             <sibling id='0' value='20'/>
Nov 02 17:13:02 user nova-compute[74980]:             <sibling id='1' value='10'/>
Nov 02 17:13:02 user nova-compute[74980]:           </distances>
Nov 02 17:13:02 user nova-compute[74980]:           <cpus num='6'>
Nov 02 17:13:02 user nova-compute[74980]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 02 17:13:02 user nova-compute[74980]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 02 17:13:02 user nova-compute[74980]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 02 17:13:02 user nova-compute[74980]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 02 17:13:02 user nova-compute[74980]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 02 17:13:02 user nova-compute[74980]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 02 17:13:02 user nova-compute[74980]:           </cpus>
Nov 02 17:13:02 user nova-compute[74980]:         </cell>
Nov 02 17:13:02 user nova-compute[74980]:       </cells>
Nov 02 17:13:02 user nova-compute[74980]:     </topology>
Nov 02 17:13:02 user nova-compute[74980]:     <cache>
Nov 02 17:13:02 user nova-compute[74980]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 02 17:13:02 user nova-compute[74980]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 02 17:13:02 user nova-compute[74980]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 02 17:13:02 user nova-compute[74980]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 02 17:13:02 user nova-compute[74980]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 02 17:13:02 user nova-compute[74980]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 02 17:13:02 user nova-compute[74980]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 02 17:13:02 user nova-compute[74980]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 02 17:13:02 user nova-compute[74980]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 02 17:13:02 user nova-compute[74980]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 02 17:13:02 user nova-compute[74980]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 02 17:13:02 user nova-compute[74980]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 02 17:13:02 user nova-compute[74980]:     </cache>
Nov 02 17:13:02 user nova-compute[74980]:     <secmodel>
Nov 02 17:13:02 user nova-compute[74980]:       <model>apparmor</model>
Nov 02 17:13:02 user nova-compute[74980]:       <doi>0</doi>
Nov 02 17:13:02 user nova-compute[74980]:     </secmodel>
Nov 02 17:13:02 user nova-compute[74980]:     <secmodel>
Nov 02 17:13:02 user nova-compute[74980]:       <model>dac</model>
Nov 02 17:13:02 user nova-compute[74980]:       <doi>0</doi>
Nov 02 17:13:02 user nova-compute[74980]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 02 17:13:02 user nova-compute[74980]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 02 17:13:02 user nova-compute[74980]:     </secmodel>
Nov 02 17:13:02 user nova-compute[74980]:   </host>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='alpha'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>64</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>clipper</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='armv6l'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>32</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>integratorcp</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>borzoi</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>spitz</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>nuri</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>musca-b1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>versatileab</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>kzm</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>musca-a</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>smdkc210</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sx1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>z2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>tosa</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>sabrelite</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>realview-eb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>n810</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>n800</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>versatilepb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>terrier</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mainstone</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>midway</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>musicpal</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>microbit</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>cubieboard</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>verdex</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>netduino2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>raspi2b</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>cheetah</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>highbank</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>akita</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>connex</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>collie</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>raspi0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='armv7l'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>32</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>integratorcp</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>borzoi</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>spitz</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>nuri</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>musca-b1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>versatileab</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>kzm</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>musca-a</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>smdkc210</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sx1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>z2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>tosa</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>sabrelite</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>realview-eb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>n810</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>n800</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>versatilepb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>terrier</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mainstone</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>midway</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>musicpal</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>microbit</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>cubieboard</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>verdex</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>netduino2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>raspi2b</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>cheetah</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>highbank</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>akita</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>connex</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>collie</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>raspi0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='aarch64'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>64</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>integratorcp</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>borzoi</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>spitz</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>nuri</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>musca-b1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>versatileab</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>kzm</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>musca-a</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>smdkc210</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sx1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>z2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>tosa</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>sabrelite</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>realview-eb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>n810</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>n800</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>versatilepb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>terrier</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mainstone</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>midway</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>musicpal</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>microbit</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>cubieboard</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>verdex</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>netduino2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>raspi3b</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>raspi2b</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>cheetah</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>highbank</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>akita</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>connex</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>collie</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>raspi0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <acpi default='on' toggle='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='cris'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>32</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='i686'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>32</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>x-remote</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>isapc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>microvm</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='kvm'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <pae/>
Nov 02 17:13:02 user nova-compute[74980]:       <nonpae/>
Nov 02 17:13:02 user nova-compute[74980]:       <acpi default='on' toggle='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:       <apic default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='m68k'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>32</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>an5206</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>q800</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>next-cube</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='microblaze'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>32</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='microblazeel'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>32</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='mips'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>32</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='16'>malta</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='mipsel'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>32</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='16'>malta</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='mips64'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>64</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='16'>malta</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>pica61</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>magnum</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='mips64el'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>64</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='16'>malta</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>pica61</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>magnum</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='16'>boston</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='ppc'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>32</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>g3beige</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mac99</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>ppce500</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>pegasos2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sam460ex</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>bamboo</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>40p</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>ref405ep</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>taihu</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='ppc64'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>64</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2048'>powernv9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>taihu</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2048'>powernv10</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>ppce500</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>40p</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>pegasos2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>bamboo</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>g3beige</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mac99</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sam460ex</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>ref405ep</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2048'>powernv8</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='ppc64le'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>64</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2048'>powernv9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>taihu</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2048'>powernv10</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>ppce500</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>40p</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>pegasos2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>bamboo</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>g3beige</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>mac99</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sam460ex</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>ref405ep</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2048'>powernv8</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='riscv32'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>32</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='8'>spike</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>opentitan</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='5'>sifive_u</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sifive_e</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='8'>virt</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='riscv64'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>64</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='8'>spike</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='5'>sifive_u</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>shakti_c</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sifive_e</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='8'>virt</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='s390x'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>64</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='sh4'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>32</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>shix</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>r2d</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='sh4eb'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>64</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>shix</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>r2d</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='sparc'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>32</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>SS-5</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>SS-20</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>LX</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>SS-4</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>SS-10</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>Voyager</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='sparc64'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>64</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sun4u</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>niagara</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>sun4v</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='x86_64'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>64</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>x-remote</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='1'>isapc</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>microvm</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='kvm'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <acpi default='on' toggle='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:       <apic default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='xtensa'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>32</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>sim</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>kc705</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>ml605</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>virt</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>lx200</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>lx60</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]:   <guest>
Nov 02 17:13:02 user nova-compute[74980]:     <os_type>hvm</os_type>
Nov 02 17:13:02 user nova-compute[74980]:     <arch name='xtensaeb'>
Nov 02 17:13:02 user nova-compute[74980]:       <wordsize>32</wordsize>
Nov 02 17:13:02 user nova-compute[74980]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='4'>sim</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>kc705</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>ml605</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>virt</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>lx200</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>lx60</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 02 17:13:02 user nova-compute[74980]:       <domain type='qemu'/>
Nov 02 17:13:02 user nova-compute[74980]:     </arch>
Nov 02 17:13:02 user nova-compute[74980]:     <features>
Nov 02 17:13:02 user nova-compute[74980]:       <cpuselection/>
Nov 02 17:13:02 user nova-compute[74980]:       <deviceboot/>
Nov 02 17:13:02 user nova-compute[74980]:       <disksnapshot default='on' toggle='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     </features>
Nov 02 17:13:02 user nova-compute[74980]:   </guest>
Nov 02 17:13:02 user nova-compute[74980]: </capabilities>
Nov 02 17:13:02 user nova-compute[74980]: 
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'ubuntu', 'q35'} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 02 17:13:02 user nova-compute[74980]: <domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 17:13:02 user nova-compute[74980]:   <domain>kvm</domain>
Nov 02 17:13:02 user nova-compute[74980]:   <machine>pc-i440fx-6.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:   <arch>i686</arch>
Nov 02 17:13:02 user nova-compute[74980]:   <vcpu max='255'/>
Nov 02 17:13:02 user nova-compute[74980]:   <iothreads supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:   <os supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='firmware'/>
Nov 02 17:13:02 user nova-compute[74980]:     <loader supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>rom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pflash</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='readonly'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>yes</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='secure'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </loader>
Nov 02 17:13:02 user nova-compute[74980]:   </os>
Nov 02 17:13:02 user nova-compute[74980]:   <cpu>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-passthrough' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='hostPassthroughMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='maximum' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='maximumMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>on</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-model' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <vendor>Intel</vendor>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ss'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='vmx'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='pcid'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='hypervisor'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arat'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='umip'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='md-clear'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibpb'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibrs'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='erms'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='lm'/>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='custom' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>qemu64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>qemu32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>phenom</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>n270</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>kvm64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>kvm32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>coreduo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>core2duo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>athlon</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Westmere</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Snowridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Penryn</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G5</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G4</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G1</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Nehalem</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Rome</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Milan</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Dhyana</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cooperlake</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Conroe</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>486</model>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:   </cpu>
Nov 02 17:13:02 user nova-compute[74980]:   <memoryBacking supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='sourceType'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>file</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>anonymous</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>memfd</value>
Nov 02 17:13:02 user nova-compute[74980]:     </enum>
Nov 02 17:13:02 user nova-compute[74980]:   </memoryBacking>
Nov 02 17:13:02 user nova-compute[74980]:   <devices>
Nov 02 17:13:02 user nova-compute[74980]:     <disk supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='diskDevice'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>disk</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cdrom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>floppy</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>lun</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='bus'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>ide</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>fdc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sata</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </disk>
Nov 02 17:13:02 user nova-compute[74980]:     <graphics supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sdl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vnc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>spice</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egl-headless</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </graphics>
Nov 02 17:13:02 user nova-compute[74980]:     <video supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='modelType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cirrus</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vmvga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>qxl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>none</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>bochs</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>ramfb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </video>
Nov 02 17:13:02 user nova-compute[74980]:     <hostdev supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='mode'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>subsystem</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='startupPolicy'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>default</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>mandatory</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>requisite</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>optional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='subsysType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pci</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='capsType'/>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='pciBackend'/>
Nov 02 17:13:02 user nova-compute[74980]:     </hostdev>
Nov 02 17:13:02 user nova-compute[74980]:     <rng supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>random</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egd</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>builtin</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </rng>
Nov 02 17:13:02 user nova-compute[74980]:     <filesystem supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='driverType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>path</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>handle</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtiofs</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </filesystem>
Nov 02 17:13:02 user nova-compute[74980]:     <tpm supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-tis</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-crb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>passthrough</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>emulator</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </tpm>
Nov 02 17:13:02 user nova-compute[74980]:   </devices>
Nov 02 17:13:02 user nova-compute[74980]:   <features>
Nov 02 17:13:02 user nova-compute[74980]:     <gic supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     <vmcoreinfo supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <genid supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backingStoreInput supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backup supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <sev supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:   </features>
Nov 02 17:13:02 user nova-compute[74980]: </domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:  {{(pid=74980) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 02 17:13:02 user nova-compute[74980]: <domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 17:13:02 user nova-compute[74980]:   <domain>kvm</domain>
Nov 02 17:13:02 user nova-compute[74980]:   <machine>pc-q35-jammy</machine>
Nov 02 17:13:02 user nova-compute[74980]:   <arch>i686</arch>
Nov 02 17:13:02 user nova-compute[74980]:   <vcpu max='288'/>
Nov 02 17:13:02 user nova-compute[74980]:   <iothreads supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:   <os supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='firmware'/>
Nov 02 17:13:02 user nova-compute[74980]:     <loader supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>rom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pflash</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='readonly'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>yes</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='secure'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </loader>
Nov 02 17:13:02 user nova-compute[74980]:   </os>
Nov 02 17:13:02 user nova-compute[74980]:   <cpu>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-passthrough' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='hostPassthroughMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='maximum' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='maximumMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>on</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-model' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <vendor>Intel</vendor>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ss'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='vmx'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='pcid'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='hypervisor'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arat'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='umip'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='md-clear'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibpb'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibrs'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='erms'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='lm'/>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='custom' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>qemu64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>qemu32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>phenom</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>n270</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>kvm64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>kvm32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>coreduo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>core2duo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>athlon</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Westmere</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Snowridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Penryn</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G5</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G4</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G1</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Nehalem</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Rome</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Milan</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Dhyana</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cooperlake</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Conroe</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>486</model>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:   </cpu>
Nov 02 17:13:02 user nova-compute[74980]:   <memoryBacking supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='sourceType'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>file</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>anonymous</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>memfd</value>
Nov 02 17:13:02 user nova-compute[74980]:     </enum>
Nov 02 17:13:02 user nova-compute[74980]:   </memoryBacking>
Nov 02 17:13:02 user nova-compute[74980]:   <devices>
Nov 02 17:13:02 user nova-compute[74980]:     <disk supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='diskDevice'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>disk</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cdrom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>floppy</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>lun</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='bus'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>fdc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sata</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </disk>
Nov 02 17:13:02 user nova-compute[74980]:     <graphics supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sdl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vnc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>spice</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egl-headless</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </graphics>
Nov 02 17:13:02 user nova-compute[74980]:     <video supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='modelType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cirrus</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vmvga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>qxl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>none</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>bochs</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>ramfb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </video>
Nov 02 17:13:02 user nova-compute[74980]:     <hostdev supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='mode'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>subsystem</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='startupPolicy'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>default</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>mandatory</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>requisite</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>optional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='subsysType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pci</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='capsType'/>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='pciBackend'/>
Nov 02 17:13:02 user nova-compute[74980]:     </hostdev>
Nov 02 17:13:02 user nova-compute[74980]:     <rng supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>random</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egd</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>builtin</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </rng>
Nov 02 17:13:02 user nova-compute[74980]:     <filesystem supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='driverType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>path</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>handle</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtiofs</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </filesystem>
Nov 02 17:13:02 user nova-compute[74980]:     <tpm supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-tis</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-crb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>passthrough</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>emulator</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </tpm>
Nov 02 17:13:02 user nova-compute[74980]:   </devices>
Nov 02 17:13:02 user nova-compute[74980]:   <features>
Nov 02 17:13:02 user nova-compute[74980]:     <gic supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     <vmcoreinfo supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <genid supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backingStoreInput supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backup supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <sev supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:   </features>
Nov 02 17:13:02 user nova-compute[74980]: </domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:  {{(pid=74980) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 02 17:13:02 user nova-compute[74980]: <domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 17:13:02 user nova-compute[74980]:   <domain>kvm</domain>
Nov 02 17:13:02 user nova-compute[74980]:   <machine>pc-i440fx-jammy</machine>
Nov 02 17:13:02 user nova-compute[74980]:   <arch>i686</arch>
Nov 02 17:13:02 user nova-compute[74980]:   <vcpu max='255'/>
Nov 02 17:13:02 user nova-compute[74980]:   <iothreads supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:   <os supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='firmware'/>
Nov 02 17:13:02 user nova-compute[74980]:     <loader supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>rom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pflash</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='readonly'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>yes</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='secure'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </loader>
Nov 02 17:13:02 user nova-compute[74980]:   </os>
Nov 02 17:13:02 user nova-compute[74980]:   <cpu>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-passthrough' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='hostPassthroughMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='maximum' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='maximumMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>on</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-model' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <vendor>Intel</vendor>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ss'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='vmx'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='pcid'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='hypervisor'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arat'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='umip'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='md-clear'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibpb'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibrs'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='erms'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='lm'/>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='custom' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>qemu64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>qemu32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>phenom</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>n270</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>kvm64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>kvm32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>coreduo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>core2duo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>athlon</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Westmere</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Snowridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Penryn</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G5</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G4</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G1</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Nehalem</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Rome</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Milan</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Dhyana</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cooperlake</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Conroe</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>486</model>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:   </cpu>
Nov 02 17:13:02 user nova-compute[74980]:   <memoryBacking supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='sourceType'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>file</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>anonymous</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>memfd</value>
Nov 02 17:13:02 user nova-compute[74980]:     </enum>
Nov 02 17:13:02 user nova-compute[74980]:   </memoryBacking>
Nov 02 17:13:02 user nova-compute[74980]:   <devices>
Nov 02 17:13:02 user nova-compute[74980]:     <disk supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='diskDevice'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>disk</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cdrom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>floppy</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>lun</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='bus'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>ide</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>fdc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sata</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </disk>
Nov 02 17:13:02 user nova-compute[74980]:     <graphics supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sdl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vnc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>spice</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egl-headless</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </graphics>
Nov 02 17:13:02 user nova-compute[74980]:     <video supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='modelType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cirrus</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vmvga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>qxl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>none</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>bochs</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>ramfb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </video>
Nov 02 17:13:02 user nova-compute[74980]:     <hostdev supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='mode'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>subsystem</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='startupPolicy'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>default</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>mandatory</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>requisite</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>optional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='subsysType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pci</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='capsType'/>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='pciBackend'/>
Nov 02 17:13:02 user nova-compute[74980]:     </hostdev>
Nov 02 17:13:02 user nova-compute[74980]:     <rng supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>random</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egd</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>builtin</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </rng>
Nov 02 17:13:02 user nova-compute[74980]:     <filesystem supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='driverType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>path</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>handle</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtiofs</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </filesystem>
Nov 02 17:13:02 user nova-compute[74980]:     <tpm supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-tis</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-crb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>passthrough</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>emulator</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </tpm>
Nov 02 17:13:02 user nova-compute[74980]:   </devices>
Nov 02 17:13:02 user nova-compute[74980]:   <features>
Nov 02 17:13:02 user nova-compute[74980]:     <gic supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     <vmcoreinfo supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <genid supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backingStoreInput supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backup supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <sev supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:   </features>
Nov 02 17:13:02 user nova-compute[74980]: </domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:  {{(pid=74980) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 02 17:13:02 user nova-compute[74980]: <domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 17:13:02 user nova-compute[74980]:   <domain>kvm</domain>
Nov 02 17:13:02 user nova-compute[74980]:   <machine>pc-q35-6.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:   <arch>i686</arch>
Nov 02 17:13:02 user nova-compute[74980]:   <vcpu max='288'/>
Nov 02 17:13:02 user nova-compute[74980]:   <iothreads supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:   <os supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='firmware'/>
Nov 02 17:13:02 user nova-compute[74980]:     <loader supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>rom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pflash</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='readonly'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>yes</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='secure'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </loader>
Nov 02 17:13:02 user nova-compute[74980]:   </os>
Nov 02 17:13:02 user nova-compute[74980]:   <cpu>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-passthrough' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='hostPassthroughMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='maximum' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='maximumMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>on</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-model' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <vendor>Intel</vendor>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ss'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='vmx'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='pcid'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='hypervisor'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arat'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='umip'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='md-clear'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibpb'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibrs'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='erms'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='lm'/>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='custom' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>qemu64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>qemu32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>phenom</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>n270</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>kvm64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>kvm32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>coreduo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>core2duo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>athlon</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Westmere</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Snowridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Penryn</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G5</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G4</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G1</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Nehalem</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Rome</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Milan</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Dhyana</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cooperlake</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Conroe</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>486</model>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:   </cpu>
Nov 02 17:13:02 user nova-compute[74980]:   <memoryBacking supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='sourceType'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>file</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>anonymous</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>memfd</value>
Nov 02 17:13:02 user nova-compute[74980]:     </enum>
Nov 02 17:13:02 user nova-compute[74980]:   </memoryBacking>
Nov 02 17:13:02 user nova-compute[74980]:   <devices>
Nov 02 17:13:02 user nova-compute[74980]:     <disk supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='diskDevice'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>disk</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cdrom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>floppy</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>lun</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='bus'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>fdc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sata</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </disk>
Nov 02 17:13:02 user nova-compute[74980]:     <graphics supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sdl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vnc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>spice</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egl-headless</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </graphics>
Nov 02 17:13:02 user nova-compute[74980]:     <video supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='modelType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cirrus</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vmvga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>qxl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>none</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>bochs</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>ramfb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </video>
Nov 02 17:13:02 user nova-compute[74980]:     <hostdev supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='mode'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>subsystem</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='startupPolicy'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>default</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>mandatory</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>requisite</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>optional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='subsysType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pci</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='capsType'/>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='pciBackend'/>
Nov 02 17:13:02 user nova-compute[74980]:     </hostdev>
Nov 02 17:13:02 user nova-compute[74980]:     <rng supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>random</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egd</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>builtin</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </rng>
Nov 02 17:13:02 user nova-compute[74980]:     <filesystem supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='driverType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>path</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>handle</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtiofs</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </filesystem>
Nov 02 17:13:02 user nova-compute[74980]:     <tpm supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-tis</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-crb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>passthrough</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>emulator</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </tpm>
Nov 02 17:13:02 user nova-compute[74980]:   </devices>
Nov 02 17:13:02 user nova-compute[74980]:   <features>
Nov 02 17:13:02 user nova-compute[74980]:     <gic supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     <vmcoreinfo supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <genid supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backingStoreInput supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backup supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <sev supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:   </features>
Nov 02 17:13:02 user nova-compute[74980]: </domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:  {{(pid=74980) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'ubuntu', 'q35'} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 02 17:13:02 user nova-compute[74980]: <domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 17:13:02 user nova-compute[74980]:   <domain>kvm</domain>
Nov 02 17:13:02 user nova-compute[74980]:   <machine>pc-i440fx-6.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:   <arch>x86_64</arch>
Nov 02 17:13:02 user nova-compute[74980]:   <vcpu max='255'/>
Nov 02 17:13:02 user nova-compute[74980]:   <iothreads supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:   <os supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='firmware'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>efi</value>
Nov 02 17:13:02 user nova-compute[74980]:     </enum>
Nov 02 17:13:02 user nova-compute[74980]:     <loader supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>rom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pflash</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='readonly'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>yes</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='secure'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </loader>
Nov 02 17:13:02 user nova-compute[74980]:   </os>
Nov 02 17:13:02 user nova-compute[74980]:   <cpu>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-passthrough' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='hostPassthroughMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>on</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='maximum' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='maximumMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>on</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-model' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <vendor>Intel</vendor>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ss'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='vmx'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='pcid'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='hypervisor'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arat'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='umip'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='md-clear'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='invtsc'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibpb'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibrs'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='rsba'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='erms'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='custom' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>qemu64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>qemu32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>phenom</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>n270</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>kvm64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>kvm32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>coreduo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>core2duo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>athlon</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Westmere</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Snowridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Penryn</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G5</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G4</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Opteron_G1</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Nehalem</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Rome</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Milan</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Dhyana</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cooperlake</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Conroe</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>486</model>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:   </cpu>
Nov 02 17:13:02 user nova-compute[74980]:   <memoryBacking supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='sourceType'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>file</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>anonymous</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>memfd</value>
Nov 02 17:13:02 user nova-compute[74980]:     </enum>
Nov 02 17:13:02 user nova-compute[74980]:   </memoryBacking>
Nov 02 17:13:02 user nova-compute[74980]:   <devices>
Nov 02 17:13:02 user nova-compute[74980]:     <disk supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='diskDevice'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>disk</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cdrom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>floppy</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>lun</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='bus'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>ide</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>fdc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sata</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </disk>
Nov 02 17:13:02 user nova-compute[74980]:     <graphics supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sdl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vnc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>spice</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egl-headless</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </graphics>
Nov 02 17:13:02 user nova-compute[74980]:     <video supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='modelType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cirrus</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vmvga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>qxl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>none</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>bochs</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>ramfb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </video>
Nov 02 17:13:02 user nova-compute[74980]:     <hostdev supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='mode'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>subsystem</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='startupPolicy'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>default</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>mandatory</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>requisite</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>optional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='subsysType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pci</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='capsType'/>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='pciBackend'/>
Nov 02 17:13:02 user nova-compute[74980]:     </hostdev>
Nov 02 17:13:02 user nova-compute[74980]:     <rng supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>random</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egd</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>builtin</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </rng>
Nov 02 17:13:02 user nova-compute[74980]:     <filesystem supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='driverType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>path</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>handle</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtiofs</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </filesystem>
Nov 02 17:13:02 user nova-compute[74980]:     <tpm supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-tis</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-crb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>passthrough</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>emulator</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </tpm>
Nov 02 17:13:02 user nova-compute[74980]:   </devices>
Nov 02 17:13:02 user nova-compute[74980]:   <features>
Nov 02 17:13:02 user nova-compute[74980]:     <gic supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     <vmcoreinfo supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <genid supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backingStoreInput supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backup supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <sev supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:   </features>
Nov 02 17:13:02 user nova-compute[74980]: </domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:  {{(pid=74980) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 02 17:13:02 user nova-compute[74980]: <domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 17:13:02 user nova-compute[74980]:   <domain>kvm</domain>
Nov 02 17:13:02 user nova-compute[74980]:   <machine>pc-q35-jammy</machine>
Nov 02 17:13:02 user nova-compute[74980]:   <arch>x86_64</arch>
Nov 02 17:13:02 user nova-compute[74980]:   <vcpu max='288'/>
Nov 02 17:13:02 user nova-compute[74980]:   <iothreads supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:   <os supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='firmware'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>efi</value>
Nov 02 17:13:02 user nova-compute[74980]:     </enum>
Nov 02 17:13:02 user nova-compute[74980]:     <loader supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>rom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pflash</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='readonly'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>yes</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='secure'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>yes</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </loader>
Nov 02 17:13:02 user nova-compute[74980]:   </os>
Nov 02 17:13:02 user nova-compute[74980]:   <cpu>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-passthrough' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='hostPassthroughMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>on</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='maximum' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='maximumMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>on</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-model' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <vendor>Intel</vendor>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ss'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='vmx'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='pcid'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='hypervisor'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arat'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='umip'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='md-clear'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='invtsc'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibpb'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibrs'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='rsba'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='erms'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='custom' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>qemu64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>qemu32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>phenom</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>n270</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>kvm64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>kvm32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>coreduo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>core2duo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>athlon</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Westmere</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Snowridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Penryn</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G5</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G4</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Opteron_G1</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Nehalem</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Rome</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Milan</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Dhyana</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cooperlake</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Conroe</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>486</model>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:   </cpu>
Nov 02 17:13:02 user nova-compute[74980]:   <memoryBacking supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='sourceType'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>file</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>anonymous</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>memfd</value>
Nov 02 17:13:02 user nova-compute[74980]:     </enum>
Nov 02 17:13:02 user nova-compute[74980]:   </memoryBacking>
Nov 02 17:13:02 user nova-compute[74980]:   <devices>
Nov 02 17:13:02 user nova-compute[74980]:     <disk supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='diskDevice'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>disk</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cdrom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>floppy</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>lun</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='bus'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>fdc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sata</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </disk>
Nov 02 17:13:02 user nova-compute[74980]:     <graphics supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sdl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vnc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>spice</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egl-headless</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </graphics>
Nov 02 17:13:02 user nova-compute[74980]:     <video supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='modelType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cirrus</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vmvga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>qxl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>none</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>bochs</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>ramfb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </video>
Nov 02 17:13:02 user nova-compute[74980]:     <hostdev supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='mode'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>subsystem</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='startupPolicy'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>default</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>mandatory</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>requisite</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>optional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='subsysType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pci</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='capsType'/>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='pciBackend'/>
Nov 02 17:13:02 user nova-compute[74980]:     </hostdev>
Nov 02 17:13:02 user nova-compute[74980]:     <rng supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>random</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egd</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>builtin</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </rng>
Nov 02 17:13:02 user nova-compute[74980]:     <filesystem supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='driverType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>path</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>handle</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtiofs</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </filesystem>
Nov 02 17:13:02 user nova-compute[74980]:     <tpm supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-tis</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-crb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>passthrough</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>emulator</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </tpm>
Nov 02 17:13:02 user nova-compute[74980]:   </devices>
Nov 02 17:13:02 user nova-compute[74980]:   <features>
Nov 02 17:13:02 user nova-compute[74980]:     <gic supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     <vmcoreinfo supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <genid supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backingStoreInput supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backup supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <sev supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:   </features>
Nov 02 17:13:02 user nova-compute[74980]: </domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:  {{(pid=74980) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 02 17:13:02 user nova-compute[74980]: <domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 17:13:02 user nova-compute[74980]:   <domain>kvm</domain>
Nov 02 17:13:02 user nova-compute[74980]:   <machine>pc-i440fx-jammy</machine>
Nov 02 17:13:02 user nova-compute[74980]:   <arch>x86_64</arch>
Nov 02 17:13:02 user nova-compute[74980]:   <vcpu max='255'/>
Nov 02 17:13:02 user nova-compute[74980]:   <iothreads supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:   <os supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='firmware'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>efi</value>
Nov 02 17:13:02 user nova-compute[74980]:     </enum>
Nov 02 17:13:02 user nova-compute[74980]:     <loader supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>rom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pflash</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='readonly'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>yes</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='secure'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </loader>
Nov 02 17:13:02 user nova-compute[74980]:   </os>
Nov 02 17:13:02 user nova-compute[74980]:   <cpu>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-passthrough' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='hostPassthroughMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>on</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='maximum' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='maximumMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>on</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-model' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <vendor>Intel</vendor>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ss'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='vmx'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='pcid'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='hypervisor'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arat'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='umip'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='md-clear'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='invtsc'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibpb'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibrs'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='rsba'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='erms'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='custom' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>qemu64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>qemu32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>phenom</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>n270</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>kvm64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>kvm32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>coreduo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>core2duo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>athlon</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Westmere</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Snowridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Penryn</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G5</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G4</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Opteron_G1</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Nehalem</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Rome</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Milan</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Dhyana</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cooperlake</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Conroe</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>486</model>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:   </cpu>
Nov 02 17:13:02 user nova-compute[74980]:   <memoryBacking supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='sourceType'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>file</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>anonymous</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>memfd</value>
Nov 02 17:13:02 user nova-compute[74980]:     </enum>
Nov 02 17:13:02 user nova-compute[74980]:   </memoryBacking>
Nov 02 17:13:02 user nova-compute[74980]:   <devices>
Nov 02 17:13:02 user nova-compute[74980]:     <disk supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='diskDevice'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>disk</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cdrom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>floppy</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>lun</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='bus'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>ide</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>fdc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sata</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </disk>
Nov 02 17:13:02 user nova-compute[74980]:     <graphics supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sdl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vnc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>spice</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egl-headless</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </graphics>
Nov 02 17:13:02 user nova-compute[74980]:     <video supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='modelType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cirrus</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vmvga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>qxl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>none</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>bochs</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>ramfb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </video>
Nov 02 17:13:02 user nova-compute[74980]:     <hostdev supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='mode'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>subsystem</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='startupPolicy'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>default</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>mandatory</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>requisite</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>optional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='subsysType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pci</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='capsType'/>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='pciBackend'/>
Nov 02 17:13:02 user nova-compute[74980]:     </hostdev>
Nov 02 17:13:02 user nova-compute[74980]:     <rng supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>random</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egd</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>builtin</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </rng>
Nov 02 17:13:02 user nova-compute[74980]:     <filesystem supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='driverType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>path</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>handle</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtiofs</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </filesystem>
Nov 02 17:13:02 user nova-compute[74980]:     <tpm supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-tis</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-crb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>passthrough</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>emulator</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </tpm>
Nov 02 17:13:02 user nova-compute[74980]:   </devices>
Nov 02 17:13:02 user nova-compute[74980]:   <features>
Nov 02 17:13:02 user nova-compute[74980]:     <gic supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     <vmcoreinfo supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <genid supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backingStoreInput supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backup supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <sev supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:   </features>
Nov 02 17:13:02 user nova-compute[74980]: </domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:  {{(pid=74980) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 02 17:13:02 user nova-compute[74980]: <domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 17:13:02 user nova-compute[74980]:   <domain>kvm</domain>
Nov 02 17:13:02 user nova-compute[74980]:   <machine>pc-q35-6.2</machine>
Nov 02 17:13:02 user nova-compute[74980]:   <arch>x86_64</arch>
Nov 02 17:13:02 user nova-compute[74980]:   <vcpu max='288'/>
Nov 02 17:13:02 user nova-compute[74980]:   <iothreads supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:   <os supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='firmware'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>efi</value>
Nov 02 17:13:02 user nova-compute[74980]:     </enum>
Nov 02 17:13:02 user nova-compute[74980]:     <loader supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>rom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pflash</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='readonly'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>yes</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='secure'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>yes</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>no</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </loader>
Nov 02 17:13:02 user nova-compute[74980]:   </os>
Nov 02 17:13:02 user nova-compute[74980]:   <cpu>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-passthrough' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='hostPassthroughMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>on</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='maximum' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='maximumMigratable'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>on</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>off</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='host-model' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <vendor>Intel</vendor>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ss'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='vmx'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='pcid'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='hypervisor'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arat'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='umip'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='md-clear'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='invtsc'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibpb'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='ibrs'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-stibp'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='rsba'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='erms'/>
Nov 02 17:13:02 user nova-compute[74980]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:     <mode name='custom' supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>qemu64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>qemu32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>phenom</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>pentium</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>n270</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>kvm64</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>kvm32</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>coreduo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>core2duo</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>athlon</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Westmere</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Snowridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Skylake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>SandyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Penryn</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G5</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G4</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G3</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Opteron_G2</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Opteron_G1</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Nehalem</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>IvyBridge</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Icelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Haswell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Rome</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-Milan</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>EPYC</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Dhyana</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cooperlake</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>Conroe</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='no'>Broadwell</model>
Nov 02 17:13:02 user nova-compute[74980]:       <model usable='yes'>486</model>
Nov 02 17:13:02 user nova-compute[74980]:     </mode>
Nov 02 17:13:02 user nova-compute[74980]:   </cpu>
Nov 02 17:13:02 user nova-compute[74980]:   <memoryBacking supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:     <enum name='sourceType'>
Nov 02 17:13:02 user nova-compute[74980]:       <value>file</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>anonymous</value>
Nov 02 17:13:02 user nova-compute[74980]:       <value>memfd</value>
Nov 02 17:13:02 user nova-compute[74980]:     </enum>
Nov 02 17:13:02 user nova-compute[74980]:   </memoryBacking>
Nov 02 17:13:02 user nova-compute[74980]:   <devices>
Nov 02 17:13:02 user nova-compute[74980]:     <disk supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='diskDevice'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>disk</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cdrom</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>floppy</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>lun</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='bus'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>fdc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sata</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </disk>
Nov 02 17:13:02 user nova-compute[74980]:     <graphics supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='type'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>sdl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vnc</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>spice</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egl-headless</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </graphics>
Nov 02 17:13:02 user nova-compute[74980]:     <video supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='modelType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>cirrus</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>vmvga</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>qxl</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>none</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>bochs</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>ramfb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </video>
Nov 02 17:13:02 user nova-compute[74980]:     <hostdev supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='mode'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>subsystem</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='startupPolicy'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>default</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>mandatory</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>requisite</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>optional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='subsysType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>usb</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>pci</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>scsi</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='capsType'/>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='pciBackend'/>
Nov 02 17:13:02 user nova-compute[74980]:     </hostdev>
Nov 02 17:13:02 user nova-compute[74980]:     <rng supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtio-non-transitional</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>random</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>egd</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>builtin</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </rng>
Nov 02 17:13:02 user nova-compute[74980]:     <filesystem supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='driverType'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>path</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>handle</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>virtiofs</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </filesystem>
Nov 02 17:13:02 user nova-compute[74980]:     <tpm supported='yes'>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='model'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-tis</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>tpm-crb</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:       <enum name='backendModel'>
Nov 02 17:13:02 user nova-compute[74980]:         <value>passthrough</value>
Nov 02 17:13:02 user nova-compute[74980]:         <value>emulator</value>
Nov 02 17:13:02 user nova-compute[74980]:       </enum>
Nov 02 17:13:02 user nova-compute[74980]:     </tpm>
Nov 02 17:13:02 user nova-compute[74980]:   </devices>
Nov 02 17:13:02 user nova-compute[74980]:   <features>
Nov 02 17:13:02 user nova-compute[74980]:     <gic supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:     <vmcoreinfo supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <genid supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backingStoreInput supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <backup supported='yes'/>
Nov 02 17:13:02 user nova-compute[74980]:     <sev supported='no'/>
Nov 02 17:13:02 user nova-compute[74980]:   </features>
Nov 02 17:13:02 user nova-compute[74980]: </domainCapabilities>
Nov 02 17:13:02 user nova-compute[74980]:  {{(pid=74980) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74980) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74980) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Checking secure boot support for host arch (x86_64) {{(pid=74980) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Checking secure boot support for host arch (x86_64) {{(pid=74980) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Checking secure boot support for host arch (x86_64) {{(pid=74980) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 02 17:13:02 user nova-compute[74980]: INFO nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Secure Boot support detected
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] cpu compare xml: <cpu match="exact">
Nov 02 17:13:02 user nova-compute[74980]:   <model>Nehalem</model>
Nov 02 17:13:02 user nova-compute[74980]: </cpu>
Nov 02 17:13:02 user nova-compute[74980]:  {{(pid=74980) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 02 17:13:02 user nova-compute[74980]: INFO nova.virt.node [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Generated node identity 8bc01c9c-03f1-416d-b5bd-b94d64739bca
Nov 02 17:13:02 user nova-compute[74980]: INFO nova.virt.node [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Wrote node identity 8bc01c9c-03f1-416d-b5bd-b94d64739bca to /opt/stack/data/nova/compute_id
Nov 02 17:13:02 user nova-compute[74980]: WARNING nova.compute.manager [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Compute nodes ['8bc01c9c-03f1-416d-b5bd-b94d64739bca'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 02 17:13:02 user nova-compute[74980]: INFO nova.compute.manager [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 02 17:13:02 user nova-compute[74980]: WARNING nova.compute.manager [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 02 17:13:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:13:02 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:13:02 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:13:02 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Hypervisor/Node resource view: name=user free_ram=10943MB free_disk=26.107078552246094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:13:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:13:03 user nova-compute[74980]: WARNING nova.compute.resource_tracker [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] No compute node record for user:8bc01c9c-03f1-416d-b5bd-b94d64739bca: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 8bc01c9c-03f1-416d-b5bd-b94d64739bca could not be found.
Nov 02 17:13:03 user nova-compute[74980]: INFO nova.compute.resource_tracker [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Compute node record created for user:user with uuid: 8bc01c9c-03f1-416d-b5bd-b94d64739bca
Nov 02 17:13:03 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:13:03 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:13:03 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] [req-c5138f21-f784-46a5-a49a-207e987c24ec] Created resource provider record via placement API for resource provider with UUID 8bc01c9c-03f1-416d-b5bd-b94d64739bca and name user.
Nov 02 17:13:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74980) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 02 17:13:03 user nova-compute[74980]: INFO nova.virt.libvirt.host [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] kernel doesn't support AMD SEV
Nov 02 17:13:03 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Updating inventory in ProviderTree for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 17:13:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:13:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Libvirt baseline CPU <cpu>
Nov 02 17:13:03 user nova-compute[74980]:   <arch>x86_64</arch>
Nov 02 17:13:03 user nova-compute[74980]:   <model>Nehalem</model>
Nov 02 17:13:03 user nova-compute[74980]:   <vendor>Intel</vendor>
Nov 02 17:13:03 user nova-compute[74980]:   <topology sockets="6" cores="1" threads="1"/>
Nov 02 17:13:03 user nova-compute[74980]: </cpu>
Nov 02 17:13:03 user nova-compute[74980]:  {{(pid=74980) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 02 17:13:03 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Updated inventory for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 02 17:13:03 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Updating resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca generation from 0 to 1 during operation: update_inventory {{(pid=74980) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 02 17:13:03 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Updating inventory in ProviderTree for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 17:13:03 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Updating resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca generation from 1 to 2 during operation: update_traits {{(pid=74980) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 02 17:13:03 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:13:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.622s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:13:03 user nova-compute[74980]: DEBUG nova.service [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Creating RPC server for service compute {{(pid=74980) start /opt/stack/nova/nova/service.py:182}}
Nov 02 17:13:03 user nova-compute[74980]: DEBUG nova.service [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] Join ServiceGroup membership for this service compute {{(pid=74980) start /opt/stack/nova/nova/service.py:199}}
Nov 02 17:13:03 user nova-compute[74980]: DEBUG nova.servicegroup.drivers.db [None req-1f34608d-5353-4a19-b8d6-eabfe2daeb08 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74980) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Didn't find any instances for network info cache update. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:13:55 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:13:55 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:13:55 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=10367MB free_disk=26.010902404785156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:13:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:13:56 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:13:56 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:13:56 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:13:56 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:13:56 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:13:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:13:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:14:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:14:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:14:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:14:54 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:14:54 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Didn't find any instances for network info cache update. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:14:55 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:14:55 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:14:55 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=10312MB free_disk=26.075176239013672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:14:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:14:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:14:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:14:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:15:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:15:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Didn't find any instances for network info cache update. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:15:56 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:15:56 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:15:56 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=10305MB free_disk=25.828655242919922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:15:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:15:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:15:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:15:57 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:15:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:16:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:16:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:16:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:16:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Didn't find any instances for network info cache update. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:16:57 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:16:57 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:16:57 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=9595MB free_disk=25.856719970703125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:16:57 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:16:58 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:16:58 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:16:58 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:16:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:16:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:17:00 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:17:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "4e6bfb81-f01c-47e6-b771-7c2b34587623" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:07 user nova-compute[74980]: DEBUG nova.compute.manager [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:17:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:07 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:17:07 user nova-compute[74980]: INFO nova.compute.claims [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Claim successful on node user
Nov 02 17:17:08 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG nova.network.neutron [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:17:08 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:17:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:17:08 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Creating image(s)
Nov 02 17:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "/opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "/opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "d7f2fa00-48af-4277-93b4-af930e4a650f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:08 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:17:08 user nova-compute[74980]: INFO nova.compute.claims [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Claim successful on node user
Nov 02 17:17:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666.part --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:09 user nova-compute[74980]: DEBUG nova.policy [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05186d8245f04cb19095cf71ee92f70b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7978c159e5d431aba9762331de242f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:17:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:09 user nova-compute[74980]: DEBUG nova.virt.images [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] 36a97702-8b81-46fe-8b9c-8c3e2e69141f was qcow2, converting to raw {{(pid=74980) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 17:17:09 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:17:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666.part /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666.converted {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:09 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:17:09 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:17:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.646s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:09 user nova-compute[74980]: DEBUG nova.compute.manager [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:17:09 user nova-compute[74980]: DEBUG nova.compute.manager [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:17:09 user nova-compute[74980]: DEBUG nova.network.neutron [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:17:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666.part /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666.converted" returned: 0 in 0.237s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666.converted --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:09 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:17:09 user nova-compute[74980]: DEBUG nova.compute.manager [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:17:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.265s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:09 user nova-compute[74980]: INFO oslo.privsep.daemon [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2fjii6ik/privsep.sock']
Nov 02 17:17:09 user sudo[84235]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2fjii6ik/privsep.sock
Nov 02 17:17:09 user sudo[84235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 02 17:17:09 user nova-compute[74980]: DEBUG nova.policy [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a979e164900348beaab104704c92b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889d98476584bb1b18080bfa0664810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:17:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:17:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:17:10 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Creating image(s)
Nov 02 17:17:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "/opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "/opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:17:11 user nova-compute[74980]: INFO nova.compute.claims [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Claim successful on node user
Nov 02 17:17:11 user sudo[84235]: pam_unix(sudo:session): session closed for user root
Nov 02 17:17:11 user nova-compute[74980]: INFO oslo.privsep.daemon [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Spawned new privsep daemon via rootwrap
Nov 02 17:17:11 user nova-compute[74980]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 17:17:11 user nova-compute[74980]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 17:17:11 user nova-compute[74980]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 02 17:17:11 user nova-compute[74980]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84245
Nov 02 17:17:11 user nova-compute[74980]: WARNING oslo_privsep.priv_context [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] privsep daemon already running
Nov 02 17:17:11 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:17:11 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:17:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.178s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.198s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:17:11 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Creating image(s)
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "/opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "/opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "/opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG nova.policy [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e61d486aa0bf4b1fb4332aabfa5dafd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb10da584734aedb3d08879a4ffc2b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.202s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Successfully created port: 6189316b-4df5-4f6e-ab3d-77d321a6aafb {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk 1073741824" returned: 0 in 0.048s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.236s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.183s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.207s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.209s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk 1073741824" returned: 0 in 0.042s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.254s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Cannot resize image /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Ensure instance console log exists: /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.161s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.183s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk 1073741824" returned: 0 in 0.048s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG nova.network.neutron [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Successfully created port: ea1b9b79-0495-451f-a67d-e997c88e4b60 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Cannot resize image /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Ensure instance console log exists: /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.188s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:17:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:13 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Cannot resize image /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:17:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:17:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Ensure instance console log exists: /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:17:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:14 user nova-compute[74980]: DEBUG nova.network.neutron [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Successfully created port: d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:17:15 user nova-compute[74980]: DEBUG nova.network.neutron [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Successfully updated port: 6189316b-4df5-4f6e-ab3d-77d321a6aafb {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:17:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "refresh_cache-4e6bfb81-f01c-47e6-b771-7c2b34587623" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquired lock "refresh_cache-4e6bfb81-f01c-47e6-b771-7c2b34587623" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:15 user nova-compute[74980]: DEBUG nova.network.neutron [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:17:15 user nova-compute[74980]: DEBUG nova.network.neutron [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:17:15 user nova-compute[74980]: DEBUG nova.compute.manager [req-1c1fb9a3-7eea-4d04-8b19-8000a8321574 req-4124d61b-fd85-4622-9a7f-2f4aaec60100 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Received event network-changed-6189316b-4df5-4f6e-ab3d-77d321a6aafb {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:17:15 user nova-compute[74980]: DEBUG nova.compute.manager [req-1c1fb9a3-7eea-4d04-8b19-8000a8321574 req-4124d61b-fd85-4622-9a7f-2f4aaec60100 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Refreshing instance network info cache due to event network-changed-6189316b-4df5-4f6e-ab3d-77d321a6aafb. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:17:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1c1fb9a3-7eea-4d04-8b19-8000a8321574 req-4124d61b-fd85-4622-9a7f-2f4aaec60100 service nova] Acquiring lock "refresh_cache-4e6bfb81-f01c-47e6-b771-7c2b34587623" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:15 user nova-compute[74980]: DEBUG nova.network.neutron [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Successfully updated port: ea1b9b79-0495-451f-a67d-e997c88e4b60 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:17:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "refresh_cache-d7f2fa00-48af-4277-93b4-af930e4a650f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquired lock "refresh_cache-d7f2fa00-48af-4277-93b4-af930e4a650f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:15 user nova-compute[74980]: DEBUG nova.network.neutron [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.network.neutron [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.network.neutron [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Updating instance_info_cache with network_info: [{"id": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "address": "fa:16:3e:95:9a:bc", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6189316b-4d", "ovs_interfaceid": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Releasing lock "refresh_cache-4e6bfb81-f01c-47e6-b771-7c2b34587623" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.compute.manager [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Instance network_info: |[{"id": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "address": "fa:16:3e:95:9a:bc", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6189316b-4d", "ovs_interfaceid": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1c1fb9a3-7eea-4d04-8b19-8000a8321574 req-4124d61b-fd85-4622-9a7f-2f4aaec60100 service nova] Acquired lock "refresh_cache-4e6bfb81-f01c-47e6-b771-7c2b34587623" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.network.neutron [req-1c1fb9a3-7eea-4d04-8b19-8000a8321574 req-4124d61b-fd85-4622-9a7f-2f4aaec60100 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Refreshing network info cache for port 6189316b-4df5-4f6e-ab3d-77d321a6aafb {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Start _get_guest_xml network_info=[{"id": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "address": "fa:16:3e:95:9a:bc", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6189316b-4d", "ovs_interfaceid": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:17:16 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:16 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1940927778',display_name='tempest-ServersNegativeTestJSON-server-1940927778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1940927778',id=1,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7978c159e5d431aba9762331de242f1',ramdisk_id='',reservation_id='r-8vt5t0pi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1915471849',owner_user_name='tempest-ServersNegativeTestJSON-1915471849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:09Z,user_data=None,user_id='05186d8245f04cb19095cf71ee92f70b',uuid=4e6bfb81-f01c-47e6-b771-7c2b34587623,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "address": "fa:16:3e:95:9a:bc", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6189316b-4d", "ovs_interfaceid": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Converting VIF {"id": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "address": "fa:16:3e:95:9a:bc", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6189316b-4d", "ovs_interfaceid": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:9a:bc,bridge_name='br-int',has_traffic_filtering=True,id=6189316b-4df5-4f6e-ab3d-77d321a6aafb,network=Network(e19b7ac0-cd44-4a92-8414-9f1a78021fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6189316b-4d') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.objects.instance [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e6bfb81-f01c-47e6-b771-7c2b34587623 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:17:16 user nova-compute[74980]:   <uuid>4e6bfb81-f01c-47e6-b771-7c2b34587623</uuid>
Nov 02 17:17:16 user nova-compute[74980]:   <name>instance-00000001</name>
Nov 02 17:17:16 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:17:16 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:17:16 user nova-compute[74980]:   <metadata>
Nov 02 17:17:16 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:17:16 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:17:16 user nova-compute[74980]:       <nova:name>tempest-ServersNegativeTestJSON-server-1940927778</nova:name>
Nov 02 17:17:16 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:17:16</nova:creationTime>
Nov 02 17:17:16 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:17:16 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:17:16 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:17:16 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:17:16 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:17:16 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:17:16 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:17:16 user nova-compute[74980]:       <nova:owner>
Nov 02 17:17:16 user nova-compute[74980]:         <nova:user uuid="05186d8245f04cb19095cf71ee92f70b">tempest-ServersNegativeTestJSON-1915471849-project-member</nova:user>
Nov 02 17:17:16 user nova-compute[74980]:         <nova:project uuid="e7978c159e5d431aba9762331de242f1">tempest-ServersNegativeTestJSON-1915471849</nova:project>
Nov 02 17:17:16 user nova-compute[74980]:       </nova:owner>
Nov 02 17:17:16 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:17:16 user nova-compute[74980]:       <nova:ports>
Nov 02 17:17:16 user nova-compute[74980]:         <nova:port uuid="6189316b-4df5-4f6e-ab3d-77d321a6aafb">
Nov 02 17:17:16 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 17:17:16 user nova-compute[74980]:         </nova:port>
Nov 02 17:17:16 user nova-compute[74980]:       </nova:ports>
Nov 02 17:17:16 user nova-compute[74980]:     </nova:instance>
Nov 02 17:17:16 user nova-compute[74980]:   </metadata>
Nov 02 17:17:16 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:17:16 user nova-compute[74980]:     <system>
Nov 02 17:17:16 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:17:16 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:17:16 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:17:16 user nova-compute[74980]:       <entry name="serial">4e6bfb81-f01c-47e6-b771-7c2b34587623</entry>
Nov 02 17:17:16 user nova-compute[74980]:       <entry name="uuid">4e6bfb81-f01c-47e6-b771-7c2b34587623</entry>
Nov 02 17:17:16 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:17:16 user nova-compute[74980]:     </system>
Nov 02 17:17:16 user nova-compute[74980]:   </sysinfo>
Nov 02 17:17:16 user nova-compute[74980]:   <os>
Nov 02 17:17:16 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:17:16 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:17:16 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:17:16 user nova-compute[74980]:   </os>
Nov 02 17:17:16 user nova-compute[74980]:   <features>
Nov 02 17:17:16 user nova-compute[74980]:     <acpi/>
Nov 02 17:17:16 user nova-compute[74980]:     <apic/>
Nov 02 17:17:16 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:17:16 user nova-compute[74980]:   </features>
Nov 02 17:17:16 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:17:16 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:17:16 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:17:16 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:17:16 user nova-compute[74980]:   </clock>
Nov 02 17:17:16 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:17:16 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:17:16 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:17:16 user nova-compute[74980]:   </cpu>
Nov 02 17:17:16 user nova-compute[74980]:   <devices>
Nov 02 17:17:16 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:17:16 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:17:16 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk"/>
Nov 02 17:17:16 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:17:16 user nova-compute[74980]:     </disk>
Nov 02 17:17:16 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:17:16 user nova-compute[74980]:       <mac address="fa:16:3e:95:9a:bc"/>
Nov 02 17:17:16 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:16 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:17:16 user nova-compute[74980]:       <target dev="tap6189316b-4d"/>
Nov 02 17:17:16 user nova-compute[74980]:     </interface>
Nov 02 17:17:16 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:17:16 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/console.log" append="off"/>
Nov 02 17:17:16 user nova-compute[74980]:     </serial>
Nov 02 17:17:16 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:17:16 user nova-compute[74980]:     <video>
Nov 02 17:17:16 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:16 user nova-compute[74980]:     </video>
Nov 02 17:17:16 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:17:16 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:17:16 user nova-compute[74980]:     </rng>
Nov 02 17:17:16 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:17:16 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:17:16 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:17:16 user nova-compute[74980]:     </memballoon>
Nov 02 17:17:16 user nova-compute[74980]:   </devices>
Nov 02 17:17:16 user nova-compute[74980]: </domain>
Nov 02 17:17:16 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1940927778',display_name='tempest-ServersNegativeTestJSON-server-1940927778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1940927778',id=1,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7978c159e5d431aba9762331de242f1',ramdisk_id='',reservation_id='r-8vt5t0pi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1915471849',owner_user_name='tempest-ServersNegativeTestJSON-1915471849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:09Z,user_data=None,user_id='05186d8245f04cb19095cf71ee92f70b',uuid=4e6bfb81-f01c-47e6-b771-7c2b34587623,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "address": "fa:16:3e:95:9a:bc", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6189316b-4d", "ovs_interfaceid": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Converting VIF {"id": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "address": "fa:16:3e:95:9a:bc", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6189316b-4d", "ovs_interfaceid": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:9a:bc,bridge_name='br-int',has_traffic_filtering=True,id=6189316b-4df5-4f6e-ab3d-77d321a6aafb,network=Network(e19b7ac0-cd44-4a92-8414-9f1a78021fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6189316b-4d') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG os_vif [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:9a:bc,bridge_name='br-int',has_traffic_filtering=True,id=6189316b-4df5-4f6e-ab3d-77d321a6aafb,network=Network(e19b7ac0-cd44-4a92-8414-9f1a78021fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6189316b-4d') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Created schema index Interface.name {{(pid=74980) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Created schema index Port.name {{(pid=74980) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Created schema index Bridge.name {{(pid=74980) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [POLLOUT] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a66ef4d-d9c6-5d54-bdce-26ec44bc9669', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:16 user nova-compute[74980]: INFO oslo.privsep.daemon [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpdi6y7dra/privsep.sock']
Nov 02 17:17:16 user sudo[84327]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpdi6y7dra/privsep.sock
Nov 02 17:17:16 user sudo[84327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.network.neutron [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Updating instance_info_cache with network_info: [{"id": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "address": "fa:16:3e:28:61:3f", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1b9b79-04", "ovs_interfaceid": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Releasing lock "refresh_cache-d7f2fa00-48af-4277-93b4-af930e4a650f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.compute.manager [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Instance network_info: |[{"id": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "address": "fa:16:3e:28:61:3f", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1b9b79-04", "ovs_interfaceid": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Start _get_guest_xml network_info=[{"id": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "address": "fa:16:3e:28:61:3f", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1b9b79-04", "ovs_interfaceid": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:17:17 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:17 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1569365018',display_name='tempest-AttachVolumeNegativeTest-server-1569365018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1569365018',id=2,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeHZCFkMjNxG1SEDleej369iWuE5S5LAfSIjQLR+6TwnYXqrydwMDTevfz2BB5plMzN4xj1y19/NHZy4KBw3A1bwVnVwuRec3lJVXQHZlBZsrxAlt8g5aErwdHJZdLI3g==',key_name='tempest-keypair-1637593074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b889d98476584bb1b18080bfa0664810',ramdisk_id='',reservation_id='r-q4dmt0ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1956142060',owner_user_name='tempest-AttachVolumeNegativeTest-1956142060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a979e164900348beaab104704c92b722',uuid=d7f2fa00-48af-4277-93b4-af930e4a650f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "address": "fa:16:3e:28:61:3f", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1b9b79-04", "ovs_interfaceid": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converting VIF {"id": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "address": "fa:16:3e:28:61:3f", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1b9b79-04", "ovs_interfaceid": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:61:3f,bridge_name='br-int',has_traffic_filtering=True,id=ea1b9b79-0495-451f-a67d-e997c88e4b60,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1b9b79-04') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.objects.instance [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'pci_devices' on Instance uuid d7f2fa00-48af-4277-93b4-af930e4a650f {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:17:17 user nova-compute[74980]:   <uuid>d7f2fa00-48af-4277-93b4-af930e4a650f</uuid>
Nov 02 17:17:17 user nova-compute[74980]:   <name>instance-00000002</name>
Nov 02 17:17:17 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:17:17 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:17:17 user nova-compute[74980]:   <metadata>
Nov 02 17:17:17 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:17:17 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:17:17 user nova-compute[74980]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1569365018</nova:name>
Nov 02 17:17:17 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:17:17</nova:creationTime>
Nov 02 17:17:17 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:17:17 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:17:17 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:17:17 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:17:17 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:17:17 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:17:17 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:17:17 user nova-compute[74980]:       <nova:owner>
Nov 02 17:17:17 user nova-compute[74980]:         <nova:user uuid="a979e164900348beaab104704c92b722">tempest-AttachVolumeNegativeTest-1956142060-project-member</nova:user>
Nov 02 17:17:17 user nova-compute[74980]:         <nova:project uuid="b889d98476584bb1b18080bfa0664810">tempest-AttachVolumeNegativeTest-1956142060</nova:project>
Nov 02 17:17:17 user nova-compute[74980]:       </nova:owner>
Nov 02 17:17:17 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:17:17 user nova-compute[74980]:       <nova:ports>
Nov 02 17:17:17 user nova-compute[74980]:         <nova:port uuid="ea1b9b79-0495-451f-a67d-e997c88e4b60">
Nov 02 17:17:17 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 17:17:17 user nova-compute[74980]:         </nova:port>
Nov 02 17:17:17 user nova-compute[74980]:       </nova:ports>
Nov 02 17:17:17 user nova-compute[74980]:     </nova:instance>
Nov 02 17:17:17 user nova-compute[74980]:   </metadata>
Nov 02 17:17:17 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:17:17 user nova-compute[74980]:     <system>
Nov 02 17:17:17 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:17:17 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:17:17 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:17:17 user nova-compute[74980]:       <entry name="serial">d7f2fa00-48af-4277-93b4-af930e4a650f</entry>
Nov 02 17:17:17 user nova-compute[74980]:       <entry name="uuid">d7f2fa00-48af-4277-93b4-af930e4a650f</entry>
Nov 02 17:17:17 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:17:17 user nova-compute[74980]:     </system>
Nov 02 17:17:17 user nova-compute[74980]:   </sysinfo>
Nov 02 17:17:17 user nova-compute[74980]:   <os>
Nov 02 17:17:17 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:17:17 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:17:17 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:17:17 user nova-compute[74980]:   </os>
Nov 02 17:17:17 user nova-compute[74980]:   <features>
Nov 02 17:17:17 user nova-compute[74980]:     <acpi/>
Nov 02 17:17:17 user nova-compute[74980]:     <apic/>
Nov 02 17:17:17 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:17:17 user nova-compute[74980]:   </features>
Nov 02 17:17:17 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:17:17 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:17:17 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:17:17 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:17:17 user nova-compute[74980]:   </clock>
Nov 02 17:17:17 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:17:17 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:17:17 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:17:17 user nova-compute[74980]:   </cpu>
Nov 02 17:17:17 user nova-compute[74980]:   <devices>
Nov 02 17:17:17 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:17:17 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:17:17 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk"/>
Nov 02 17:17:17 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:17:17 user nova-compute[74980]:     </disk>
Nov 02 17:17:17 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:17:17 user nova-compute[74980]:       <mac address="fa:16:3e:28:61:3f"/>
Nov 02 17:17:17 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:17 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:17:17 user nova-compute[74980]:       <target dev="tapea1b9b79-04"/>
Nov 02 17:17:17 user nova-compute[74980]:     </interface>
Nov 02 17:17:17 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:17:17 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/console.log" append="off"/>
Nov 02 17:17:17 user nova-compute[74980]:     </serial>
Nov 02 17:17:17 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:17:17 user nova-compute[74980]:     <video>
Nov 02 17:17:17 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:17 user nova-compute[74980]:     </video>
Nov 02 17:17:17 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:17:17 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:17:17 user nova-compute[74980]:     </rng>
Nov 02 17:17:17 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:17:17 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:17:17 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:17:17 user nova-compute[74980]:     </memballoon>
Nov 02 17:17:17 user nova-compute[74980]:   </devices>
Nov 02 17:17:17 user nova-compute[74980]: </domain>
Nov 02 17:17:17 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1569365018',display_name='tempest-AttachVolumeNegativeTest-server-1569365018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1569365018',id=2,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeHZCFkMjNxG1SEDleej369iWuE5S5LAfSIjQLR+6TwnYXqrydwMDTevfz2BB5plMzN4xj1y19/NHZy4KBw3A1bwVnVwuRec3lJVXQHZlBZsrxAlt8g5aErwdHJZdLI3g==',key_name='tempest-keypair-1637593074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b889d98476584bb1b18080bfa0664810',ramdisk_id='',reservation_id='r-q4dmt0ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1956142060',owner_user_name='tempest-AttachVolumeNegativeTest-1956142060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a979e164900348beaab104704c92b722',uuid=d7f2fa00-48af-4277-93b4-af930e4a650f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "address": "fa:16:3e:28:61:3f", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1b9b79-04", "ovs_interfaceid": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converting VIF {"id": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "address": "fa:16:3e:28:61:3f", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1b9b79-04", "ovs_interfaceid": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:61:3f,bridge_name='br-int',has_traffic_filtering=True,id=ea1b9b79-0495-451f-a67d-e997c88e4b60,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1b9b79-04') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG os_vif [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:61:3f,bridge_name='br-int',has_traffic_filtering=True,id=ea1b9b79-0495-451f-a67d-e997c88e4b60,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1b9b79-04') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f58ebc28-f648-5691-b8a3-223230333cc9', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.network.neutron [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Successfully updated port: d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquired lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.network.neutron [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "e9d8737b-e341-4c00-bb8c-6e1847d24418" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "e9d8737b-e341-4c00-bb8c-6e1847d24418" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:17:17 user nova-compute[74980]: INFO nova.compute.claims [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Claim successful on node user
Nov 02 17:17:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Received event network-changed-ea1b9b79-0495-451f-a67d-e997c88e4b60 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Refreshing instance network info cache due to event network-changed-ea1b9b79-0495-451f-a67d-e997c88e4b60. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] Acquiring lock "refresh_cache-d7f2fa00-48af-4277-93b4-af930e4a650f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] Acquired lock "refresh_cache-d7f2fa00-48af-4277-93b4-af930e4a650f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.network.neutron [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Refreshing network info cache for port ea1b9b79-0495-451f-a67d-e997c88e4b60 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:17:17 user nova-compute[74980]: DEBUG nova.network.neutron [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.network.neutron [req-1c1fb9a3-7eea-4d04-8b19-8000a8321574 req-4124d61b-fd85-4622-9a7f-2f4aaec60100 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Updated VIF entry in instance network info cache for port 6189316b-4df5-4f6e-ab3d-77d321a6aafb. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.network.neutron [req-1c1fb9a3-7eea-4d04-8b19-8000a8321574 req-4124d61b-fd85-4622-9a7f-2f4aaec60100 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Updating instance_info_cache with network_info: [{"id": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "address": "fa:16:3e:95:9a:bc", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6189316b-4d", "ovs_interfaceid": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1c1fb9a3-7eea-4d04-8b19-8000a8321574 req-4124d61b-fd85-4622-9a7f-2f4aaec60100 service nova] Releasing lock "refresh_cache-4e6bfb81-f01c-47e6-b771-7c2b34587623" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:18 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:17:18 user sudo[84327]: pam_unix(sudo:session): session closed for user root
Nov 02 17:17:18 user nova-compute[74980]: INFO oslo.privsep.daemon [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Spawned new privsep daemon via rootwrap
Nov 02 17:17:18 user nova-compute[74980]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 17:17:18 user nova-compute[74980]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 17:17:18 user nova-compute[74980]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 02 17:17:18 user nova-compute[74980]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84331
Nov 02 17:17:18 user nova-compute[74980]: WARNING oslo_privsep.priv_context [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] privsep daemon already running
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:17:18 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Creating image(s)
Nov 02 17:17:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "/opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "/opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.policy [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1f92dd53761465592b6d5390090f59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb03b0bde444fbc82be742d0027c0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.187s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.network.neutron [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updating instance_info_cache with network_info: [{"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Releasing lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Instance network_info: |[{"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Start _get_guest_xml network_info=[{"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:18 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:18 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:17:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1331126015',display_name='tempest-ServerActionsTestOtherA-server-1331126015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1331126015',id=3,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLnMhbM0oba6rJcByxBYQLlndi5MHkt5CHpXxfq+RJdLBsoLWmSnT0vVaxYrrZ06wl3cBC9G1WoMy7HQ9vT9DdZBt3/Q/q1q9MknpNsiMnCx1tDgUx7vQwwWmQat63Hng==',key_name='tempest-keypair-1476871667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb10da584734aedb3d08879a4ffc2b2',ramdisk_id='',reservation_id='r-4vdf07b2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-50427258',owner_user_name='tempest-ServerActionsTestOtherA-50427258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e61d486aa0bf4b1fb4332aabfa5dafd7',uuid=cef7417a-9d8f-49b7-ba6a-6fb9c1251a24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converting VIF {"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:4f:b6,bridge_name='br-int',has_traffic_filtering=True,id=d48f410f-fd59-42c7-bf39-17ccc20ad6b8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48f410f-fd') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.objects.instance [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lazy-loading 'pci_devices' on Instance uuid cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.241s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:17:19 user nova-compute[74980]:   <uuid>cef7417a-9d8f-49b7-ba6a-6fb9c1251a24</uuid>
Nov 02 17:17:19 user nova-compute[74980]:   <name>instance-00000003</name>
Nov 02 17:17:19 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:17:19 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:17:19 user nova-compute[74980]:   <metadata>
Nov 02 17:17:19 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:17:19 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:17:19 user nova-compute[74980]:       <nova:name>tempest-ServerActionsTestOtherA-server-1331126015</nova:name>
Nov 02 17:17:19 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:17:18</nova:creationTime>
Nov 02 17:17:19 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:17:19 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:17:19 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:17:19 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:17:19 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:17:19 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:17:19 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:17:19 user nova-compute[74980]:       <nova:owner>
Nov 02 17:17:19 user nova-compute[74980]:         <nova:user uuid="e61d486aa0bf4b1fb4332aabfa5dafd7">tempest-ServerActionsTestOtherA-50427258-project-member</nova:user>
Nov 02 17:17:19 user nova-compute[74980]:         <nova:project uuid="7bb10da584734aedb3d08879a4ffc2b2">tempest-ServerActionsTestOtherA-50427258</nova:project>
Nov 02 17:17:19 user nova-compute[74980]:       </nova:owner>
Nov 02 17:17:19 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:17:19 user nova-compute[74980]:       <nova:ports>
Nov 02 17:17:19 user nova-compute[74980]:         <nova:port uuid="d48f410f-fd59-42c7-bf39-17ccc20ad6b8">
Nov 02 17:17:19 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 17:17:19 user nova-compute[74980]:         </nova:port>
Nov 02 17:17:19 user nova-compute[74980]:       </nova:ports>
Nov 02 17:17:19 user nova-compute[74980]:     </nova:instance>
Nov 02 17:17:19 user nova-compute[74980]:   </metadata>
Nov 02 17:17:19 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:17:19 user nova-compute[74980]:     <system>
Nov 02 17:17:19 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:17:19 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:17:19 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:17:19 user nova-compute[74980]:       <entry name="serial">cef7417a-9d8f-49b7-ba6a-6fb9c1251a24</entry>
Nov 02 17:17:19 user nova-compute[74980]:       <entry name="uuid">cef7417a-9d8f-49b7-ba6a-6fb9c1251a24</entry>
Nov 02 17:17:19 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:17:19 user nova-compute[74980]:     </system>
Nov 02 17:17:19 user nova-compute[74980]:   </sysinfo>
Nov 02 17:17:19 user nova-compute[74980]:   <os>
Nov 02 17:17:19 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:17:19 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:17:19 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:17:19 user nova-compute[74980]:   </os>
Nov 02 17:17:19 user nova-compute[74980]:   <features>
Nov 02 17:17:19 user nova-compute[74980]:     <acpi/>
Nov 02 17:17:19 user nova-compute[74980]:     <apic/>
Nov 02 17:17:19 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:17:19 user nova-compute[74980]:   </features>
Nov 02 17:17:19 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:17:19 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:17:19 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:17:19 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:17:19 user nova-compute[74980]:   </clock>
Nov 02 17:17:19 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:17:19 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:17:19 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:17:19 user nova-compute[74980]:   </cpu>
Nov 02 17:17:19 user nova-compute[74980]:   <devices>
Nov 02 17:17:19 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:17:19 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:17:19 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk"/>
Nov 02 17:17:19 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:17:19 user nova-compute[74980]:     </disk>
Nov 02 17:17:19 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:17:19 user nova-compute[74980]:       <mac address="fa:16:3e:02:4f:b6"/>
Nov 02 17:17:19 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:19 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:17:19 user nova-compute[74980]:       <target dev="tapd48f410f-fd"/>
Nov 02 17:17:19 user nova-compute[74980]:     </interface>
Nov 02 17:17:19 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:17:19 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/console.log" append="off"/>
Nov 02 17:17:19 user nova-compute[74980]:     </serial>
Nov 02 17:17:19 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:17:19 user nova-compute[74980]:     <video>
Nov 02 17:17:19 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:19 user nova-compute[74980]:     </video>
Nov 02 17:17:19 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:17:19 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:17:19 user nova-compute[74980]:     </rng>
Nov 02 17:17:19 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:17:19 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:17:19 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:17:19 user nova-compute[74980]:     </memballoon>
Nov 02 17:17:19 user nova-compute[74980]:   </devices>
Nov 02 17:17:19 user nova-compute[74980]: </domain>
Nov 02 17:17:19 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1331126015',display_name='tempest-ServerActionsTestOtherA-server-1331126015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1331126015',id=3,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLnMhbM0oba6rJcByxBYQLlndi5MHkt5CHpXxfq+RJdLBsoLWmSnT0vVaxYrrZ06wl3cBC9G1WoMy7HQ9vT9DdZBt3/Q/q1q9MknpNsiMnCx1tDgUx7vQwwWmQat63Hng==',key_name='tempest-keypair-1476871667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb10da584734aedb3d08879a4ffc2b2',ramdisk_id='',reservation_id='r-4vdf07b2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-50427258',owner_user_name='tempest-ServerActionsTestOtherA-50427258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e61d486aa0bf4b1fb4332aabfa5dafd7',uuid=cef7417a-9d8f-49b7-ba6a-6fb9c1251a24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converting VIF {"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:4f:b6,bridge_name='br-int',has_traffic_filtering=True,id=d48f410f-fd59-42c7-bf39-17ccc20ad6b8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48f410f-fd') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG os_vif [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:4f:b6,bridge_name='br-int',has_traffic_filtering=True,id=d48f410f-fd59-42c7-bf39-17ccc20ad6b8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48f410f-fd') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0602301b-bb3a-5e89-b80c-0d9c5211c746', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk 1073741824" returned: 0 in 0.060s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea1b9b79-04, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea1b9b79-04, col_values=(('qos', UUID('7348ab2e-7ba0-444a-89ab-69723ecf7787')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea1b9b79-04, col_values=(('external_ids', {'iface-id': 'ea1b9b79-0495-451f-a67d-e997c88e4b60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:61:3f', 'vm-uuid': 'd7f2fa00-48af-4277-93b4-af930e4a650f'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:19 user nova-compute[74980]: INFO os_vif [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:61:3f,bridge_name='br-int',has_traffic_filtering=True,id=ea1b9b79-0495-451f-a67d-e997c88e4b60,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1b9b79-04')
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6189316b-4d, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6189316b-4d, col_values=(('qos', UUID('19dfef21-9ef8-405e-ac50-4e03b1fccc3f')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6189316b-4d, col_values=(('external_ids', {'iface-id': '6189316b-4df5-4f6e-ab3d-77d321a6aafb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:9a:bc', 'vm-uuid': '4e6bfb81-f01c-47e6-b771-7c2b34587623'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:19 user nova-compute[74980]: INFO os_vif [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:9a:bc,bridge_name='br-int',has_traffic_filtering=True,id=6189316b-4df5-4f6e-ab3d-77d321a6aafb,network=Network(e19b7ac0-cd44-4a92-8414-9f1a78021fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6189316b-4d')
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd48f410f-fd, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd48f410f-fd, col_values=(('qos', UUID('b9d10539-b6cc-4775-9cae-91ce87b0f158')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd48f410f-fd, col_values=(('external_ids', {'iface-id': 'd48f410f-fd59-42c7-bf39-17ccc20ad6b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:4f:b6', 'vm-uuid': 'cef7417a-9d8f-49b7-ba6a-6fb9c1251a24'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.193s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:19 user nova-compute[74980]: INFO os_vif [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:4f:b6,bridge_name='br-int',has_traffic_filtering=True,id=d48f410f-fd59-42c7-bf39-17ccc20ad6b8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48f410f-fd')
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No VIF found with MAC fa:16:3e:28:61:3f, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.network.neutron [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Updated VIF entry in instance network info cache for port ea1b9b79-0495-451f-a67d-e997c88e4b60. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.network.neutron [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Updating instance_info_cache with network_info: [{"id": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "address": "fa:16:3e:28:61:3f", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1b9b79-04", "ovs_interfaceid": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] No VIF found with MAC fa:16:3e:95:9a:bc, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] No VIF found with MAC fa:16:3e:02:4f:b6, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] Releasing lock "refresh_cache-d7f2fa00-48af-4277-93b4-af930e4a650f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Received event network-changed-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Refreshing instance network info cache due to event network-changed-d48f410f-fd59-42c7-bf39-17ccc20ad6b8. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] Acquiring lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] Acquired lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.network.neutron [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Refreshing network info cache for port d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Cannot resize image /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Ensure instance console log exists: /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:20 user nova-compute[74980]: DEBUG nova.network.neutron [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updated VIF entry in instance network info cache for port d48f410f-fd59-42c7-bf39-17ccc20ad6b8. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:17:20 user nova-compute[74980]: DEBUG nova.network.neutron [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updating instance_info_cache with network_info: [{"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5b17b13d-e5cd-4326-96a2-4ff0336ef76c req-9d5476db-e6cf-4d7d-90ea-3cb8f6f1d3e7 service nova] Releasing lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:21 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Successfully created port: 0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:17:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Successfully updated port: 0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "refresh_cache-e9d8737b-e341-4c00-bb8c-6e1847d24418" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquired lock "refresh_cache-e9d8737b-e341-4c00-bb8c-6e1847d24418" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-f7cc1bf9-22dc-4877-8a77-9a6ce8cddeb4 req-134d85ac-6aaa-4775-9eaf-52b7dd6ac00a service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Received event network-changed-0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-f7cc1bf9-22dc-4877-8a77-9a6ce8cddeb4 req-134d85ac-6aaa-4775-9eaf-52b7dd6ac00a service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Refreshing instance network info cache due to event network-changed-0864571c-261a-43f1-a1ec-0c481e22f430. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f7cc1bf9-22dc-4877-8a77-9a6ce8cddeb4 req-134d85ac-6aaa-4775-9eaf-52b7dd6ac00a service nova] Acquiring lock "refresh_cache-e9d8737b-e341-4c00-bb8c-6e1847d24418" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Updating instance_info_cache with network_info: [{"id": "0864571c-261a-43f1-a1ec-0c481e22f430", "address": "fa:16:3e:08:8e:66", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0864571c-26", "ovs_interfaceid": "0864571c-261a-43f1-a1ec-0c481e22f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Releasing lock "refresh_cache-e9d8737b-e341-4c00-bb8c-6e1847d24418" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Instance network_info: |[{"id": "0864571c-261a-43f1-a1ec-0c481e22f430", "address": "fa:16:3e:08:8e:66", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0864571c-26", "ovs_interfaceid": "0864571c-261a-43f1-a1ec-0c481e22f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f7cc1bf9-22dc-4877-8a77-9a6ce8cddeb4 req-134d85ac-6aaa-4775-9eaf-52b7dd6ac00a service nova] Acquired lock "refresh_cache-e9d8737b-e341-4c00-bb8c-6e1847d24418" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG nova.network.neutron [req-f7cc1bf9-22dc-4877-8a77-9a6ce8cddeb4 req-134d85ac-6aaa-4775-9eaf-52b7dd6ac00a service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Refreshing network info cache for port 0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Start _get_guest_xml network_info=[{"id": "0864571c-261a-43f1-a1ec-0c481e22f430", "address": "fa:16:3e:08:8e:66", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0864571c-26", "ovs_interfaceid": "0864571c-261a-43f1-a1ec-0c481e22f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:17:23 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:23 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:17:24 user nova-compute[74980]: INFO nova.compute.claims [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Claim successful on node user
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1400154423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1400154423',id=4,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEP4qQYJL6H6UKq6nH6AswOA1zi+zAJjZ+sS43goRLZGiDdVoXCQpJwUxjB41ygCvVugbyNvx0HHWG74gfXP/7htzc43wKdNJJ5GPfvY8Iv0gNOxFnxRbspNqN3E5KvnEQ==',key_name='tempest-keypair-1546098073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccb03b0bde444fbc82be742d0027c0ec',ramdisk_id='',reservation_id='r-c55pmg0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1991165793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1991165793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1f92dd53761465592b6d5390090f59f',uuid=e9d8737b-e341-4c00-bb8c-6e1847d24418,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0864571c-261a-43f1-a1ec-0c481e22f430", "address": "fa:16:3e:08:8e:66", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0864571c-26", "ovs_interfaceid": "0864571c-261a-43f1-a1ec-0c481e22f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converting VIF {"id": "0864571c-261a-43f1-a1ec-0c481e22f430", "address": "fa:16:3e:08:8e:66", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0864571c-26", "ovs_interfaceid": "0864571c-261a-43f1-a1ec-0c481e22f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:8e:66,bridge_name='br-int',has_traffic_filtering=True,id=0864571c-261a-43f1-a1ec-0c481e22f430,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0864571c-26') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.objects.instance [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lazy-loading 'pci_devices' on Instance uuid e9d8737b-e341-4c00-bb8c-6e1847d24418 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:17:24 user nova-compute[74980]:   <uuid>e9d8737b-e341-4c00-bb8c-6e1847d24418</uuid>
Nov 02 17:17:24 user nova-compute[74980]:   <name>instance-00000004</name>
Nov 02 17:17:24 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:17:24 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:17:24 user nova-compute[74980]:   <metadata>
Nov 02 17:17:24 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:17:24 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:17:24 user nova-compute[74980]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1400154423</nova:name>
Nov 02 17:17:24 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:17:23</nova:creationTime>
Nov 02 17:17:24 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:17:24 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:17:24 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:17:24 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:17:24 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:17:24 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:17:24 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:17:24 user nova-compute[74980]:       <nova:owner>
Nov 02 17:17:24 user nova-compute[74980]:         <nova:user uuid="f1f92dd53761465592b6d5390090f59f">tempest-AttachVolumeShelveTestJSON-1991165793-project-member</nova:user>
Nov 02 17:17:24 user nova-compute[74980]:         <nova:project uuid="ccb03b0bde444fbc82be742d0027c0ec">tempest-AttachVolumeShelveTestJSON-1991165793</nova:project>
Nov 02 17:17:24 user nova-compute[74980]:       </nova:owner>
Nov 02 17:17:24 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:17:24 user nova-compute[74980]:       <nova:ports>
Nov 02 17:17:24 user nova-compute[74980]:         <nova:port uuid="0864571c-261a-43f1-a1ec-0c481e22f430">
Nov 02 17:17:24 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 17:17:24 user nova-compute[74980]:         </nova:port>
Nov 02 17:17:24 user nova-compute[74980]:       </nova:ports>
Nov 02 17:17:24 user nova-compute[74980]:     </nova:instance>
Nov 02 17:17:24 user nova-compute[74980]:   </metadata>
Nov 02 17:17:24 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:17:24 user nova-compute[74980]:     <system>
Nov 02 17:17:24 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:17:24 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:17:24 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:17:24 user nova-compute[74980]:       <entry name="serial">e9d8737b-e341-4c00-bb8c-6e1847d24418</entry>
Nov 02 17:17:24 user nova-compute[74980]:       <entry name="uuid">e9d8737b-e341-4c00-bb8c-6e1847d24418</entry>
Nov 02 17:17:24 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:17:24 user nova-compute[74980]:     </system>
Nov 02 17:17:24 user nova-compute[74980]:   </sysinfo>
Nov 02 17:17:24 user nova-compute[74980]:   <os>
Nov 02 17:17:24 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:17:24 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:17:24 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:17:24 user nova-compute[74980]:   </os>
Nov 02 17:17:24 user nova-compute[74980]:   <features>
Nov 02 17:17:24 user nova-compute[74980]:     <acpi/>
Nov 02 17:17:24 user nova-compute[74980]:     <apic/>
Nov 02 17:17:24 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:17:24 user nova-compute[74980]:   </features>
Nov 02 17:17:24 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:17:24 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:17:24 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:17:24 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:17:24 user nova-compute[74980]:   </clock>
Nov 02 17:17:24 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:17:24 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:17:24 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:17:24 user nova-compute[74980]:   </cpu>
Nov 02 17:17:24 user nova-compute[74980]:   <devices>
Nov 02 17:17:24 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:17:24 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:17:24 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk"/>
Nov 02 17:17:24 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:17:24 user nova-compute[74980]:     </disk>
Nov 02 17:17:24 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:17:24 user nova-compute[74980]:       <mac address="fa:16:3e:08:8e:66"/>
Nov 02 17:17:24 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:24 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:17:24 user nova-compute[74980]:       <target dev="tap0864571c-26"/>
Nov 02 17:17:24 user nova-compute[74980]:     </interface>
Nov 02 17:17:24 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:17:24 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/console.log" append="off"/>
Nov 02 17:17:24 user nova-compute[74980]:     </serial>
Nov 02 17:17:24 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:17:24 user nova-compute[74980]:     <video>
Nov 02 17:17:24 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:24 user nova-compute[74980]:     </video>
Nov 02 17:17:24 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:17:24 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:17:24 user nova-compute[74980]:     </rng>
Nov 02 17:17:24 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:17:24 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:17:24 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:17:24 user nova-compute[74980]:     </memballoon>
Nov 02 17:17:24 user nova-compute[74980]:   </devices>
Nov 02 17:17:24 user nova-compute[74980]: </domain>
Nov 02 17:17:24 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1400154423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1400154423',id=4,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEP4qQYJL6H6UKq6nH6AswOA1zi+zAJjZ+sS43goRLZGiDdVoXCQpJwUxjB41ygCvVugbyNvx0HHWG74gfXP/7htzc43wKdNJJ5GPfvY8Iv0gNOxFnxRbspNqN3E5KvnEQ==',key_name='tempest-keypair-1546098073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccb03b0bde444fbc82be742d0027c0ec',ramdisk_id='',reservation_id='r-c55pmg0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1991165793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1991165793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1f92dd53761465592b6d5390090f59f',uuid=e9d8737b-e341-4c00-bb8c-6e1847d24418,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0864571c-261a-43f1-a1ec-0c481e22f430", "address": "fa:16:3e:08:8e:66", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0864571c-26", "ovs_interfaceid": "0864571c-261a-43f1-a1ec-0c481e22f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converting VIF {"id": "0864571c-261a-43f1-a1ec-0c481e22f430", "address": "fa:16:3e:08:8e:66", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0864571c-26", "ovs_interfaceid": "0864571c-261a-43f1-a1ec-0c481e22f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:8e:66,bridge_name='br-int',has_traffic_filtering=True,id=0864571c-261a-43f1-a1ec-0c481e22f430,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0864571c-26') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG os_vif [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:8e:66,bridge_name='br-int',has_traffic_filtering=True,id=0864571c-261a-43f1-a1ec-0c481e22f430,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0864571c-26') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '474bbade-54d9-5e1e-acce-34a68271cae7', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0864571c-26, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0864571c-26, col_values=(('qos', UUID('e956cfea-7aa5-42f2-9af1-0596553fdb1f')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0864571c-26, col_values=(('external_ids', {'iface-id': '0864571c-261a-43f1-a1ec-0c481e22f430', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:8e:66', 'vm-uuid': 'e9d8737b-e341-4c00-bb8c-6e1847d24418'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:24 user nova-compute[74980]: INFO os_vif [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:8e:66,bridge_name='br-int',has_traffic_filtering=True,id=0864571c-261a-43f1-a1ec-0c481e22f430,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0864571c-26')
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] No VIF found with MAC fa:16:3e:08:8e:66, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:17:24 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:17:24 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Creating image(s)
Nov 02 17:17:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "/opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "/opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "/opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.policy [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdf10ea963dd41a0b41493d5c9dd8d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c80ea4c5594618a1eb984162ab9a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.network.neutron [req-f7cc1bf9-22dc-4877-8a77-9a6ce8cddeb4 req-134d85ac-6aaa-4775-9eaf-52b7dd6ac00a service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Updated VIF entry in instance network info cache for port 0864571c-261a-43f1-a1ec-0c481e22f430. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG nova.network.neutron [req-f7cc1bf9-22dc-4877-8a77-9a6ce8cddeb4 req-134d85ac-6aaa-4775-9eaf-52b7dd6ac00a service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Updating instance_info_cache with network_info: [{"id": "0864571c-261a-43f1-a1ec-0c481e22f430", "address": "fa:16:3e:08:8e:66", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0864571c-26", "ovs_interfaceid": "0864571c-261a-43f1-a1ec-0c481e22f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f7cc1bf9-22dc-4877-8a77-9a6ce8cddeb4 req-134d85ac-6aaa-4775-9eaf-52b7dd6ac00a service nova] Releasing lock "refresh_cache-e9d8737b-e341-4c00-bb8c-6e1847d24418" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.209s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.186s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk 1073741824" returned: 0 in 0.086s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.299s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Cannot resize image /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Ensure instance console log exists: /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:26 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:17:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:17:26 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Instance spawned successfully.
Nov 02 17:17:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:17:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:26 user nova-compute[74980]: INFO nova.compute.manager [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Took 14.82 seconds to spawn the instance on the hypervisor.
Nov 02 17:17:26 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:17:26 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Successfully created port: b915b940-4c54-4954-9996-938c74f1d50f {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:17:26 user nova-compute[74980]: INFO nova.compute.manager [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Took 15.93 seconds to build instance.
Nov 02 17:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da0dd86f-38d6-4066-965a-a3bcbc9a8d84 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.078s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:17:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:17:27 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Instance spawned successfully.
Nov 02 17:17:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:17:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:27 user nova-compute[74980]: INFO nova.compute.manager [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Took 17.60 seconds to spawn the instance on the hypervisor.
Nov 02 17:17:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:17:27 user nova-compute[74980]: INFO nova.compute.manager [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Took 18.87 seconds to build instance.
Nov 02 17:17:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-31926f87-2705-4648-bab1-c735996b379b tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.013s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:17:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:17:27 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Instance spawned successfully.
Nov 02 17:17:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:28 user nova-compute[74980]: INFO nova.compute.manager [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Took 19.48 seconds to spawn the instance on the hypervisor.
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.compute.manager [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:17:28 user nova-compute[74980]: INFO nova.compute.manager [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Took 20.67 seconds to build instance.
Nov 02 17:17:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a8a0892-2e9d-46bb-9e7f-6eda8c8cdd63 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.020s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:17:28 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Instance spawned successfully.
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Successfully updated port: b915b940-4c54-4954-9996-938c74f1d50f {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "refresh_cache-1154d1f9-80b8-405b-8fd8-c10bb39c507f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquired lock "refresh_cache-1154d1f9-80b8-405b-8fd8-c10bb39c507f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:17:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:29 user nova-compute[74980]: INFO nova.compute.manager [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Took 10.47 seconds to spawn the instance on the hypervisor.
Nov 02 17:17:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:17:29 user nova-compute[74980]: DEBUG nova.compute.manager [req-f733cc43-1bb2-403a-abb8-540bea1d144f req-a072044a-f267-413e-bca8-cd309137d106 service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Received event network-changed-b915b940-4c54-4954-9996-938c74f1d50f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:17:29 user nova-compute[74980]: DEBUG nova.compute.manager [req-f733cc43-1bb2-403a-abb8-540bea1d144f req-a072044a-f267-413e-bca8-cd309137d106 service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Refreshing instance network info cache due to event network-changed-b915b940-4c54-4954-9996-938c74f1d50f. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:17:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f733cc43-1bb2-403a-abb8-540bea1d144f req-a072044a-f267-413e-bca8-cd309137d106 service nova] Acquiring lock "refresh_cache-1154d1f9-80b8-405b-8fd8-c10bb39c507f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:29 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:17:29 user nova-compute[74980]: INFO nova.compute.manager [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Took 11.60 seconds to build instance.
Nov 02 17:17:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8c268ab6-aae2-4da4-a802-0bb36557b21e tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "e9d8737b-e341-4c00-bb8c-6e1847d24418" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.007s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Updating instance_info_cache with network_info: [{"id": "b915b940-4c54-4954-9996-938c74f1d50f", "address": "fa:16:3e:5d:ba:b9", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb915b940-4c", "ovs_interfaceid": "b915b940-4c54-4954-9996-938c74f1d50f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Releasing lock "refresh_cache-1154d1f9-80b8-405b-8fd8-c10bb39c507f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Instance network_info: |[{"id": "b915b940-4c54-4954-9996-938c74f1d50f", "address": "fa:16:3e:5d:ba:b9", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb915b940-4c", "ovs_interfaceid": "b915b940-4c54-4954-9996-938c74f1d50f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f733cc43-1bb2-403a-abb8-540bea1d144f req-a072044a-f267-413e-bca8-cd309137d106 service nova] Acquired lock "refresh_cache-1154d1f9-80b8-405b-8fd8-c10bb39c507f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.network.neutron [req-f733cc43-1bb2-403a-abb8-540bea1d144f req-a072044a-f267-413e-bca8-cd309137d106 service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Refreshing network info cache for port b915b940-4c54-4954-9996-938c74f1d50f {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Start _get_guest_xml network_info=[{"id": "b915b940-4c54-4954-9996-938c74f1d50f", "address": "fa:16:3e:5d:ba:b9", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb915b940-4c", "ovs_interfaceid": "b915b940-4c54-4954-9996-938c74f1d50f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:17:30 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:30 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1187757527',display_name='tempest-VolumesAdminNegativeTest-server-1187757527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1187757527',id=5,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmuMDLeFBUg+z1XLKM4p7PaLhvt7TypfLAI0nsRFStncW8EkIuRKk3lRED0kkqVIrKDPfVMci5HlLzkxtS2E6b/eAa1RCrxQ9bwqNOofjD2zkCIhOe6SlD5sgrgK8QZxA==',key_name='tempest-keypair-676059616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c80ea4c5594618a1eb984162ab9a88',ramdisk_id='',reservation_id='r-vwn829ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1454371770',owner_user_name='tempest-VolumesAdminNegativeTest-1454371770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf10ea963dd41a0b41493d5c9dd8d4a',uuid=1154d1f9-80b8-405b-8fd8-c10bb39c507f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b915b940-4c54-4954-9996-938c74f1d50f", "address": "fa:16:3e:5d:ba:b9", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb915b940-4c", "ovs_interfaceid": "b915b940-4c54-4954-9996-938c74f1d50f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Converting VIF {"id": "b915b940-4c54-4954-9996-938c74f1d50f", "address": "fa:16:3e:5d:ba:b9", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb915b940-4c", "ovs_interfaceid": "b915b940-4c54-4954-9996-938c74f1d50f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ba:b9,bridge_name='br-int',has_traffic_filtering=True,id=b915b940-4c54-4954-9996-938c74f1d50f,network=Network(d2d80d29-bc80-47d0-b989-112114a8523e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb915b940-4c') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.objects.instance [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lazy-loading 'pci_devices' on Instance uuid 1154d1f9-80b8-405b-8fd8-c10bb39c507f {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:17:30 user nova-compute[74980]:   <uuid>1154d1f9-80b8-405b-8fd8-c10bb39c507f</uuid>
Nov 02 17:17:30 user nova-compute[74980]:   <name>instance-00000005</name>
Nov 02 17:17:30 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:17:30 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:17:30 user nova-compute[74980]:   <metadata>
Nov 02 17:17:30 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:17:30 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:17:30 user nova-compute[74980]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1187757527</nova:name>
Nov 02 17:17:30 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:17:30</nova:creationTime>
Nov 02 17:17:30 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:17:30 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:17:30 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:17:30 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:17:30 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:17:30 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:17:30 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:17:30 user nova-compute[74980]:       <nova:owner>
Nov 02 17:17:30 user nova-compute[74980]:         <nova:user uuid="fdf10ea963dd41a0b41493d5c9dd8d4a">tempest-VolumesAdminNegativeTest-1454371770-project-member</nova:user>
Nov 02 17:17:30 user nova-compute[74980]:         <nova:project uuid="77c80ea4c5594618a1eb984162ab9a88">tempest-VolumesAdminNegativeTest-1454371770</nova:project>
Nov 02 17:17:30 user nova-compute[74980]:       </nova:owner>
Nov 02 17:17:30 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:17:30 user nova-compute[74980]:       <nova:ports>
Nov 02 17:17:30 user nova-compute[74980]:         <nova:port uuid="b915b940-4c54-4954-9996-938c74f1d50f">
Nov 02 17:17:30 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 17:17:30 user nova-compute[74980]:         </nova:port>
Nov 02 17:17:30 user nova-compute[74980]:       </nova:ports>
Nov 02 17:17:30 user nova-compute[74980]:     </nova:instance>
Nov 02 17:17:30 user nova-compute[74980]:   </metadata>
Nov 02 17:17:30 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:17:30 user nova-compute[74980]:     <system>
Nov 02 17:17:30 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:17:30 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:17:30 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:17:30 user nova-compute[74980]:       <entry name="serial">1154d1f9-80b8-405b-8fd8-c10bb39c507f</entry>
Nov 02 17:17:30 user nova-compute[74980]:       <entry name="uuid">1154d1f9-80b8-405b-8fd8-c10bb39c507f</entry>
Nov 02 17:17:30 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:17:30 user nova-compute[74980]:     </system>
Nov 02 17:17:30 user nova-compute[74980]:   </sysinfo>
Nov 02 17:17:30 user nova-compute[74980]:   <os>
Nov 02 17:17:30 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:17:30 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:17:30 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:17:30 user nova-compute[74980]:   </os>
Nov 02 17:17:30 user nova-compute[74980]:   <features>
Nov 02 17:17:30 user nova-compute[74980]:     <acpi/>
Nov 02 17:17:30 user nova-compute[74980]:     <apic/>
Nov 02 17:17:30 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:17:30 user nova-compute[74980]:   </features>
Nov 02 17:17:30 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:17:30 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:17:30 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:17:30 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:17:30 user nova-compute[74980]:   </clock>
Nov 02 17:17:30 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:17:30 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:17:30 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:17:30 user nova-compute[74980]:   </cpu>
Nov 02 17:17:30 user nova-compute[74980]:   <devices>
Nov 02 17:17:30 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:17:30 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:17:30 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk"/>
Nov 02 17:17:30 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:17:30 user nova-compute[74980]:     </disk>
Nov 02 17:17:30 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:17:30 user nova-compute[74980]:       <mac address="fa:16:3e:5d:ba:b9"/>
Nov 02 17:17:30 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:30 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:17:30 user nova-compute[74980]:       <target dev="tapb915b940-4c"/>
Nov 02 17:17:30 user nova-compute[74980]:     </interface>
Nov 02 17:17:30 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:17:30 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/console.log" append="off"/>
Nov 02 17:17:30 user nova-compute[74980]:     </serial>
Nov 02 17:17:30 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:17:30 user nova-compute[74980]:     <video>
Nov 02 17:17:30 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:30 user nova-compute[74980]:     </video>
Nov 02 17:17:30 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:17:30 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:17:30 user nova-compute[74980]:     </rng>
Nov 02 17:17:30 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:17:30 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:17:30 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:17:30 user nova-compute[74980]:     </memballoon>
Nov 02 17:17:30 user nova-compute[74980]:   </devices>
Nov 02 17:17:30 user nova-compute[74980]: </domain>
Nov 02 17:17:30 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1187757527',display_name='tempest-VolumesAdminNegativeTest-server-1187757527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1187757527',id=5,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmuMDLeFBUg+z1XLKM4p7PaLhvt7TypfLAI0nsRFStncW8EkIuRKk3lRED0kkqVIrKDPfVMci5HlLzkxtS2E6b/eAa1RCrxQ9bwqNOofjD2zkCIhOe6SlD5sgrgK8QZxA==',key_name='tempest-keypair-676059616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c80ea4c5594618a1eb984162ab9a88',ramdisk_id='',reservation_id='r-vwn829ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1454371770',owner_user_name='tempest-VolumesAdminNegativeTest-1454371770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf10ea963dd41a0b41493d5c9dd8d4a',uuid=1154d1f9-80b8-405b-8fd8-c10bb39c507f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b915b940-4c54-4954-9996-938c74f1d50f", "address": "fa:16:3e:5d:ba:b9", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb915b940-4c", "ovs_interfaceid": "b915b940-4c54-4954-9996-938c74f1d50f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Converting VIF {"id": "b915b940-4c54-4954-9996-938c74f1d50f", "address": "fa:16:3e:5d:ba:b9", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb915b940-4c", "ovs_interfaceid": "b915b940-4c54-4954-9996-938c74f1d50f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ba:b9,bridge_name='br-int',has_traffic_filtering=True,id=b915b940-4c54-4954-9996-938c74f1d50f,network=Network(d2d80d29-bc80-47d0-b989-112114a8523e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb915b940-4c') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG os_vif [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ba:b9,bridge_name='br-int',has_traffic_filtering=True,id=b915b940-4c54-4954-9996-938c74f1d50f,network=Network(d2d80d29-bc80-47d0-b989-112114a8523e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb915b940-4c') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb19ec49-2f60-54db-897d-f315b035f4d2', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb915b940-4c, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb915b940-4c, col_values=(('qos', UUID('75ad6429-4edc-46a6-b478-01b1df4e5d00')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb915b940-4c, col_values=(('external_ids', {'iface-id': 'b915b940-4c54-4954-9996-938c74f1d50f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:ba:b9', 'vm-uuid': '1154d1f9-80b8-405b-8fd8-c10bb39c507f'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:30 user nova-compute[74980]: INFO os_vif [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ba:b9,bridge_name='br-int',has_traffic_filtering=True,id=b915b940-4c54-4954-9996-938c74f1d50f,network=Network(d2d80d29-bc80-47d0-b989-112114a8523e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb915b940-4c')
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] No VIF found with MAC fa:16:3e:5d:ba:b9, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "9ef84810-0506-4439-9302-72b239c8dddd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "9ef84810-0506-4439-9302-72b239c8dddd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:17:31 user nova-compute[74980]: INFO nova.compute.claims [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Claim successful on node user
Nov 02 17:17:31 user nova-compute[74980]: DEBUG nova.network.neutron [req-f733cc43-1bb2-403a-abb8-540bea1d144f req-a072044a-f267-413e-bca8-cd309137d106 service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Updated VIF entry in instance network info cache for port b915b940-4c54-4954-9996-938c74f1d50f. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:17:31 user nova-compute[74980]: DEBUG nova.network.neutron [req-f733cc43-1bb2-403a-abb8-540bea1d144f req-a072044a-f267-413e-bca8-cd309137d106 service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Updating instance_info_cache with network_info: [{"id": "b915b940-4c54-4954-9996-938c74f1d50f", "address": "fa:16:3e:5d:ba:b9", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb915b940-4c", "ovs_interfaceid": "b915b940-4c54-4954-9996-938c74f1d50f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f733cc43-1bb2-403a-abb8-540bea1d144f req-a072044a-f267-413e-bca8-cd309137d106 service nova] Releasing lock "refresh_cache-1154d1f9-80b8-405b-8fd8-c10bb39c507f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:31 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:17:31 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:17:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.791s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:31 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:17:31 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:17:31 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:17:31 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 02 17:17:31 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:17:32 user nova-compute[74980]: DEBUG nova.policy [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b57eb271bb7e41d4a681668205f13fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5510f386174150b459057618f4d82a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:17:32 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:17:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:17:32 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Creating image(s)
Nov 02 17:17:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "/opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "/opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "2213305e0b4bb734d1ba23e3746e5dab20a0fbd3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "2213305e0b4bb734d1ba23e3746e5dab20a0fbd3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3.part --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3.part --force-share --output=json" returned: 0 in 0.309s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:33 user nova-compute[74980]: DEBUG nova.virt.images [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] 8c68b031-691b-4379-8c2e-c7776b623872 was qcow2, converting to raw {{(pid=74980) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 17:17:33 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:17:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3.part /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3.converted {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3.part /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3.converted" returned: 0 in 0.274s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3.converted --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3.converted --force-share --output=json" returned: 0 in 0.267s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "2213305e0b4bb734d1ba23e3746e5dab20a0fbd3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.647s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:34 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Successfully created port: d9d93843-971c-477e-9e3a-f3065c32bf63 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:17:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3 --force-share --output=json" returned: 0 in 0.530s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "2213305e0b4bb734d1ba23e3746e5dab20a0fbd3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "2213305e0b4bb734d1ba23e3746e5dab20a0fbd3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3 --force-share --output=json" returned: 0 in 0.369s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3,backing_fmt=raw /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3,backing_fmt=raw /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk 1073741824" returned: 0 in 0.077s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "2213305e0b4bb734d1ba23e3746e5dab20a0fbd3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.453s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3 --force-share --output=json" returned: 0 in 0.301s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Cannot resize image /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Ensure instance console log exists: /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Successfully updated port: d9d93843-971c-477e-9e3a-f3065c32bf63 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "refresh_cache-9ef84810-0506-4439-9302-72b239c8dddd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquired lock "refresh_cache-9ef84810-0506-4439-9302-72b239c8dddd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-79aac6d9-3f76-4388-aeac-b89d67d6ddde req-75ae698b-0eeb-42d6-b6ee-cfca07255ced service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Received event network-changed-d9d93843-971c-477e-9e3a-f3065c32bf63 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-79aac6d9-3f76-4388-aeac-b89d67d6ddde req-75ae698b-0eeb-42d6-b6ee-cfca07255ced service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Refreshing instance network info cache due to event network-changed-d9d93843-971c-477e-9e3a-f3065c32bf63. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-79aac6d9-3f76-4388-aeac-b89d67d6ddde req-75ae698b-0eeb-42d6-b6ee-cfca07255ced service nova] Acquiring lock "refresh_cache-9ef84810-0506-4439-9302-72b239c8dddd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:35 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:17:36 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Instance spawned successfully.
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Updating instance_info_cache with network_info: [{"id": "d9d93843-971c-477e-9e3a-f3065c32bf63", "address": "fa:16:3e:42:50:a7", "network": {"id": "77a350e1-e514-4d3b-889c-0b93f203d3a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-403711479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5510f386174150b459057618f4d82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d93843-97", "ovs_interfaceid": "d9d93843-971c-477e-9e3a-f3065c32bf63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Releasing lock "refresh_cache-9ef84810-0506-4439-9302-72b239c8dddd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Instance network_info: |[{"id": "d9d93843-971c-477e-9e3a-f3065c32bf63", "address": "fa:16:3e:42:50:a7", "network": {"id": "77a350e1-e514-4d3b-889c-0b93f203d3a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-403711479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5510f386174150b459057618f4d82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d93843-97", "ovs_interfaceid": "d9d93843-971c-477e-9e3a-f3065c32bf63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-79aac6d9-3f76-4388-aeac-b89d67d6ddde req-75ae698b-0eeb-42d6-b6ee-cfca07255ced service nova] Acquired lock "refresh_cache-9ef84810-0506-4439-9302-72b239c8dddd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.network.neutron [req-79aac6d9-3f76-4388-aeac-b89d67d6ddde req-75ae698b-0eeb-42d6-b6ee-cfca07255ced service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Refreshing network info cache for port d9d93843-971c-477e-9e3a-f3065c32bf63 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Start _get_guest_xml network_info=[{"id": "d9d93843-971c-477e-9e3a-f3065c32bf63", "address": "fa:16:3e:42:50:a7", "network": {"id": "77a350e1-e514-4d3b-889c-0b93f203d3a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-403711479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5510f386174150b459057618f4d82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d93843-97", "ovs_interfaceid": "d9d93843-971c-477e-9e3a-f3065c32bf63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:17:22Z,direct_url=<?>,disk_format='qcow2',id=8c68b031-691b-4379-8c2e-c7776b623872,min_disk=0,min_ram=0,name='',owner='da7cb82d0835426cab4a0ccd1ef47765',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:17:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'scsi', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '8c68b031-691b-4379-8c2e-c7776b623872'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:17:36 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:36 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:17:22Z,direct_url=<?>,disk_format='qcow2',id=8c68b031-691b-4379-8c2e-c7776b623872,min_disk=0,min_ram=0,name='',owner='da7cb82d0835426cab4a0ccd1ef47765',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:17:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-924999295',display_name='tempest-AttachSCSIVolumeTestJSON-server-924999295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-924999295',id=6,image_ref='8c68b031-691b-4379-8c2e-c7776b623872',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcsiz2ukAq9Wv4M/GBGxq1E7VWaPQdwLf13GaWNPNr8rYp6rN5NeNS/9Twg+eNHgDLL75EDTLMjw0WexUAIS0viFZOtH2nnHX4YswipGJ1J4eV1yP3ZyiiGK95+sYALTQ==',key_name='tempest-keypair-1440925866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da5510f386174150b459057618f4d82a',ramdisk_id='',reservation_id='r-vsn8y5nh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8c68b031-691b-4379-8c2e-c7776b623872',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1465154663',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1465154663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b57eb271bb7e41d4a681668205f13fcc',uuid=9ef84810-0506-4439-9302-72b239c8dddd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9d93843-971c-477e-9e3a-f3065c32bf63", "address": "fa:16:3e:42:50:a7", "network": {"id": "77a350e1-e514-4d3b-889c-0b93f203d3a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-403711479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5510f386174150b459057618f4d82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d93843-97", "ovs_interfaceid": "d9d93843-971c-477e-9e3a-f3065c32bf63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Converting VIF {"id": "d9d93843-971c-477e-9e3a-f3065c32bf63", "address": "fa:16:3e:42:50:a7", "network": {"id": "77a350e1-e514-4d3b-889c-0b93f203d3a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-403711479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5510f386174150b459057618f4d82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d93843-97", "ovs_interfaceid": "d9d93843-971c-477e-9e3a-f3065c32bf63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:50:a7,bridge_name='br-int',has_traffic_filtering=True,id=d9d93843-971c-477e-9e3a-f3065c32bf63,network=Network(77a350e1-e514-4d3b-889c-0b93f203d3a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d93843-97') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.objects.instance [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ef84810-0506-4439-9302-72b239c8dddd {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:36 user nova-compute[74980]: INFO nova.compute.manager [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Took 11.75 seconds to spawn the instance on the hypervisor.
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:17:36 user nova-compute[74980]:   <uuid>9ef84810-0506-4439-9302-72b239c8dddd</uuid>
Nov 02 17:17:36 user nova-compute[74980]:   <name>instance-00000006</name>
Nov 02 17:17:36 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:17:36 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:17:36 user nova-compute[74980]:   <metadata>
Nov 02 17:17:36 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:17:36 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:17:36 user nova-compute[74980]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-924999295</nova:name>
Nov 02 17:17:36 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:17:36</nova:creationTime>
Nov 02 17:17:36 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:17:36 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:17:36 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:17:36 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:17:36 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:17:36 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:17:36 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:17:36 user nova-compute[74980]:       <nova:owner>
Nov 02 17:17:36 user nova-compute[74980]:         <nova:user uuid="b57eb271bb7e41d4a681668205f13fcc">tempest-AttachSCSIVolumeTestJSON-1465154663-project-member</nova:user>
Nov 02 17:17:36 user nova-compute[74980]:         <nova:project uuid="da5510f386174150b459057618f4d82a">tempest-AttachSCSIVolumeTestJSON-1465154663</nova:project>
Nov 02 17:17:36 user nova-compute[74980]:       </nova:owner>
Nov 02 17:17:36 user nova-compute[74980]:       <nova:root type="image" uuid="8c68b031-691b-4379-8c2e-c7776b623872"/>
Nov 02 17:17:36 user nova-compute[74980]:       <nova:ports>
Nov 02 17:17:36 user nova-compute[74980]:         <nova:port uuid="d9d93843-971c-477e-9e3a-f3065c32bf63">
Nov 02 17:17:36 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 17:17:36 user nova-compute[74980]:         </nova:port>
Nov 02 17:17:36 user nova-compute[74980]:       </nova:ports>
Nov 02 17:17:36 user nova-compute[74980]:     </nova:instance>
Nov 02 17:17:36 user nova-compute[74980]:   </metadata>
Nov 02 17:17:36 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:17:36 user nova-compute[74980]:     <system>
Nov 02 17:17:36 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:17:36 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:17:36 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:17:36 user nova-compute[74980]:       <entry name="serial">9ef84810-0506-4439-9302-72b239c8dddd</entry>
Nov 02 17:17:36 user nova-compute[74980]:       <entry name="uuid">9ef84810-0506-4439-9302-72b239c8dddd</entry>
Nov 02 17:17:36 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:17:36 user nova-compute[74980]:     </system>
Nov 02 17:17:36 user nova-compute[74980]:   </sysinfo>
Nov 02 17:17:36 user nova-compute[74980]:   <os>
Nov 02 17:17:36 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:17:36 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:17:36 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:17:36 user nova-compute[74980]:   </os>
Nov 02 17:17:36 user nova-compute[74980]:   <features>
Nov 02 17:17:36 user nova-compute[74980]:     <acpi/>
Nov 02 17:17:36 user nova-compute[74980]:     <apic/>
Nov 02 17:17:36 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:17:36 user nova-compute[74980]:   </features>
Nov 02 17:17:36 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:17:36 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:17:36 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:17:36 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:17:36 user nova-compute[74980]:   </clock>
Nov 02 17:17:36 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:17:36 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:17:36 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:17:36 user nova-compute[74980]:   </cpu>
Nov 02 17:17:36 user nova-compute[74980]:   <devices>
Nov 02 17:17:36 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:17:36 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:17:36 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk"/>
Nov 02 17:17:36 user nova-compute[74980]:       <target dev="sda" bus="scsi"/>
Nov 02 17:17:36 user nova-compute[74980]:       <address type="drive" controller="0" unit="0"/>
Nov 02 17:17:36 user nova-compute[74980]:     </disk>
Nov 02 17:17:36 user nova-compute[74980]:     <disk type="file" device="cdrom">
Nov 02 17:17:36 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 17:17:36 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk.config"/>
Nov 02 17:17:36 user nova-compute[74980]:       <target dev="sdb" bus="scsi"/>
Nov 02 17:17:36 user nova-compute[74980]:       <address type="drive" controller="0" unit="1"/>
Nov 02 17:17:36 user nova-compute[74980]:     </disk>
Nov 02 17:17:36 user nova-compute[74980]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 02 17:17:36 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:17:36 user nova-compute[74980]:       <mac address="fa:16:3e:42:50:a7"/>
Nov 02 17:17:36 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:36 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:17:36 user nova-compute[74980]:       <target dev="tapd9d93843-97"/>
Nov 02 17:17:36 user nova-compute[74980]:     </interface>
Nov 02 17:17:36 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:17:36 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/console.log" append="off"/>
Nov 02 17:17:36 user nova-compute[74980]:     </serial>
Nov 02 17:17:36 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:17:36 user nova-compute[74980]:     <video>
Nov 02 17:17:36 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:36 user nova-compute[74980]:     </video>
Nov 02 17:17:36 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:17:36 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:17:36 user nova-compute[74980]:     </rng>
Nov 02 17:17:36 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:17:36 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:17:36 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:17:36 user nova-compute[74980]:     </memballoon>
Nov 02 17:17:36 user nova-compute[74980]:   </devices>
Nov 02 17:17:36 user nova-compute[74980]: </domain>
Nov 02 17:17:36 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-924999295',display_name='tempest-AttachSCSIVolumeTestJSON-server-924999295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-924999295',id=6,image_ref='8c68b031-691b-4379-8c2e-c7776b623872',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcsiz2ukAq9Wv4M/GBGxq1E7VWaPQdwLf13GaWNPNr8rYp6rN5NeNS/9Twg+eNHgDLL75EDTLMjw0WexUAIS0viFZOtH2nnHX4YswipGJ1J4eV1yP3ZyiiGK95+sYALTQ==',key_name='tempest-keypair-1440925866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da5510f386174150b459057618f4d82a',ramdisk_id='',reservation_id='r-vsn8y5nh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8c68b031-691b-4379-8c2e-c7776b623872',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1465154663',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1465154663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b57eb271bb7e41d4a681668205f13fcc',uuid=9ef84810-0506-4439-9302-72b239c8dddd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9d93843-971c-477e-9e3a-f3065c32bf63", "address": "fa:16:3e:42:50:a7", "network": {"id": "77a350e1-e514-4d3b-889c-0b93f203d3a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-403711479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5510f386174150b459057618f4d82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d93843-97", "ovs_interfaceid": "d9d93843-971c-477e-9e3a-f3065c32bf63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Converting VIF {"id": "d9d93843-971c-477e-9e3a-f3065c32bf63", "address": "fa:16:3e:42:50:a7", "network": {"id": "77a350e1-e514-4d3b-889c-0b93f203d3a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-403711479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5510f386174150b459057618f4d82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d93843-97", "ovs_interfaceid": "d9d93843-971c-477e-9e3a-f3065c32bf63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:50:a7,bridge_name='br-int',has_traffic_filtering=True,id=d9d93843-971c-477e-9e3a-f3065c32bf63,network=Network(77a350e1-e514-4d3b-889c-0b93f203d3a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d93843-97') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG os_vif [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:50:a7,bridge_name='br-int',has_traffic_filtering=True,id=d9d93843-971c-477e-9e3a-f3065c32bf63,network=Network(77a350e1-e514-4d3b-889c-0b93f203d3a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d93843-97') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00e9472f-511e-56b6-8d66-b53949f5037e', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9d93843-97, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9d93843-97, col_values=(('qos', UUID('fe28cf13-cdd5-4fca-a243-bcba0e8253ba')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9d93843-97, col_values=(('external_ids', {'iface-id': 'd9d93843-971c-477e-9e3a-f3065c32bf63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:50:a7', 'vm-uuid': '9ef84810-0506-4439-9302-72b239c8dddd'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:36 user nova-compute[74980]: INFO os_vif [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:50:a7,bridge_name='br-int',has_traffic_filtering=True,id=d9d93843-971c-477e-9e3a-f3065c32bf63,network=Network(77a350e1-e514-4d3b-889c-0b93f203d3a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d93843-97')
Nov 02 17:17:36 user nova-compute[74980]: INFO nova.compute.manager [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Took 12.76 seconds to build instance.
Nov 02 17:17:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8cbfa324-328a-4474-a1c6-81a3bc872871 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.916s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] No BDM found with device name sda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:17:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] No VIF found with MAC fa:16:3e:42:50:a7, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:17:36 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Using config drive
Nov 02 17:17:37 user nova-compute[74980]: DEBUG nova.network.neutron [req-79aac6d9-3f76-4388-aeac-b89d67d6ddde req-75ae698b-0eeb-42d6-b6ee-cfca07255ced service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Updated VIF entry in instance network info cache for port d9d93843-971c-477e-9e3a-f3065c32bf63. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:17:37 user nova-compute[74980]: DEBUG nova.network.neutron [req-79aac6d9-3f76-4388-aeac-b89d67d6ddde req-75ae698b-0eeb-42d6-b6ee-cfca07255ced service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Updating instance_info_cache with network_info: [{"id": "d9d93843-971c-477e-9e3a-f3065c32bf63", "address": "fa:16:3e:42:50:a7", "network": {"id": "77a350e1-e514-4d3b-889c-0b93f203d3a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-403711479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5510f386174150b459057618f4d82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d93843-97", "ovs_interfaceid": "d9d93843-971c-477e-9e3a-f3065c32bf63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-79aac6d9-3f76-4388-aeac-b89d67d6ddde req-75ae698b-0eeb-42d6-b6ee-cfca07255ced service nova] Releasing lock "refresh_cache-9ef84810-0506-4439-9302-72b239c8dddd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:37 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Creating config drive at /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk.config
Nov 02 17:17:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwarpfp4o {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwarpfp4o" returned: 0 in 0.068s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:38 user nova-compute[74980]: DEBUG nova.compute.manager [req-5d873245-3581-4cec-afb6-ed9c82aa4a60 req-4e1d9d18-1e67-42a4-80cd-d82d90910878 service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Received event network-vif-plugged-0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:17:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5d873245-3581-4cec-afb6-ed9c82aa4a60 req-4e1d9d18-1e67-42a4-80cd-d82d90910878 service nova] Acquiring lock "e9d8737b-e341-4c00-bb8c-6e1847d24418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5d873245-3581-4cec-afb6-ed9c82aa4a60 req-4e1d9d18-1e67-42a4-80cd-d82d90910878 service nova] Lock "e9d8737b-e341-4c00-bb8c-6e1847d24418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5d873245-3581-4cec-afb6-ed9c82aa4a60 req-4e1d9d18-1e67-42a4-80cd-d82d90910878 service nova] Lock "e9d8737b-e341-4c00-bb8c-6e1847d24418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:38 user nova-compute[74980]: DEBUG nova.compute.manager [req-5d873245-3581-4cec-afb6-ed9c82aa4a60 req-4e1d9d18-1e67-42a4-80cd-d82d90910878 service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] No waiting events found dispatching network-vif-plugged-0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:17:38 user nova-compute[74980]: WARNING nova.compute.manager [req-5d873245-3581-4cec-afb6-ed9c82aa4a60 req-4e1d9d18-1e67-42a4-80cd-d82d90910878 service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Received unexpected event network-vif-plugged-0864571c-261a-43f1-a1ec-0c481e22f430 for instance with vm_state active and task_state None.
Nov 02 17:17:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:39 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:17:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:39 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:17:39 user nova-compute[74980]: INFO nova.compute.claims [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Claim successful on node user
Nov 02 17:17:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG nova.compute.manager [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Received event network-vif-plugged-0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] Acquiring lock "e9d8737b-e341-4c00-bb8c-6e1847d24418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] Lock "e9d8737b-e341-4c00-bb8c-6e1847d24418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] Lock "e9d8737b-e341-4c00-bb8c-6e1847d24418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG nova.compute.manager [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] No waiting events found dispatching network-vif-plugged-0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:17:40 user nova-compute[74980]: WARNING nova.compute.manager [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Received unexpected event network-vif-plugged-0864571c-261a-43f1-a1ec-0c481e22f430 for instance with vm_state active and task_state None.
Nov 02 17:17:40 user nova-compute[74980]: DEBUG nova.compute.manager [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Received event network-vif-plugged-b915b940-4c54-4954-9996-938c74f1d50f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] Acquiring lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG nova.compute.manager [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] No waiting events found dispatching network-vif-plugged-b915b940-4c54-4954-9996-938c74f1d50f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:17:40 user nova-compute[74980]: WARNING nova.compute.manager [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Received unexpected event network-vif-plugged-b915b940-4c54-4954-9996-938c74f1d50f for instance with vm_state active and task_state None.
Nov 02 17:17:40 user nova-compute[74980]: DEBUG nova.compute.manager [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Received event network-vif-plugged-b915b940-4c54-4954-9996-938c74f1d50f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] Acquiring lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG nova.compute.manager [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] No waiting events found dispatching network-vif-plugged-b915b940-4c54-4954-9996-938c74f1d50f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:17:40 user nova-compute[74980]: WARNING nova.compute.manager [req-e2c16cd8-cbbb-4c81-b1e8-b0b0458dad34 req-43204821-d546-482c-998e-c415bd4b7059 service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Received unexpected event network-vif-plugged-b915b940-4c54-4954-9996-938c74f1d50f for instance with vm_state active and task_state None.
Nov 02 17:17:40 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.984s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG nova.network.neutron [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:17:40 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:17:40 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG nova.policy [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59c1bf383d2a48449244708dea3cd95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061cfdc41fc64eea9bd281d8c51424c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:17:40 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Creating image(s)
Nov 02 17:17:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.225s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.216s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk 1073741824" returned: 0 in 0.072s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG nova.network.neutron [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Successfully created port: 7434f94a-713e-4434-9262-8da6a26d4006 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.308s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Cannot resize image /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Ensure instance console log exists: /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.network.neutron [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Successfully updated port: 7434f94a-713e-4434-9262-8da6a26d4006 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquired lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.network.neutron [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-11c05923-bf31-4001-8852-7ddc79f7e228 req-ebd81ade-ba9e-4fd3-b9d4-dc7aa3ea4f43 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received event network-changed-7434f94a-713e-4434-9262-8da6a26d4006 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-11c05923-bf31-4001-8852-7ddc79f7e228 req-ebd81ade-ba9e-4fd3-b9d4-dc7aa3ea4f43 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Refreshing instance network info cache due to event network-changed-7434f94a-713e-4434-9262-8da6a26d4006. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-11c05923-bf31-4001-8852-7ddc79f7e228 req-ebd81ade-ba9e-4fd3-b9d4-dc7aa3ea4f43 service nova] Acquiring lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.network.neutron [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:17:42 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Instance spawned successfully.
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:42 user nova-compute[74980]: INFO nova.compute.manager [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Took 10.48 seconds to spawn the instance on the hypervisor.
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.network.neutron [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Updating instance_info_cache with network_info: [{"id": "7434f94a-713e-4434-9262-8da6a26d4006", "address": "fa:16:3e:d3:89:3a", "network": {"id": "6f6330e7-ef7b-4457-a97b-798bb8365964", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-523904489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7434f94a-71", "ovs_interfaceid": "7434f94a-713e-4434-9262-8da6a26d4006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Releasing lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Instance network_info: |[{"id": "7434f94a-713e-4434-9262-8da6a26d4006", "address": "fa:16:3e:d3:89:3a", "network": {"id": "6f6330e7-ef7b-4457-a97b-798bb8365964", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-523904489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7434f94a-71", "ovs_interfaceid": "7434f94a-713e-4434-9262-8da6a26d4006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-11c05923-bf31-4001-8852-7ddc79f7e228 req-ebd81ade-ba9e-4fd3-b9d4-dc7aa3ea4f43 service nova] Acquired lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.network.neutron [req-11c05923-bf31-4001-8852-7ddc79f7e228 req-ebd81ade-ba9e-4fd3-b9d4-dc7aa3ea4f43 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Refreshing network info cache for port 7434f94a-713e-4434-9262-8da6a26d4006 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Start _get_guest_xml network_info=[{"id": "7434f94a-713e-4434-9262-8da6a26d4006", "address": "fa:16:3e:d3:89:3a", "network": {"id": "6f6330e7-ef7b-4457-a97b-798bb8365964", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-523904489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7434f94a-71", "ovs_interfaceid": "7434f94a-713e-4434-9262-8da6a26d4006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:17:42 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:42 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1956055295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1956055295',id=7,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxrQckQxr69xMzJYNTLEjM/WTe1wsExTJezKCnbJ7jnYlT8mZTga0YewAJ2OnZA6lwf50l3CWjDefeId4ykNOk9L89xqNa/3p6b4bQjrJI1+UpsUWudVowdG28U6uyqAA==',key_name='tempest-keypair-347748516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='061cfdc41fc64eea9bd281d8c51424c8',ramdisk_id='',reservation_id='r-qbp9xyqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2126535582',owner_user_name='tempest-TaggedAttachmentsTest-2126535582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59c1bf383d2a48449244708dea3cd95b',uuid=aeae0fe6-ffc2-48f7-8b59-c6485851be3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7434f94a-713e-4434-9262-8da6a26d4006", "address": "fa:16:3e:d3:89:3a", "network": {"id": "6f6330e7-ef7b-4457-a97b-798bb8365964", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-523904489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7434f94a-71", "ovs_interfaceid": "7434f94a-713e-4434-9262-8da6a26d4006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Converting VIF {"id": "7434f94a-713e-4434-9262-8da6a26d4006", "address": "fa:16:3e:d3:89:3a", "network": {"id": "6f6330e7-ef7b-4457-a97b-798bb8365964", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-523904489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7434f94a-71", "ovs_interfaceid": "7434f94a-713e-4434-9262-8da6a26d4006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:89:3a,bridge_name='br-int',has_traffic_filtering=True,id=7434f94a-713e-4434-9262-8da6a26d4006,network=Network(6f6330e7-ef7b-4457-a97b-798bb8365964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7434f94a-71') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:42 user nova-compute[74980]: DEBUG nova.objects.instance [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lazy-loading 'pci_devices' on Instance uuid aeae0fe6-ffc2-48f7-8b59-c6485851be3d {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:17:43 user nova-compute[74980]:   <uuid>aeae0fe6-ffc2-48f7-8b59-c6485851be3d</uuid>
Nov 02 17:17:43 user nova-compute[74980]:   <name>instance-00000007</name>
Nov 02 17:17:43 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:17:43 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:17:43 user nova-compute[74980]:   <metadata>
Nov 02 17:17:43 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:17:43 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:17:43 user nova-compute[74980]:       <nova:name>tempest-device-tagging-server-1956055295</nova:name>
Nov 02 17:17:43 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:17:42</nova:creationTime>
Nov 02 17:17:43 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:17:43 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:17:43 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:17:43 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:17:43 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:17:43 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:17:43 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:17:43 user nova-compute[74980]:       <nova:owner>
Nov 02 17:17:43 user nova-compute[74980]:         <nova:user uuid="59c1bf383d2a48449244708dea3cd95b">tempest-TaggedAttachmentsTest-2126535582-project-member</nova:user>
Nov 02 17:17:43 user nova-compute[74980]:         <nova:project uuid="061cfdc41fc64eea9bd281d8c51424c8">tempest-TaggedAttachmentsTest-2126535582</nova:project>
Nov 02 17:17:43 user nova-compute[74980]:       </nova:owner>
Nov 02 17:17:43 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:17:43 user nova-compute[74980]:       <nova:ports>
Nov 02 17:17:43 user nova-compute[74980]:         <nova:port uuid="7434f94a-713e-4434-9262-8da6a26d4006">
Nov 02 17:17:43 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 17:17:43 user nova-compute[74980]:         </nova:port>
Nov 02 17:17:43 user nova-compute[74980]:       </nova:ports>
Nov 02 17:17:43 user nova-compute[74980]:     </nova:instance>
Nov 02 17:17:43 user nova-compute[74980]:   </metadata>
Nov 02 17:17:43 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:17:43 user nova-compute[74980]:     <system>
Nov 02 17:17:43 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:17:43 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:17:43 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:17:43 user nova-compute[74980]:       <entry name="serial">aeae0fe6-ffc2-48f7-8b59-c6485851be3d</entry>
Nov 02 17:17:43 user nova-compute[74980]:       <entry name="uuid">aeae0fe6-ffc2-48f7-8b59-c6485851be3d</entry>
Nov 02 17:17:43 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:17:43 user nova-compute[74980]:     </system>
Nov 02 17:17:43 user nova-compute[74980]:   </sysinfo>
Nov 02 17:17:43 user nova-compute[74980]:   <os>
Nov 02 17:17:43 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:17:43 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:17:43 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:17:43 user nova-compute[74980]:   </os>
Nov 02 17:17:43 user nova-compute[74980]:   <features>
Nov 02 17:17:43 user nova-compute[74980]:     <acpi/>
Nov 02 17:17:43 user nova-compute[74980]:     <apic/>
Nov 02 17:17:43 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:17:43 user nova-compute[74980]:   </features>
Nov 02 17:17:43 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:17:43 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:17:43 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:17:43 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:17:43 user nova-compute[74980]:   </clock>
Nov 02 17:17:43 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:17:43 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:17:43 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:17:43 user nova-compute[74980]:   </cpu>
Nov 02 17:17:43 user nova-compute[74980]:   <devices>
Nov 02 17:17:43 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:17:43 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:17:43 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk"/>
Nov 02 17:17:43 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:17:43 user nova-compute[74980]:     </disk>
Nov 02 17:17:43 user nova-compute[74980]:     <disk type="file" device="cdrom">
Nov 02 17:17:43 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 17:17:43 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk.config"/>
Nov 02 17:17:43 user nova-compute[74980]:       <target dev="hda" bus="ide"/>
Nov 02 17:17:43 user nova-compute[74980]:     </disk>
Nov 02 17:17:43 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:17:43 user nova-compute[74980]:       <mac address="fa:16:3e:d3:89:3a"/>
Nov 02 17:17:43 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:43 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:17:43 user nova-compute[74980]:       <target dev="tap7434f94a-71"/>
Nov 02 17:17:43 user nova-compute[74980]:     </interface>
Nov 02 17:17:43 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:17:43 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/console.log" append="off"/>
Nov 02 17:17:43 user nova-compute[74980]:     </serial>
Nov 02 17:17:43 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:17:43 user nova-compute[74980]:     <video>
Nov 02 17:17:43 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:43 user nova-compute[74980]:     </video>
Nov 02 17:17:43 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:17:43 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:17:43 user nova-compute[74980]:     </rng>
Nov 02 17:17:43 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:17:43 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:17:43 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:17:43 user nova-compute[74980]:     </memballoon>
Nov 02 17:17:43 user nova-compute[74980]:   </devices>
Nov 02 17:17:43 user nova-compute[74980]: </domain>
Nov 02 17:17:43 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1956055295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1956055295',id=7,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxrQckQxr69xMzJYNTLEjM/WTe1wsExTJezKCnbJ7jnYlT8mZTga0YewAJ2OnZA6lwf50l3CWjDefeId4ykNOk9L89xqNa/3p6b4bQjrJI1+UpsUWudVowdG28U6uyqAA==',key_name='tempest-keypair-347748516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='061cfdc41fc64eea9bd281d8c51424c8',ramdisk_id='',reservation_id='r-qbp9xyqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2126535582',owner_user_name='tempest-TaggedAttachmentsTest-2126535582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59c1bf383d2a48449244708dea3cd95b',uuid=aeae0fe6-ffc2-48f7-8b59-c6485851be3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7434f94a-713e-4434-9262-8da6a26d4006", "address": "fa:16:3e:d3:89:3a", "network": {"id": "6f6330e7-ef7b-4457-a97b-798bb8365964", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-523904489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7434f94a-71", "ovs_interfaceid": "7434f94a-713e-4434-9262-8da6a26d4006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Converting VIF {"id": "7434f94a-713e-4434-9262-8da6a26d4006", "address": "fa:16:3e:d3:89:3a", "network": {"id": "6f6330e7-ef7b-4457-a97b-798bb8365964", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-523904489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7434f94a-71", "ovs_interfaceid": "7434f94a-713e-4434-9262-8da6a26d4006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:89:3a,bridge_name='br-int',has_traffic_filtering=True,id=7434f94a-713e-4434-9262-8da6a26d4006,network=Network(6f6330e7-ef7b-4457-a97b-798bb8365964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7434f94a-71') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG os_vif [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:89:3a,bridge_name='br-int',has_traffic_filtering=True,id=7434f94a-713e-4434-9262-8da6a26d4006,network=Network(6f6330e7-ef7b-4457-a97b-798bb8365964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7434f94a-71') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:17:43 user nova-compute[74980]: INFO nova.compute.manager [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Took 12.08 seconds to build instance.
Nov 02 17:17:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2a1ca9f-0070-5b5d-82ee-8efc9e4fa1de', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7434f94a-71, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7434f94a-71, col_values=(('qos', UUID('c5e6118c-45c9-44cf-8505-744831b2954e')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7434f94a-71, col_values=(('external_ids', {'iface-id': '7434f94a-713e-4434-9262-8da6a26d4006', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:89:3a', 'vm-uuid': 'aeae0fe6-ffc2-48f7-8b59-c6485851be3d'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ddf5af83-6da7-4d18-9501-f5e8826b8f5c tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "9ef84810-0506-4439-9302-72b239c8dddd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.411s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:43 user nova-compute[74980]: INFO os_vif [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:89:3a,bridge_name='br-int',has_traffic_filtering=True,id=7434f94a-713e-4434-9262-8da6a26d4006,network=Network(6f6330e7-ef7b-4457-a97b-798bb8365964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7434f94a-71')
Nov 02 17:17:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] No BDM found with device name hda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] No VIF found with MAC fa:16:3e:d3:89:3a, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:17:43 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Using config drive
Nov 02 17:17:43 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Creating config drive at /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk.config
Nov 02 17:17:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsrbsl0_c {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsrbsl0_c" returned: 0 in 0.081s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG nova.network.neutron [req-11c05923-bf31-4001-8852-7ddc79f7e228 req-ebd81ade-ba9e-4fd3-b9d4-dc7aa3ea4f43 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Updated VIF entry in instance network info cache for port 7434f94a-713e-4434-9262-8da6a26d4006. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG nova.network.neutron [req-11c05923-bf31-4001-8852-7ddc79f7e228 req-ebd81ade-ba9e-4fd3-b9d4-dc7aa3ea4f43 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Updating instance_info_cache with network_info: [{"id": "7434f94a-713e-4434-9262-8da6a26d4006", "address": "fa:16:3e:d3:89:3a", "network": {"id": "6f6330e7-ef7b-4457-a97b-798bb8365964", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-523904489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7434f94a-71", "ovs_interfaceid": "7434f94a-713e-4434-9262-8da6a26d4006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-11c05923-bf31-4001-8852-7ddc79f7e228 req-ebd81ade-ba9e-4fd3-b9d4-dc7aa3ea4f43 service nova] Releasing lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-48b4afe8-7ae3-44c8-9a4b-d01eed07a3d2 req-092a664f-af4e-40d2-8580-c73be3111138 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Received event network-vif-plugged-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:17:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-48b4afe8-7ae3-44c8-9a4b-d01eed07a3d2 req-092a664f-af4e-40d2-8580-c73be3111138 service nova] Acquiring lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-48b4afe8-7ae3-44c8-9a4b-d01eed07a3d2 req-092a664f-af4e-40d2-8580-c73be3111138 service nova] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-48b4afe8-7ae3-44c8-9a4b-d01eed07a3d2 req-092a664f-af4e-40d2-8580-c73be3111138 service nova] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-48b4afe8-7ae3-44c8-9a4b-d01eed07a3d2 req-092a664f-af4e-40d2-8580-c73be3111138 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] No waiting events found dispatching network-vif-plugged-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:17:46 user nova-compute[74980]: WARNING nova.compute.manager [req-48b4afe8-7ae3-44c8-9a4b-d01eed07a3d2 req-092a664f-af4e-40d2-8580-c73be3111138 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Received unexpected event network-vif-plugged-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 for instance with vm_state active and task_state None.
Nov 02 17:17:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:17:48 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Instance spawned successfully.
Nov 02 17:17:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Acquiring lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:17:48 user nova-compute[74980]: INFO nova.compute.manager [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Took 8.02 seconds to spawn the instance on the hypervisor.
Nov 02 17:17:48 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:17:48 user nova-compute[74980]: INFO nova.compute.claims [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Claim successful on node user
Nov 02 17:17:48 user nova-compute[74980]: DEBUG nova.compute.manager [req-c155b2b1-9c32-4378-8e15-7ee947f58647 req-7ff658ca-9fb3-4491-b8ad-7af21034ed89 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Received event network-vif-plugged-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c155b2b1-9c32-4378-8e15-7ee947f58647 req-7ff658ca-9fb3-4491-b8ad-7af21034ed89 service nova] Acquiring lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c155b2b1-9c32-4378-8e15-7ee947f58647 req-7ff658ca-9fb3-4491-b8ad-7af21034ed89 service nova] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c155b2b1-9c32-4378-8e15-7ee947f58647 req-7ff658ca-9fb3-4491-b8ad-7af21034ed89 service nova] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG nova.compute.manager [req-c155b2b1-9c32-4378-8e15-7ee947f58647 req-7ff658ca-9fb3-4491-b8ad-7af21034ed89 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] No waiting events found dispatching network-vif-plugged-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:17:48 user nova-compute[74980]: WARNING nova.compute.manager [req-c155b2b1-9c32-4378-8e15-7ee947f58647 req-7ff658ca-9fb3-4491-b8ad-7af21034ed89 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Received unexpected event network-vif-plugged-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 for instance with vm_state active and task_state None.
Nov 02 17:17:48 user nova-compute[74980]: INFO nova.compute.manager [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Took 9.65 seconds to build instance.
Nov 02 17:17:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d09653b3-7e6f-443d-8f43-e9a64cd07427 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.794s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:17:49 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:17:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG nova.policy [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fe318621b4549a880428866244a997f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f1fee6570a42bd9ec5f9899e7618f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:17:49 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Creating image(s)
Nov 02 17:17:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "/opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "/opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.235s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.215s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk 1073741824" returned: 0 in 0.065s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.233s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Successfully created port: 7acd4ed3-a111-48a7-9ddd-4da7246f5d28 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Cannot resize image /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Ensure instance console log exists: /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Successfully updated port: 7acd4ed3-a111-48a7-9ddd-4da7246f5d28 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Acquiring lock "refresh_cache-8f08eaa2-92d1-4081-9bc7-fe3e7123e831" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Acquired lock "refresh_cache-8f08eaa2-92d1-4081-9bc7-fe3e7123e831" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-5d5876e0-aafb-49b4-9ed4-7758f6e15a74 req-846fdd2f-bcb5-4f91-ad5c-6481d9657239 service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Received event network-changed-7acd4ed3-a111-48a7-9ddd-4da7246f5d28 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-5d5876e0-aafb-49b4-9ed4-7758f6e15a74 req-846fdd2f-bcb5-4f91-ad5c-6481d9657239 service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Refreshing instance network info cache due to event network-changed-7acd4ed3-a111-48a7-9ddd-4da7246f5d28. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5d5876e0-aafb-49b4-9ed4-7758f6e15a74 req-846fdd2f-bcb5-4f91-ad5c-6481d9657239 service nova] Acquiring lock "refresh_cache-8f08eaa2-92d1-4081-9bc7-fe3e7123e831" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Updating instance_info_cache with network_info: [{"id": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "address": "fa:16:3e:a3:43:90", "network": {"id": "4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-496537762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64f1fee6570a42bd9ec5f9899e7618f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7acd4ed3-a1", "ovs_interfaceid": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Releasing lock "refresh_cache-8f08eaa2-92d1-4081-9bc7-fe3e7123e831" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Instance network_info: |[{"id": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "address": "fa:16:3e:a3:43:90", "network": {"id": "4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-496537762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64f1fee6570a42bd9ec5f9899e7618f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7acd4ed3-a1", "ovs_interfaceid": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5d5876e0-aafb-49b4-9ed4-7758f6e15a74 req-846fdd2f-bcb5-4f91-ad5c-6481d9657239 service nova] Acquired lock "refresh_cache-8f08eaa2-92d1-4081-9bc7-fe3e7123e831" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.network.neutron [req-5d5876e0-aafb-49b4-9ed4-7758f6e15a74 req-846fdd2f-bcb5-4f91-ad5c-6481d9657239 service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Refreshing network info cache for port 7acd4ed3-a111-48a7-9ddd-4da7246f5d28 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Start _get_guest_xml network_info=[{"id": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "address": "fa:16:3e:a3:43:90", "network": {"id": "4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-496537762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64f1fee6570a42bd9ec5f9899e7618f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7acd4ed3-a1", "ovs_interfaceid": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:17:51 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:51 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-662418021',display_name='tempest-VolumesAssistedSnapshotsTest-server-662418021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-662418021',id=8,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbE8VKIGhk/DyK8gWj0QKBe+A/9AGKeubbqpCpDhRNm7Ey7jkRnu4C6Nu95KNt9U+VPacgkVNPffU2phTUT/lDfi+Z3VSBWCKf8/vJtPA145q8NpyXGNVcOltHSfcIPKg==',key_name='tempest-keypair-72423944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64f1fee6570a42bd9ec5f9899e7618f9',ramdisk_id='',reservation_id='r-fxkovy9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-293542621',owner_user_name='tempest-VolumesAssistedSnapshotsTest-293542621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fe318621b4549a880428866244a997f',uuid=8f08eaa2-92d1-4081-9bc7-fe3e7123e831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "address": "fa:16:3e:a3:43:90", "network": {"id": "4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-496537762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64f1fee6570a42bd9ec5f9899e7618f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7acd4ed3-a1", "ovs_interfaceid": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Converting VIF {"id": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "address": "fa:16:3e:a3:43:90", "network": {"id": "4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-496537762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64f1fee6570a42bd9ec5f9899e7618f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7acd4ed3-a1", "ovs_interfaceid": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:43:90,bridge_name='br-int',has_traffic_filtering=True,id=7acd4ed3-a111-48a7-9ddd-4da7246f5d28,network=Network(4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7acd4ed3-a1') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.objects.instance [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:17:51 user nova-compute[74980]:   <uuid>8f08eaa2-92d1-4081-9bc7-fe3e7123e831</uuid>
Nov 02 17:17:51 user nova-compute[74980]:   <name>instance-00000008</name>
Nov 02 17:17:51 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:17:51 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:17:51 user nova-compute[74980]:   <metadata>
Nov 02 17:17:51 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:17:51 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:17:51 user nova-compute[74980]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-662418021</nova:name>
Nov 02 17:17:51 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:17:51</nova:creationTime>
Nov 02 17:17:51 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:17:51 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:17:51 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:17:51 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:17:51 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:17:51 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:17:51 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:17:51 user nova-compute[74980]:       <nova:owner>
Nov 02 17:17:51 user nova-compute[74980]:         <nova:user uuid="9fe318621b4549a880428866244a997f">tempest-VolumesAssistedSnapshotsTest-293542621-project-member</nova:user>
Nov 02 17:17:51 user nova-compute[74980]:         <nova:project uuid="64f1fee6570a42bd9ec5f9899e7618f9">tempest-VolumesAssistedSnapshotsTest-293542621</nova:project>
Nov 02 17:17:51 user nova-compute[74980]:       </nova:owner>
Nov 02 17:17:51 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:17:51 user nova-compute[74980]:       <nova:ports>
Nov 02 17:17:51 user nova-compute[74980]:         <nova:port uuid="7acd4ed3-a111-48a7-9ddd-4da7246f5d28">
Nov 02 17:17:51 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 17:17:51 user nova-compute[74980]:         </nova:port>
Nov 02 17:17:51 user nova-compute[74980]:       </nova:ports>
Nov 02 17:17:51 user nova-compute[74980]:     </nova:instance>
Nov 02 17:17:51 user nova-compute[74980]:   </metadata>
Nov 02 17:17:51 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:17:51 user nova-compute[74980]:     <system>
Nov 02 17:17:51 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:17:51 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:17:51 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:17:51 user nova-compute[74980]:       <entry name="serial">8f08eaa2-92d1-4081-9bc7-fe3e7123e831</entry>
Nov 02 17:17:51 user nova-compute[74980]:       <entry name="uuid">8f08eaa2-92d1-4081-9bc7-fe3e7123e831</entry>
Nov 02 17:17:51 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:17:51 user nova-compute[74980]:     </system>
Nov 02 17:17:51 user nova-compute[74980]:   </sysinfo>
Nov 02 17:17:51 user nova-compute[74980]:   <os>
Nov 02 17:17:51 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:17:51 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:17:51 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:17:51 user nova-compute[74980]:   </os>
Nov 02 17:17:51 user nova-compute[74980]:   <features>
Nov 02 17:17:51 user nova-compute[74980]:     <acpi/>
Nov 02 17:17:51 user nova-compute[74980]:     <apic/>
Nov 02 17:17:51 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:17:51 user nova-compute[74980]:   </features>
Nov 02 17:17:51 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:17:51 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:17:51 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:17:51 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:17:51 user nova-compute[74980]:   </clock>
Nov 02 17:17:51 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:17:51 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:17:51 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:17:51 user nova-compute[74980]:   </cpu>
Nov 02 17:17:51 user nova-compute[74980]:   <devices>
Nov 02 17:17:51 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:17:51 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:17:51 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk"/>
Nov 02 17:17:51 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:17:51 user nova-compute[74980]:     </disk>
Nov 02 17:17:51 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:17:51 user nova-compute[74980]:       <mac address="fa:16:3e:a3:43:90"/>
Nov 02 17:17:51 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:51 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:17:51 user nova-compute[74980]:       <target dev="tap7acd4ed3-a1"/>
Nov 02 17:17:51 user nova-compute[74980]:     </interface>
Nov 02 17:17:51 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:17:51 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/console.log" append="off"/>
Nov 02 17:17:51 user nova-compute[74980]:     </serial>
Nov 02 17:17:51 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:17:51 user nova-compute[74980]:     <video>
Nov 02 17:17:51 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:17:51 user nova-compute[74980]:     </video>
Nov 02 17:17:51 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:17:51 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:17:51 user nova-compute[74980]:     </rng>
Nov 02 17:17:51 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:17:51 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:17:51 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:17:51 user nova-compute[74980]:     </memballoon>
Nov 02 17:17:51 user nova-compute[74980]:   </devices>
Nov 02 17:17:51 user nova-compute[74980]: </domain>
Nov 02 17:17:51 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-662418021',display_name='tempest-VolumesAssistedSnapshotsTest-server-662418021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-662418021',id=8,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbE8VKIGhk/DyK8gWj0QKBe+A/9AGKeubbqpCpDhRNm7Ey7jkRnu4C6Nu95KNt9U+VPacgkVNPffU2phTUT/lDfi+Z3VSBWCKf8/vJtPA145q8NpyXGNVcOltHSfcIPKg==',key_name='tempest-keypair-72423944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64f1fee6570a42bd9ec5f9899e7618f9',ramdisk_id='',reservation_id='r-fxkovy9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-293542621',owner_user_name='tempest-VolumesAssistedSnapshotsTest-293542621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:17:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fe318621b4549a880428866244a997f',uuid=8f08eaa2-92d1-4081-9bc7-fe3e7123e831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "address": "fa:16:3e:a3:43:90", "network": {"id": "4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-496537762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64f1fee6570a42bd9ec5f9899e7618f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7acd4ed3-a1", "ovs_interfaceid": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Converting VIF {"id": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "address": "fa:16:3e:a3:43:90", "network": {"id": "4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-496537762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64f1fee6570a42bd9ec5f9899e7618f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7acd4ed3-a1", "ovs_interfaceid": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:43:90,bridge_name='br-int',has_traffic_filtering=True,id=7acd4ed3-a111-48a7-9ddd-4da7246f5d28,network=Network(4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7acd4ed3-a1') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG os_vif [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:43:90,bridge_name='br-int',has_traffic_filtering=True,id=7acd4ed3-a111-48a7-9ddd-4da7246f5d28,network=Network(4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7acd4ed3-a1') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7043faf3-046a-5584-9b51-603e89d5102c', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7acd4ed3-a1, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7acd4ed3-a1, col_values=(('qos', UUID('2e701804-5f89-41dc-a3c5-632c831b97eb')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7acd4ed3-a1, col_values=(('external_ids', {'iface-id': '7acd4ed3-a111-48a7-9ddd-4da7246f5d28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:43:90', 'vm-uuid': '8f08eaa2-92d1-4081-9bc7-fe3e7123e831'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:17:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:17:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:52 user nova-compute[74980]: INFO os_vif [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:43:90,bridge_name='br-int',has_traffic_filtering=True,id=7acd4ed3-a111-48a7-9ddd-4da7246f5d28,network=Network(4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7acd4ed3-a1')
Nov 02 17:17:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:17:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] No VIF found with MAC fa:16:3e:a3:43:90, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:17:52 user nova-compute[74980]: DEBUG nova.network.neutron [req-5d5876e0-aafb-49b4-9ed4-7758f6e15a74 req-846fdd2f-bcb5-4f91-ad5c-6481d9657239 service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Updated VIF entry in instance network info cache for port 7acd4ed3-a111-48a7-9ddd-4da7246f5d28. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:17:52 user nova-compute[74980]: DEBUG nova.network.neutron [req-5d5876e0-aafb-49b4-9ed4-7758f6e15a74 req-846fdd2f-bcb5-4f91-ad5c-6481d9657239 service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Updating instance_info_cache with network_info: [{"id": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "address": "fa:16:3e:a3:43:90", "network": {"id": "4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-496537762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64f1fee6570a42bd9ec5f9899e7618f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7acd4ed3-a1", "ovs_interfaceid": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:17:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5d5876e0-aafb-49b4-9ed4-7758f6e15a74 req-846fdd2f-bcb5-4f91-ad5c-6481d9657239 service nova] Releasing lock "refresh_cache-8f08eaa2-92d1-4081-9bc7-fe3e7123e831" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:17:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:17:54 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 17:17:54 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] There are 0 instances to clean {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 17:17:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:17:54 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74980) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 17:17:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:17:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:17:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:17:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:17:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:17:56 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Instance spawned successfully.
Nov 02 17:17:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:17:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:17:56 user nova-compute[74980]: INFO nova.compute.manager [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Took 7.16 seconds to spawn the instance on the hypervisor.
Nov 02 17:17:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:17:56 user nova-compute[74980]: INFO nova.compute.manager [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Took 8.14 seconds to build instance.
Nov 02 17:17:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ed24c2a5-280b-48fb-9baf-4224c8f5354c tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.372s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:17:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:17:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:17:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:17:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:17:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:17:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:17:59 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:17:59 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 17:17:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-4e6bfb81-f01c-47e6-b771-7c2b34587623" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:17:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-4e6bfb81-f01c-47e6-b771-7c2b34587623" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:17:59 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:17:59 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 4e6bfb81-f01c-47e6-b771-7c2b34587623 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:18:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Updating instance_info_cache with network_info: [{"id": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "address": "fa:16:3e:95:9a:bc", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6189316b-4d", "ovs_interfaceid": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:18:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-4e6bfb81-f01c-47e6-b771-7c2b34587623" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:18:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:18:00 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:18:00 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:18:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:00 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:18:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-4567c2af-e30b-4cc0-92a2-f02957cbd709 req-f568b1c3-395c-4970-afc8-68ebcdb1dfa7 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Received event network-vif-plugged-6189316b-4df5-4f6e-ab3d-77d321a6aafb {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:18:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4567c2af-e30b-4cc0-92a2-f02957cbd709 req-f568b1c3-395c-4970-afc8-68ebcdb1dfa7 service nova] Acquiring lock "4e6bfb81-f01c-47e6-b771-7c2b34587623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4567c2af-e30b-4cc0-92a2-f02957cbd709 req-f568b1c3-395c-4970-afc8-68ebcdb1dfa7 service nova] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4567c2af-e30b-4cc0-92a2-f02957cbd709 req-f568b1c3-395c-4970-afc8-68ebcdb1dfa7 service nova] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-4567c2af-e30b-4cc0-92a2-f02957cbd709 req-f568b1c3-395c-4970-afc8-68ebcdb1dfa7 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] No waiting events found dispatching network-vif-plugged-6189316b-4df5-4f6e-ab3d-77d321a6aafb {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:18:03 user nova-compute[74980]: WARNING nova.compute.manager [req-4567c2af-e30b-4cc0-92a2-f02957cbd709 req-f568b1c3-395c-4970-afc8-68ebcdb1dfa7 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Received unexpected event network-vif-plugged-6189316b-4df5-4f6e-ab3d-77d321a6aafb for instance with vm_state active and task_state None.
Nov 02 17:18:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:04 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:18:04 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=7602MB free_disk=25.53854751586914GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 4e6bfb81-f01c-47e6-b771-7c2b34587623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance d7f2fa00-48af-4277-93b4-af930e4a650f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1154d1f9-80b8-405b-8fd8-c10bb39c507f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 9ef84810-0506-4439-9302-72b239c8dddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing inventories for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating ProviderTree inventory for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating inventory in ProviderTree for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing aggregate associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, aggregates: None {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 17:18:04 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing trait associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.911s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Received event network-vif-plugged-6189316b-4df5-4f6e-ab3d-77d321a6aafb {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] Acquiring lock "4e6bfb81-f01c-47e6-b771-7c2b34587623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] No waiting events found dispatching network-vif-plugged-6189316b-4df5-4f6e-ab3d-77d321a6aafb {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:18:05 user nova-compute[74980]: WARNING nova.compute.manager [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Received unexpected event network-vif-plugged-6189316b-4df5-4f6e-ab3d-77d321a6aafb for instance with vm_state active and task_state None.
Nov 02 17:18:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Received event network-vif-plugged-ea1b9b79-0495-451f-a67d-e997c88e4b60 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] Acquiring lock "d7f2fa00-48af-4277-93b4-af930e4a650f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] No waiting events found dispatching network-vif-plugged-ea1b9b79-0495-451f-a67d-e997c88e4b60 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:18:05 user nova-compute[74980]: WARNING nova.compute.manager [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Received unexpected event network-vif-plugged-ea1b9b79-0495-451f-a67d-e997c88e4b60 for instance with vm_state active and task_state None.
Nov 02 17:18:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Received event network-vif-plugged-ea1b9b79-0495-451f-a67d-e997c88e4b60 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] Acquiring lock "d7f2fa00-48af-4277-93b4-af930e4a650f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] No waiting events found dispatching network-vif-plugged-ea1b9b79-0495-451f-a67d-e997c88e4b60 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:18:05 user nova-compute[74980]: WARNING nova.compute.manager [req-615cd0fc-455e-4591-8bae-3f67ec3956e0 req-87f28fc7-356d-4441-9ad1-f143d7d567a5 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Received unexpected event network-vif-plugged-ea1b9b79-0495-451f-a67d-e997c88e4b60 for instance with vm_state active and task_state None.
Nov 02 17:18:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:18:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-b0aeeea8-b559-43a3-a39c-6856175ad883 req-961b88b4-a523-4f69-9485-af2e951fc651 service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Received event network-vif-plugged-d9d93843-971c-477e-9e3a-f3065c32bf63 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:18:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b0aeeea8-b559-43a3-a39c-6856175ad883 req-961b88b4-a523-4f69-9485-af2e951fc651 service nova] Acquiring lock "9ef84810-0506-4439-9302-72b239c8dddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b0aeeea8-b559-43a3-a39c-6856175ad883 req-961b88b4-a523-4f69-9485-af2e951fc651 service nova] Lock "9ef84810-0506-4439-9302-72b239c8dddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b0aeeea8-b559-43a3-a39c-6856175ad883 req-961b88b4-a523-4f69-9485-af2e951fc651 service nova] Lock "9ef84810-0506-4439-9302-72b239c8dddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-b0aeeea8-b559-43a3-a39c-6856175ad883 req-961b88b4-a523-4f69-9485-af2e951fc651 service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] No waiting events found dispatching network-vif-plugged-d9d93843-971c-477e-9e3a-f3065c32bf63 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:18:09 user nova-compute[74980]: WARNING nova.compute.manager [req-b0aeeea8-b559-43a3-a39c-6856175ad883 req-961b88b4-a523-4f69-9485-af2e951fc651 service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Received unexpected event network-vif-plugged-d9d93843-971c-477e-9e3a-f3065c32bf63 for instance with vm_state active and task_state None.
Nov 02 17:18:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Received event network-vif-plugged-d9d93843-971c-477e-9e3a-f3065c32bf63 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] Acquiring lock "9ef84810-0506-4439-9302-72b239c8dddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] Lock "9ef84810-0506-4439-9302-72b239c8dddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] Lock "9ef84810-0506-4439-9302-72b239c8dddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] No waiting events found dispatching network-vif-plugged-d9d93843-971c-477e-9e3a-f3065c32bf63 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:18:11 user nova-compute[74980]: WARNING nova.compute.manager [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Received unexpected event network-vif-plugged-d9d93843-971c-477e-9e3a-f3065c32bf63 for instance with vm_state active and task_state None.
Nov 02 17:18:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received event network-vif-plugged-7434f94a-713e-4434-9262-8da6a26d4006 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] Acquiring lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] No waiting events found dispatching network-vif-plugged-7434f94a-713e-4434-9262-8da6a26d4006 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:18:11 user nova-compute[74980]: WARNING nova.compute.manager [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received unexpected event network-vif-plugged-7434f94a-713e-4434-9262-8da6a26d4006 for instance with vm_state active and task_state None.
Nov 02 17:18:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received event network-vif-plugged-7434f94a-713e-4434-9262-8da6a26d4006 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] Acquiring lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] No waiting events found dispatching network-vif-plugged-7434f94a-713e-4434-9262-8da6a26d4006 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:18:11 user nova-compute[74980]: WARNING nova.compute.manager [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received unexpected event network-vif-plugged-7434f94a-713e-4434-9262-8da6a26d4006 for instance with vm_state active and task_state None.
Nov 02 17:18:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Received event network-vif-plugged-7acd4ed3-a111-48a7-9ddd-4da7246f5d28 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] Acquiring lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] No waiting events found dispatching network-vif-plugged-7acd4ed3-a111-48a7-9ddd-4da7246f5d28 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:18:11 user nova-compute[74980]: WARNING nova.compute.manager [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Received unexpected event network-vif-plugged-7acd4ed3-a111-48a7-9ddd-4da7246f5d28 for instance with vm_state active and task_state None.
Nov 02 17:18:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Received event network-vif-plugged-7acd4ed3-a111-48a7-9ddd-4da7246f5d28 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] Acquiring lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] No waiting events found dispatching network-vif-plugged-7acd4ed3-a111-48a7-9ddd-4da7246f5d28 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:18:11 user nova-compute[74980]: WARNING nova.compute.manager [req-dd7a79e4-d990-4ee3-83d5-d146ec081c96 req-f7859532-2f30-4920-9fa7-f90c9f6787af service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Received unexpected event network-vif-plugged-7acd4ed3-a111-48a7-9ddd-4da7246f5d28 for instance with vm_state active and task_state None.
Nov 02 17:18:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "82362140-8606-41dc-a574-86b0b89a7a35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "82362140-8606-41dc-a574-86b0b89a7a35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:18:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:28 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:18:28 user nova-compute[74980]: INFO nova.compute.claims [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Claim successful on node user
Nov 02 17:18:28 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:18:28 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:18:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:28 user nova-compute[74980]: DEBUG nova.compute.manager [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:18:28 user nova-compute[74980]: DEBUG nova.compute.manager [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:18:28 user nova-compute[74980]: DEBUG nova.network.neutron [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:18:28 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:18:28 user nova-compute[74980]: DEBUG nova.compute.manager [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:18:28 user nova-compute[74980]: DEBUG nova.policy [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '349fb060d5d9496d89a25ce6c777c4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086eda6bb22c44eea8cdcdf2138d6c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:18:28 user nova-compute[74980]: INFO nova.virt.block_device [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Booting with volume 756ebe57-479f-485e-8091-9f3771aea8cf at /dev/vda
Nov 02 17:18:28 user nova-compute[74980]: DEBUG os_brick.utils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:18:28 user nova-compute[74980]: INFO oslo.privsep.daemon [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpia8q93a4/privsep.sock']
Nov 02 17:18:28 user sudo[85982]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpia8q93a4/privsep.sock
Nov 02 17:18:28 user sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 02 17:18:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:29 user nova-compute[74980]: DEBUG nova.network.neutron [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Successfully created port: 3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG nova.network.neutron [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Successfully updated port: 3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "refresh_cache-82362140-8606-41dc-a574-86b0b89a7a35" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquired lock "refresh_cache-82362140-8606-41dc-a574-86b0b89a7a35" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG nova.network.neutron [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-bc75864d-0c32-461f-9f2b-02b3462d03d4 req-1921d131-4381-4eb4-85ca-9446a44ea42d service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received event network-changed-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-bc75864d-0c32-461f-9f2b-02b3462d03d4 req-1921d131-4381-4eb4-85ca-9446a44ea42d service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Refreshing instance network info cache due to event network-changed-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bc75864d-0c32-461f-9f2b-02b3462d03d4 req-1921d131-4381-4eb4-85ca-9446a44ea42d service nova] Acquiring lock "refresh_cache-82362140-8606-41dc-a574-86b0b89a7a35" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG nova.network.neutron [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG nova.network.neutron [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Updating instance_info_cache with network_info: [{"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Releasing lock "refresh_cache-82362140-8606-41dc-a574-86b0b89a7a35" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG nova.compute.manager [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Instance network_info: |[{"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bc75864d-0c32-461f-9f2b-02b3462d03d4 req-1921d131-4381-4eb4-85ca-9446a44ea42d service nova] Acquired lock "refresh_cache-82362140-8606-41dc-a574-86b0b89a7a35" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG nova.network.neutron [req-bc75864d-0c32-461f-9f2b-02b3462d03d4 req-1921d131-4381-4eb4-85ca-9446a44ea42d service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Refreshing network info cache for port 3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:18:30 user sudo[85982]: pam_unix(sudo:session): session closed for user root
Nov 02 17:18:30 user nova-compute[74980]: INFO oslo.privsep.daemon [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Spawned new privsep daemon via rootwrap
Nov 02 17:18:30 user nova-compute[74980]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 17:18:30 user nova-compute[74980]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 17:18:30 user nova-compute[74980]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 02 17:18:30 user nova-compute[74980]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86001
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[131d1a3f-172b-408e-b3ca-d7b1584a40f3]: (2,) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b7425e-29f3-4bd6-8230-574d46695bc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:30 user nova-compute[74980]: WARNING os_brick.initiator.connectors.nvmeof [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b83ba5-f1b0-4457-a75e-5e637cb01ef3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05c028e-9cca-4472-a6de-7d0bc3b4a3b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57e9225-6cf2-40a8-a303-462226845dc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:18:30 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaec683-7c57-4634-8b7d-25c4ee0061d9]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG os_brick.utils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] <== get_connector_properties: return (1893ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Updating existing volume attachment record: f4fa5ef1-7bc2-4ff4-a01d-867291be34fc {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG nova.network.neutron [req-bc75864d-0c32-461f-9f2b-02b3462d03d4 req-1921d131-4381-4eb4-85ca-9446a44ea42d service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Updated VIF entry in instance network info cache for port 3d7df4f6-fa0e-4b6e-b96d-08126d2765f8. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG nova.network.neutron [req-bc75864d-0c32-461f-9f2b-02b3462d03d4 req-1921d131-4381-4eb4-85ca-9446a44ea42d service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Updating instance_info_cache with network_info: [{"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:18:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bc75864d-0c32-461f-9f2b-02b3462d03d4 req-1921d131-4381-4eb4-85ca-9446a44ea42d service nova] Releasing lock "refresh_cache-82362140-8606-41dc-a574-86b0b89a7a35" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:18:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:18:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:18:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:18:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:18:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:18:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:18:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:18:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:18:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:50 user nova-compute[74980]: DEBUG nova.compute.manager [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:18:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:18:50 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Creating image(s)
Nov 02 17:18:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 17:18:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Ensure instance console log exists: /opt/stack/data/nova/instances/82362140-8606-41dc-a574-86b0b89a7a35/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:18:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Start _get_guest_xml network_info=[{"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuIqYUnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82362140-8606-41dc-a574-86b0b89a7a35', 'attached_at': '', 'detached_at': '', 'volume_id': '756ebe57-479f-485e-8091-9f3771aea8cf', 'serial': '756ebe57-479f-485e-8091-9f3771aea8cf'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'f4fa5ef1-7bc2-4ff4-a01d-867291be34fc', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:18:50 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:18:51 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connector [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Factory for ISCSI on None {{(pid=74980) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuIqYUnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:18:51 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:18:51 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:18:51 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fddcf80-0a50-4917-b75a-dd422ececc40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:18:51 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1801a1-9e45-4b63-9897-b897f972b315]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf] added
Nov 02 17:18:51 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a10022e-a8f4-432b-a0b9-e77772d6cf68]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e4ae84-51c4-464f-b43b-87524caf9d38]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NuIqYUnX {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NuIqYUnX" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61a7d1d-64d0-4640-8792-85592e68d218]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NuIqYUnX'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c51056-54ab-4e4a-81ab-cdd8b4bcf1b9]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[877640b9-6907-4a5e-b15c-8c914921390c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:18:51 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:18:51 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:18:51 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 17:18:51 user nova-compute[74980]: 
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1fad01-699b-4e5d-9171-314261793b40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260]
Nov 02 17:18:51 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260] successful.
Nov 02 17:18:51 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90b65c5-dd56-41b9-88dc-a5278dd1dc63]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7748aa43-030a-4bda-8a01-553f1a65142c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:18:51 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:18:51 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd79c46-880f-4727-af41-8eb6de9486c1]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:18:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuIqYUnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23933653934303436', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933653934303436', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-346112830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-346112830',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTpqQoNo0W/Ba15IuwqtzMdO/Ma8YaqmK05K42Vul1aCdWd3AbpNWmrW5hXKt7oCzZVApl7jhtUwG4COeOBNbHItGsTrb/+JmrW4jXwqzDTsf4vNkzsXUpAI4g1UfSHEw==',key_name='tempest-keypair-703339062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='086eda6bb22c44eea8cdcdf2138d6c8a',ramdisk_id='',reservation_id='r-y52rxoqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2119202372',owner_user_name='tempest-ServerActionsV293TestJSON-2119202372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='349fb060d5d9496d89a25ce6c777c4b4',uuid=82362140-8606-41dc-a574-86b0b89a7a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Converting VIF {"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:63:d1,bridge_name='br-int',has_traffic_filtering=True,id=3d7df4f6-fa0e-4b6e-b96d-08126d2765f8,network=Network(66fd33fd-9ae9-4d77-8000-8d54202a5c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d7df4f6-fa') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG nova.objects.instance [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lazy-loading 'pci_devices' on Instance uuid 82362140-8606-41dc-a574-86b0b89a7a35 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:18:52 user nova-compute[74980]:   <uuid>82362140-8606-41dc-a574-86b0b89a7a35</uuid>
Nov 02 17:18:52 user nova-compute[74980]:   <name>instance-00000009</name>
Nov 02 17:18:52 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:18:52 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:18:52 user nova-compute[74980]:   <metadata>
Nov 02 17:18:52 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:18:52 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:18:52 user nova-compute[74980]:       <nova:name>tempest-ServerActionsV293TestJSON-server-346112830</nova:name>
Nov 02 17:18:52 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:18:51</nova:creationTime>
Nov 02 17:18:52 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:18:52 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:18:52 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:18:52 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:18:52 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:18:52 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:18:52 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:18:52 user nova-compute[74980]:       <nova:owner>
Nov 02 17:18:52 user nova-compute[74980]:         <nova:user uuid="349fb060d5d9496d89a25ce6c777c4b4">tempest-ServerActionsV293TestJSON-2119202372-project-member</nova:user>
Nov 02 17:18:52 user nova-compute[74980]:         <nova:project uuid="086eda6bb22c44eea8cdcdf2138d6c8a">tempest-ServerActionsV293TestJSON-2119202372</nova:project>
Nov 02 17:18:52 user nova-compute[74980]:       </nova:owner>
Nov 02 17:18:52 user nova-compute[74980]:       <nova:ports>
Nov 02 17:18:52 user nova-compute[74980]:         <nova:port uuid="3d7df4f6-fa0e-4b6e-b96d-08126d2765f8">
Nov 02 17:18:52 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 17:18:52 user nova-compute[74980]:         </nova:port>
Nov 02 17:18:52 user nova-compute[74980]:       </nova:ports>
Nov 02 17:18:52 user nova-compute[74980]:     </nova:instance>
Nov 02 17:18:52 user nova-compute[74980]:   </metadata>
Nov 02 17:18:52 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:18:52 user nova-compute[74980]:     <system>
Nov 02 17:18:52 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:18:52 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:18:52 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:18:52 user nova-compute[74980]:       <entry name="serial">82362140-8606-41dc-a574-86b0b89a7a35</entry>
Nov 02 17:18:52 user nova-compute[74980]:       <entry name="uuid">82362140-8606-41dc-a574-86b0b89a7a35</entry>
Nov 02 17:18:52 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:18:52 user nova-compute[74980]:     </system>
Nov 02 17:18:52 user nova-compute[74980]:   </sysinfo>
Nov 02 17:18:52 user nova-compute[74980]:   <os>
Nov 02 17:18:52 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:18:52 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:18:52 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:18:52 user nova-compute[74980]:   </os>
Nov 02 17:18:52 user nova-compute[74980]:   <features>
Nov 02 17:18:52 user nova-compute[74980]:     <acpi/>
Nov 02 17:18:52 user nova-compute[74980]:     <apic/>
Nov 02 17:18:52 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:18:52 user nova-compute[74980]:   </features>
Nov 02 17:18:52 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:18:52 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:18:52 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:18:52 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:18:52 user nova-compute[74980]:   </clock>
Nov 02 17:18:52 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:18:52 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:18:52 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:18:52 user nova-compute[74980]:   </cpu>
Nov 02 17:18:52 user nova-compute[74980]:   <devices>
Nov 02 17:18:52 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:18:52 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:18:52 user nova-compute[74980]:       <source dev="/dev/sdb"/>
Nov 02 17:18:52 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:18:52 user nova-compute[74980]:       <serial>756ebe57-479f-485e-8091-9f3771aea8cf</serial>
Nov 02 17:18:52 user nova-compute[74980]:     </disk>
Nov 02 17:18:52 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:18:52 user nova-compute[74980]:       <mac address="fa:16:3e:e1:63:d1"/>
Nov 02 17:18:52 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:18:52 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:18:52 user nova-compute[74980]:       <target dev="tap3d7df4f6-fa"/>
Nov 02 17:18:52 user nova-compute[74980]:     </interface>
Nov 02 17:18:52 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:18:52 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/82362140-8606-41dc-a574-86b0b89a7a35/console.log" append="off"/>
Nov 02 17:18:52 user nova-compute[74980]:     </serial>
Nov 02 17:18:52 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:18:52 user nova-compute[74980]:     <video>
Nov 02 17:18:52 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:18:52 user nova-compute[74980]:     </video>
Nov 02 17:18:52 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:18:52 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:18:52 user nova-compute[74980]:     </rng>
Nov 02 17:18:52 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:18:52 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:18:52 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:18:52 user nova-compute[74980]:     </memballoon>
Nov 02 17:18:52 user nova-compute[74980]:   </devices>
Nov 02 17:18:52 user nova-compute[74980]: </domain>
Nov 02 17:18:52 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-346112830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-346112830',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTpqQoNo0W/Ba15IuwqtzMdO/Ma8YaqmK05K42Vul1aCdWd3AbpNWmrW5hXKt7oCzZVApl7jhtUwG4COeOBNbHItGsTrb/+JmrW4jXwqzDTsf4vNkzsXUpAI4g1UfSHEw==',key_name='tempest-keypair-703339062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='086eda6bb22c44eea8cdcdf2138d6c8a',ramdisk_id='',reservation_id='r-y52rxoqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2119202372',owner_user_name='tempest-ServerActionsV293TestJSON-2119202372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='349fb060d5d9496d89a25ce6c777c4b4',uuid=82362140-8606-41dc-a574-86b0b89a7a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Converting VIF {"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:63:d1,bridge_name='br-int',has_traffic_filtering=True,id=3d7df4f6-fa0e-4b6e-b96d-08126d2765f8,network=Network(66fd33fd-9ae9-4d77-8000-8d54202a5c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d7df4f6-fa') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG os_vif [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:63:d1,bridge_name='br-int',has_traffic_filtering=True,id=3d7df4f6-fa0e-4b6e-b96d-08126d2765f8,network=Network(66fd33fd-9ae9-4d77-8000-8d54202a5c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d7df4f6-fa') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a677324-7137-57a5-88e0-d797ce6c81d5', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d7df4f6-fa, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d7df4f6-fa, col_values=(('qos', UUID('d1eb7b90-87ae-4fbc-99d8-0af684946297')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d7df4f6-fa, col_values=(('external_ids', {'iface-id': '3d7df4f6-fa0e-4b6e-b96d-08126d2765f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:63:d1', 'vm-uuid': '82362140-8606-41dc-a574-86b0b89a7a35'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:52 user nova-compute[74980]: INFO os_vif [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:63:d1,bridge_name='br-int',has_traffic_filtering=True,id=3d7df4f6-fa0e-4b6e-b96d-08126d2765f8,network=Network(66fd33fd-9ae9-4d77-8000-8d54202a5c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d7df4f6-fa')
Nov 02 17:18:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:18:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] No VIF found with MAC fa:16:3e:e1:63:d1, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:18:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-2b982d5d-359f-40fd-99e7-9313603455a0 req-89c66d02-9036-4264-9313-bb3805ba1d2c service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received event network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:18:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2b982d5d-359f-40fd-99e7-9313603455a0 req-89c66d02-9036-4264-9313-bb3805ba1d2c service nova] Acquiring lock "82362140-8606-41dc-a574-86b0b89a7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2b982d5d-359f-40fd-99e7-9313603455a0 req-89c66d02-9036-4264-9313-bb3805ba1d2c service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2b982d5d-359f-40fd-99e7-9313603455a0 req-89c66d02-9036-4264-9313-bb3805ba1d2c service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-2b982d5d-359f-40fd-99e7-9313603455a0 req-89c66d02-9036-4264-9313-bb3805ba1d2c service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] No waiting events found dispatching network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:18:54 user nova-compute[74980]: WARNING nova.compute.manager [req-2b982d5d-359f-40fd-99e7-9313603455a0 req-89c66d02-9036-4264-9313-bb3805ba1d2c service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received unexpected event network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 for instance with vm_state building and task_state spawning.
Nov 02 17:18:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:18:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:18:55 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Instance spawned successfully.
Nov 02 17:18:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:18:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:18:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:18:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:18:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:18:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:18:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:18:56 user nova-compute[74980]: INFO nova.compute.manager [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 02 17:18:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:18:56 user nova-compute[74980]: INFO nova.compute.manager [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Took 28.07 seconds to build instance.
Nov 02 17:18:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30159863-6812-4e00-a3ae-b266c9185f4f tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "82362140-8606-41dc-a574-86b0b89a7a35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.180s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-9de3c3f3-2a20-478f-8440-f9626d180085 req-d4dec842-bb5e-40ca-9c4f-ef3bd6166e8e service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received event network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:18:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9de3c3f3-2a20-478f-8440-f9626d180085 req-d4dec842-bb5e-40ca-9c4f-ef3bd6166e8e service nova] Acquiring lock "82362140-8606-41dc-a574-86b0b89a7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9de3c3f3-2a20-478f-8440-f9626d180085 req-d4dec842-bb5e-40ca-9c4f-ef3bd6166e8e service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9de3c3f3-2a20-478f-8440-f9626d180085 req-d4dec842-bb5e-40ca-9c4f-ef3bd6166e8e service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-9de3c3f3-2a20-478f-8440-f9626d180085 req-d4dec842-bb5e-40ca-9c4f-ef3bd6166e8e service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] No waiting events found dispatching network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:18:56 user nova-compute[74980]: WARNING nova.compute.manager [req-9de3c3f3-2a20-478f-8440-f9626d180085 req-d4dec842-bb5e-40ca-9c4f-ef3bd6166e8e service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received unexpected event network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 for instance with vm_state active and task_state None.
Nov 02 17:18:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:18:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:18:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:18:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:18:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:18:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:18:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:18:59 user nova-compute[74980]: INFO nova.compute.claims [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Claim successful on node user
Nov 02 17:18:59 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG nova.network.neutron [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:18:59 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:18:59 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG nova.policy [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05186d8245f04cb19095cf71ee92f70b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7978c159e5d431aba9762331de242f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:18:59 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Creating image(s)
Nov 02 17:18:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "/opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "/opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:18:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.213s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG nova.compute.manager [req-f0def044-969e-4ab2-9290-2e4e0ae5414d req-cef75988-b003-4a2e-8e27-dffdfe84d183 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Received event network-changed-ea1b9b79-0495-451f-a67d-e997c88e4b60 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG nova.compute.manager [req-f0def044-969e-4ab2-9290-2e4e0ae5414d req-cef75988-b003-4a2e-8e27-dffdfe84d183 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Refreshing instance network info cache due to event network-changed-ea1b9b79-0495-451f-a67d-e997c88e4b60. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f0def044-969e-4ab2-9290-2e4e0ae5414d req-cef75988-b003-4a2e-8e27-dffdfe84d183 service nova] Acquiring lock "refresh_cache-d7f2fa00-48af-4277-93b4-af930e4a650f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f0def044-969e-4ab2-9290-2e4e0ae5414d req-cef75988-b003-4a2e-8e27-dffdfe84d183 service nova] Acquired lock "refresh_cache-d7f2fa00-48af-4277-93b4-af930e4a650f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG nova.network.neutron [req-f0def044-969e-4ab2-9290-2e4e0ae5414d req-cef75988-b003-4a2e-8e27-dffdfe84d183 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Refreshing network info cache for port ea1b9b79-0495-451f-a67d-e997c88e4b60 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.221s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/disk 1073741824" returned: 0 in 0.055s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.206s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Successfully created port: 2533a0ac-59e2-4487-956e-6d015258f4a4 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Cannot resize image /opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Ensure instance console log exists: /opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:01 user nova-compute[74980]: DEBUG nova.network.neutron [req-f0def044-969e-4ab2-9290-2e4e0ae5414d req-cef75988-b003-4a2e-8e27-dffdfe84d183 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Updated VIF entry in instance network info cache for port ea1b9b79-0495-451f-a67d-e997c88e4b60. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:19:01 user nova-compute[74980]: DEBUG nova.network.neutron [req-f0def044-969e-4ab2-9290-2e4e0ae5414d req-cef75988-b003-4a2e-8e27-dffdfe84d183 service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Updating instance_info_cache with network_info: [{"id": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "address": "fa:16:3e:28:61:3f", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1b9b79-04", "ovs_interfaceid": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f0def044-969e-4ab2-9290-2e4e0ae5414d req-cef75988-b003-4a2e-8e27-dffdfe84d183 service nova] Releasing lock "refresh_cache-d7f2fa00-48af-4277-93b4-af930e4a650f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG nova.network.neutron [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Successfully updated port: 2533a0ac-59e2-4487-956e-6d015258f4a4 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "refresh_cache-8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquired lock "refresh_cache-8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG nova.network.neutron [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG nova.compute.manager [req-37cbfe47-a76e-4dc6-a490-66f15b02c476 req-910e1f48-0f96-40ac-960c-beb6c23d295f service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Received event network-changed-2533a0ac-59e2-4487-956e-6d015258f4a4 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG nova.compute.manager [req-37cbfe47-a76e-4dc6-a490-66f15b02c476 req-910e1f48-0f96-40ac-960c-beb6c23d295f service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Refreshing instance network info cache due to event network-changed-2533a0ac-59e2-4487-956e-6d015258f4a4. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-37cbfe47-a76e-4dc6-a490-66f15b02c476 req-910e1f48-0f96-40ac-960c-beb6c23d295f service nova] Acquiring lock "refresh_cache-8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG nova.network.neutron [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.network.neutron [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Updating instance_info_cache with network_info: [{"id": "2533a0ac-59e2-4487-956e-6d015258f4a4", "address": "fa:16:3e:76:46:1e", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2533a0ac-59", "ovs_interfaceid": "2533a0ac-59e2-4487-956e-6d015258f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:03 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:19:03 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=7301MB free_disk=25.486217498779297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Releasing lock "refresh_cache-8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Instance network_info: |[{"id": "2533a0ac-59e2-4487-956e-6d015258f4a4", "address": "fa:16:3e:76:46:1e", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2533a0ac-59", "ovs_interfaceid": "2533a0ac-59e2-4487-956e-6d015258f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-37cbfe47-a76e-4dc6-a490-66f15b02c476 req-910e1f48-0f96-40ac-960c-beb6c23d295f service nova] Acquired lock "refresh_cache-8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.network.neutron [req-37cbfe47-a76e-4dc6-a490-66f15b02c476 req-910e1f48-0f96-40ac-960c-beb6c23d295f service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Refreshing network info cache for port 2533a0ac-59e2-4487-956e-6d015258f4a4 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Start _get_guest_xml network_info=[{"id": "2533a0ac-59e2-4487-956e-6d015258f4a4", "address": "fa:16:3e:76:46:1e", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2533a0ac-59", "ovs_interfaceid": "2533a0ac-59e2-4487-956e-6d015258f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:19:03 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:19:03 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:18:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-803444856',display_name='tempest-ServersNegativeTestJSON-server-803444856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-803444856',id=10,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7978c159e5d431aba9762331de242f1',ramdisk_id='',reservation_id='r-exettqr4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1915471849',owner_user_name='tempest-ServersNegativeTestJSON-1915471849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:00Z,user_data=None,user_id='05186d8245f04cb19095cf71ee92f70b',uuid=8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2533a0ac-59e2-4487-956e-6d015258f4a4", "address": "fa:16:3e:76:46:1e", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2533a0ac-59", "ovs_interfaceid": "2533a0ac-59e2-4487-956e-6d015258f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Converting VIF {"id": "2533a0ac-59e2-4487-956e-6d015258f4a4", "address": "fa:16:3e:76:46:1e", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2533a0ac-59", "ovs_interfaceid": "2533a0ac-59e2-4487-956e-6d015258f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:46:1e,bridge_name='br-int',has_traffic_filtering=True,id=2533a0ac-59e2-4487-956e-6d015258f4a4,network=Network(e19b7ac0-cd44-4a92-8414-9f1a78021fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2533a0ac-59') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.objects.instance [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:19:03 user nova-compute[74980]:   <uuid>8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd</uuid>
Nov 02 17:19:03 user nova-compute[74980]:   <name>instance-0000000a</name>
Nov 02 17:19:03 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:19:03 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:19:03 user nova-compute[74980]:   <metadata>
Nov 02 17:19:03 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:19:03 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:19:03 user nova-compute[74980]:       <nova:name>tempest-ServersNegativeTestJSON-server-803444856</nova:name>
Nov 02 17:19:03 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:19:03</nova:creationTime>
Nov 02 17:19:03 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:19:03 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:19:03 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:19:03 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:19:03 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:19:03 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:19:03 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:19:03 user nova-compute[74980]:       <nova:owner>
Nov 02 17:19:03 user nova-compute[74980]:         <nova:user uuid="05186d8245f04cb19095cf71ee92f70b">tempest-ServersNegativeTestJSON-1915471849-project-member</nova:user>
Nov 02 17:19:03 user nova-compute[74980]:         <nova:project uuid="e7978c159e5d431aba9762331de242f1">tempest-ServersNegativeTestJSON-1915471849</nova:project>
Nov 02 17:19:03 user nova-compute[74980]:       </nova:owner>
Nov 02 17:19:03 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:19:03 user nova-compute[74980]:       <nova:ports>
Nov 02 17:19:03 user nova-compute[74980]:         <nova:port uuid="2533a0ac-59e2-4487-956e-6d015258f4a4">
Nov 02 17:19:03 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 17:19:03 user nova-compute[74980]:         </nova:port>
Nov 02 17:19:03 user nova-compute[74980]:       </nova:ports>
Nov 02 17:19:03 user nova-compute[74980]:     </nova:instance>
Nov 02 17:19:03 user nova-compute[74980]:   </metadata>
Nov 02 17:19:03 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:19:03 user nova-compute[74980]:     <system>
Nov 02 17:19:03 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:19:03 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:19:03 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:19:03 user nova-compute[74980]:       <entry name="serial">8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd</entry>
Nov 02 17:19:03 user nova-compute[74980]:       <entry name="uuid">8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd</entry>
Nov 02 17:19:03 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:19:03 user nova-compute[74980]:     </system>
Nov 02 17:19:03 user nova-compute[74980]:   </sysinfo>
Nov 02 17:19:03 user nova-compute[74980]:   <os>
Nov 02 17:19:03 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:19:03 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:19:03 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:19:03 user nova-compute[74980]:   </os>
Nov 02 17:19:03 user nova-compute[74980]:   <features>
Nov 02 17:19:03 user nova-compute[74980]:     <acpi/>
Nov 02 17:19:03 user nova-compute[74980]:     <apic/>
Nov 02 17:19:03 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:19:03 user nova-compute[74980]:   </features>
Nov 02 17:19:03 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:19:03 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:19:03 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:19:03 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:19:03 user nova-compute[74980]:   </clock>
Nov 02 17:19:03 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:19:03 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:19:03 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:19:03 user nova-compute[74980]:   </cpu>
Nov 02 17:19:03 user nova-compute[74980]:   <devices>
Nov 02 17:19:03 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:19:03 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:19:03 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/disk"/>
Nov 02 17:19:03 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:19:03 user nova-compute[74980]:     </disk>
Nov 02 17:19:03 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:19:03 user nova-compute[74980]:       <mac address="fa:16:3e:76:46:1e"/>
Nov 02 17:19:03 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:19:03 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:19:03 user nova-compute[74980]:       <target dev="tap2533a0ac-59"/>
Nov 02 17:19:03 user nova-compute[74980]:     </interface>
Nov 02 17:19:03 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:19:03 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/console.log" append="off"/>
Nov 02 17:19:03 user nova-compute[74980]:     </serial>
Nov 02 17:19:03 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:19:03 user nova-compute[74980]:     <video>
Nov 02 17:19:03 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:19:03 user nova-compute[74980]:     </video>
Nov 02 17:19:03 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:19:03 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:19:03 user nova-compute[74980]:     </rng>
Nov 02 17:19:03 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:19:03 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:19:03 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:19:03 user nova-compute[74980]:     </memballoon>
Nov 02 17:19:03 user nova-compute[74980]:   </devices>
Nov 02 17:19:03 user nova-compute[74980]: </domain>
Nov 02 17:19:03 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:18:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-803444856',display_name='tempest-ServersNegativeTestJSON-server-803444856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-803444856',id=10,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7978c159e5d431aba9762331de242f1',ramdisk_id='',reservation_id='r-exettqr4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1915471849',owner_user_name='tempest-ServersNegativeTestJSON-1915471849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:00Z,user_data=None,user_id='05186d8245f04cb19095cf71ee92f70b',uuid=8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2533a0ac-59e2-4487-956e-6d015258f4a4", "address": "fa:16:3e:76:46:1e", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2533a0ac-59", "ovs_interfaceid": "2533a0ac-59e2-4487-956e-6d015258f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Converting VIF {"id": "2533a0ac-59e2-4487-956e-6d015258f4a4", "address": "fa:16:3e:76:46:1e", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2533a0ac-59", "ovs_interfaceid": "2533a0ac-59e2-4487-956e-6d015258f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:46:1e,bridge_name='br-int',has_traffic_filtering=True,id=2533a0ac-59e2-4487-956e-6d015258f4a4,network=Network(e19b7ac0-cd44-4a92-8414-9f1a78021fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2533a0ac-59') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG os_vif [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:46:1e,bridge_name='br-int',has_traffic_filtering=True,id=2533a0ac-59e2-4487-956e-6d015258f4a4,network=Network(e19b7ac0-cd44-4a92-8414-9f1a78021fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2533a0ac-59') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac37fa37-56d2-5d9f-a0c7-5a17c8cba1f3', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2533a0ac-59, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2533a0ac-59, col_values=(('qos', UUID('769c0601-669d-4bca-9452-b72934a11125')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2533a0ac-59, col_values=(('external_ids', {'iface-id': '2533a0ac-59e2-4487-956e-6d015258f4a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:46:1e', 'vm-uuid': '8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:19:03 user nova-compute[74980]: INFO os_vif [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:46:1e,bridge_name='br-int',has_traffic_filtering=True,id=2533a0ac-59e2-4487-956e-6d015258f4a4,network=Network(e19b7ac0-cd44-4a92-8414-9f1a78021fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2533a0ac-59')
Nov 02 17:19:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 82362140-8606-41dc-a574-86b0b89a7a35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1154d1f9-80b8-405b-8fd8-c10bb39c507f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance d7f2fa00-48af-4277-93b4-af930e4a650f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 9ef84810-0506-4439-9302-72b239c8dddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 4e6bfb81-f01c-47e6-b771-7c2b34587623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] No VIF found with MAC fa:16:3e:76:46:1e, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.network.neutron [req-37cbfe47-a76e-4dc6-a490-66f15b02c476 req-910e1f48-0f96-40ac-960c-beb6c23d295f service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Updated VIF entry in instance network info cache for port 2533a0ac-59e2-4487-956e-6d015258f4a4. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.network.neutron [req-37cbfe47-a76e-4dc6-a490-66f15b02c476 req-910e1f48-0f96-40ac-960c-beb6c23d295f service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Updating instance_info_cache with network_info: [{"id": "2533a0ac-59e2-4487-956e-6d015258f4a4", "address": "fa:16:3e:76:46:1e", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2533a0ac-59", "ovs_interfaceid": "2533a0ac-59e2-4487-956e-6d015258f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-37cbfe47-a76e-4dc6-a490-66f15b02c476 req-910e1f48-0f96-40ac-960c-beb6c23d295f service nova] Releasing lock "refresh_cache-8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.763s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.435s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:19:04 user nova-compute[74980]: INFO nova.compute.claims [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Claim successful on node user
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-1d0398a5-cb93-4e8a-92cb-1f9803126f8a req-e45c8654-4038-4186-8c3e-dc64f4d6abd8 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Received event network-changed-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-1d0398a5-cb93-4e8a-92cb-1f9803126f8a req-e45c8654-4038-4186-8c3e-dc64f4d6abd8 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Refreshing instance network info cache due to event network-changed-d48f410f-fd59-42c7-bf39-17ccc20ad6b8. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1d0398a5-cb93-4e8a-92cb-1f9803126f8a req-e45c8654-4038-4186-8c3e-dc64f4d6abd8 service nova] Acquiring lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1d0398a5-cb93-4e8a-92cb-1f9803126f8a req-e45c8654-4038-4186-8c3e-dc64f4d6abd8 service nova] Acquired lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:04 user nova-compute[74980]: DEBUG nova.network.neutron [req-1d0398a5-cb93-4e8a-92cb-1f9803126f8a req-e45c8654-4038-4186-8c3e-dc64f4d6abd8 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Refreshing network info cache for port d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Acquiring lock "f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Lock "f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.029s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:19:05 user nova-compute[74980]: INFO nova.compute.claims [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Claim successful on node user
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.network.neutron [req-1d0398a5-cb93-4e8a-92cb-1f9803126f8a req-e45c8654-4038-4186-8c3e-dc64f4d6abd8 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updated VIF entry in instance network info cache for port d48f410f-fd59-42c7-bf39-17ccc20ad6b8. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.network.neutron [req-1d0398a5-cb93-4e8a-92cb-1f9803126f8a req-e45c8654-4038-4186-8c3e-dc64f4d6abd8 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updating instance_info_cache with network_info: [{"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1d0398a5-cb93-4e8a-92cb-1f9803126f8a req-e45c8654-4038-4186-8c3e-dc64f4d6abd8 service nova] Releasing lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:05 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:19:05 user nova-compute[74980]: INFO nova.virt.block_device [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Booting with volume 20786b37-ba1d-4adc-a8c1-a25648258b63 at /dev/vda
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.policy [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e420faa880a6456bbd1d7d63d8af2883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd832a86ce41938aedfddef7ac7fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG os_brick.utils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[126db886-7626-41c7-a002-36b5e6bc2e5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7935c604-c783-4dbe-b682-fcd2afe6f517]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b1ddec-07d6-40cd-8b46-c0630fe8223c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[833f655e-b003-48d8-8626-63c546e9453a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:05 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36f204b-6515-4056-b5bc-821c150690c7]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG os_brick.utils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating existing volume attachment record: 2312c515-8dbc-4228-b6f9-42c205303b20 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-d7f2fa00-48af-4277-93b4-af930e4a650f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-d7f2fa00-48af-4277-93b4-af930e4a650f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.630s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-25256f79-1236-4877-988b-8c14885a5ba4 req-a1780b08-296b-4c93-913b-74d5d1d342bd service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Received event network-vif-plugged-2533a0ac-59e2-4487-956e-6d015258f4a4 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-25256f79-1236-4877-988b-8c14885a5ba4 req-a1780b08-296b-4c93-913b-74d5d1d342bd service nova] Acquiring lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-25256f79-1236-4877-988b-8c14885a5ba4 req-a1780b08-296b-4c93-913b-74d5d1d342bd service nova] Lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-25256f79-1236-4877-988b-8c14885a5ba4 req-a1780b08-296b-4c93-913b-74d5d1d342bd service nova] Lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-25256f79-1236-4877-988b-8c14885a5ba4 req-a1780b08-296b-4c93-913b-74d5d1d342bd service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] No waiting events found dispatching network-vif-plugged-2533a0ac-59e2-4487-956e-6d015258f4a4 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:19:05 user nova-compute[74980]: WARNING nova.compute.manager [req-25256f79-1236-4877-988b-8c14885a5ba4 req-a1780b08-296b-4c93-913b-74d5d1d342bd service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Received unexpected event network-vif-plugged-2533a0ac-59e2-4487-956e-6d015258f4a4 for instance with vm_state building and task_state spawning.
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:19:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:05 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:19:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:19:06 user nova-compute[74980]: INFO nova.virt.block_device [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Booting with volume 3e8e2aeb-cd64-4a59-a963-049cd3f9fc6a at /dev/vda
Nov 02 17:19:06 user nova-compute[74980]: DEBUG os_brick.utils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[80707fe1-0f25-4997-a8be-c15de7b79162]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80534e4-801d-42cf-a0d7-8667f7006f00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d020819e-1996-439a-acf0-71d3a3eec3a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0a1274-9db1-4ead-84ea-df5926351481]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:06 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae460d7-2ea1-4d94-95b3-4a59f98dc10a]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG os_brick.utils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Updating existing volume attachment record: 85d17cd1-5e5c-4cca-ada7-f6807a098c55 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG nova.policy [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '473bdd50c7eb455f943c2ea12fb22617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22b7337cf864f039098d9ca369831ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Successfully created port: 65610a01-9aaa-4755-ba01-ee4e72320408 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Updating instance_info_cache with network_info: [{"id": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "address": "fa:16:3e:28:61:3f", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1b9b79-04", "ovs_interfaceid": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-d7f2fa00-48af-4277-93b4-af930e4a650f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:19:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "d7f2fa00-48af-4277-93b4-af930e4a650f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG nova.objects.instance [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'flavor' on Instance uuid d7f2fa00-48af-4277-93b4-af930e4a650f {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Successfully created port: 1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Successfully created port: 774d9b42-edc6-4b48-92cc-ab4aed571c55 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.140s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "d7f2fa00-48af-4277-93b4-af930e4a650f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:07 user nova-compute[74980]: INFO nova.compute.manager [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Attaching volume e3c99903-2f39-4a4b-8558-4c83878f1d5b to /dev/vdb
Nov 02 17:19:07 user nova-compute[74980]: DEBUG os_brick.utils [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6c1181-9155-4738-90cc-e74ccb5b4f02]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG nova.compute.manager [req-addc0468-0d01-40ea-a30e-75f2cdc55e3b req-52bc1d35-8dd7-4bd9-ab41-f5469668f7c7 service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Received event network-vif-plugged-2533a0ac-59e2-4487-956e-6d015258f4a4 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-addc0468-0d01-40ea-a30e-75f2cdc55e3b req-52bc1d35-8dd7-4bd9-ab41-f5469668f7c7 service nova] Acquiring lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-addc0468-0d01-40ea-a30e-75f2cdc55e3b req-52bc1d35-8dd7-4bd9-ab41-f5469668f7c7 service nova] Lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-addc0468-0d01-40ea-a30e-75f2cdc55e3b req-52bc1d35-8dd7-4bd9-ab41-f5469668f7c7 service nova] Lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG nova.compute.manager [req-addc0468-0d01-40ea-a30e-75f2cdc55e3b req-52bc1d35-8dd7-4bd9-ab41-f5469668f7c7 service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] No waiting events found dispatching network-vif-plugged-2533a0ac-59e2-4487-956e-6d015258f4a4 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:19:07 user nova-compute[74980]: WARNING nova.compute.manager [req-addc0468-0d01-40ea-a30e-75f2cdc55e3b req-52bc1d35-8dd7-4bd9-ab41-f5469668f7c7 service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Received unexpected event network-vif-plugged-2533a0ac-59e2-4487-956e-6d015258f4a4 for instance with vm_state building and task_state spawning.
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[996724a3-8719-4dfe-8617-f13bedf071fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e4faef-c67e-492a-b919-183b17845e68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d6cb8a-9762-4677-8e7d-9b15a28ac5d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:19:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:08 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Instance spawned successfully.
Nov 02 17:19:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:19:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:08 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:19:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ec0bbb-952c-49ff-ad49-f762196af25b]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:19:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:19:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:19:08 user nova-compute[74980]: DEBUG os_brick.utils [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:19:08 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Updating existing volume attachment record: 45d045a5-4cfe-49ba-a47c-0aad645c4648 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:19:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:19:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:19:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:19:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:19:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:19:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:19:08 user nova-compute[74980]: INFO nova.compute.manager [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Took 8.34 seconds to spawn the instance on the hypervisor.
Nov 02 17:19:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:19:08 user nova-compute[74980]: INFO nova.compute.manager [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Took 9.31 seconds to build instance.
Nov 02 17:19:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fcb93cfc-0fd5-477b-9d4a-23257f231317 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.456s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:08 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Successfully created port: a198f607-58f8-4ce4-81e1-6621b1978970 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:19:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:09 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Successfully created port: 2b25c905-b2e0-4108-8cfc-f98176dbcb80 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:19:09 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Successfully created port: 5fe1ced3-ac4c-4ed5-a69c-2503051039c4 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:19:10 user nova-compute[74980]: DEBUG nova.compute.manager [req-28e74e9c-66a6-4ed6-aeb5-8e345920badf req-bdaeba43-724f-452e-aa1a-2a24cf6622c5 service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Received event network-changed-0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:10 user nova-compute[74980]: DEBUG nova.compute.manager [req-28e74e9c-66a6-4ed6-aeb5-8e345920badf req-bdaeba43-724f-452e-aa1a-2a24cf6622c5 service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Refreshing instance network info cache due to event network-changed-0864571c-261a-43f1-a1ec-0c481e22f430. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-28e74e9c-66a6-4ed6-aeb5-8e345920badf req-bdaeba43-724f-452e-aa1a-2a24cf6622c5 service nova] Acquiring lock "refresh_cache-e9d8737b-e341-4c00-bb8c-6e1847d24418" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-28e74e9c-66a6-4ed6-aeb5-8e345920badf req-bdaeba43-724f-452e-aa1a-2a24cf6622c5 service nova] Acquired lock "refresh_cache-e9d8737b-e341-4c00-bb8c-6e1847d24418" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:10 user nova-compute[74980]: DEBUG nova.network.neutron [req-28e74e9c-66a6-4ed6-aeb5-8e345920badf req-bdaeba43-724f-452e-aa1a-2a24cf6622c5 service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Refreshing network info cache for port 0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:10 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Successfully created port: 4b98210b-a018-4279-8528-69992920e5cc {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:19:11 user nova-compute[74980]: DEBUG nova.network.neutron [req-28e74e9c-66a6-4ed6-aeb5-8e345920badf req-bdaeba43-724f-452e-aa1a-2a24cf6622c5 service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Updated VIF entry in instance network info cache for port 0864571c-261a-43f1-a1ec-0c481e22f430. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:19:11 user nova-compute[74980]: DEBUG nova.network.neutron [req-28e74e9c-66a6-4ed6-aeb5-8e345920badf req-bdaeba43-724f-452e-aa1a-2a24cf6622c5 service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Updating instance_info_cache with network_info: [{"id": "0864571c-261a-43f1-a1ec-0c481e22f430", "address": "fa:16:3e:08:8e:66", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0864571c-26", "ovs_interfaceid": "0864571c-261a-43f1-a1ec-0c481e22f430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-28e74e9c-66a6-4ed6-aeb5-8e345920badf req-bdaeba43-724f-452e-aa1a-2a24cf6622c5 service nova] Releasing lock "refresh_cache-e9d8737b-e341-4c00-bb8c-6e1847d24418" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Successfully created port: 0747d143-a415-4448-acdb-11603f52e1af {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:19:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Successfully created port: 8b69b12c-b024-44d8-81ff-7c6c9f869743 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:19:12 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Successfully created port: abc62b54-e6f4-4980-a9a9-449ccacfa04f {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:19:13 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Successfully updated port: 65610a01-9aaa-4755-ba01-ee4e72320408 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-450b6450-da53-4361-b7a2-db9273f043ba req-9cad40a5-7de3-40fb-bae3-4f05259df1fb service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-changed-65610a01-9aaa-4755-ba01-ee4e72320408 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-450b6450-da53-4361-b7a2-db9273f043ba req-9cad40a5-7de3-40fb-bae3-4f05259df1fb service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing instance network info cache due to event network-changed-65610a01-9aaa-4755-ba01-ee4e72320408. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-450b6450-da53-4361-b7a2-db9273f043ba req-9cad40a5-7de3-40fb-bae3-4f05259df1fb service nova] Acquiring lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-450b6450-da53-4361-b7a2-db9273f043ba req-9cad40a5-7de3-40fb-bae3-4f05259df1fb service nova] Acquired lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:13 user nova-compute[74980]: DEBUG nova.network.neutron [req-450b6450-da53-4361-b7a2-db9273f043ba req-9cad40a5-7de3-40fb-bae3-4f05259df1fb service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing network info cache for port 65610a01-9aaa-4755-ba01-ee4e72320408 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:13 user nova-compute[74980]: DEBUG nova.network.neutron [req-450b6450-da53-4361-b7a2-db9273f043ba req-9cad40a5-7de3-40fb-bae3-4f05259df1fb service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:19:13 user nova-compute[74980]: DEBUG nova.network.neutron [req-450b6450-da53-4361-b7a2-db9273f043ba req-9cad40a5-7de3-40fb-bae3-4f05259df1fb service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-450b6450-da53-4361-b7a2-db9273f043ba req-9cad40a5-7de3-40fb-bae3-4f05259df1fb service nova] Releasing lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:14 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Successfully updated port: 1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:14 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Successfully updated port: 97328bbf-6210-4167-98ef-df662837d418 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG nova.compute.manager [req-31fd0452-f863-4562-a6eb-28a812445a20 req-6a681c96-8d04-4e08-a742-6d28db891ced service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Received event network-changed-b915b940-4c54-4954-9996-938c74f1d50f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG nova.compute.manager [req-31fd0452-f863-4562-a6eb-28a812445a20 req-6a681c96-8d04-4e08-a742-6d28db891ced service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Refreshing instance network info cache due to event network-changed-b915b940-4c54-4954-9996-938c74f1d50f. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-31fd0452-f863-4562-a6eb-28a812445a20 req-6a681c96-8d04-4e08-a742-6d28db891ced service nova] Acquiring lock "refresh_cache-1154d1f9-80b8-405b-8fd8-c10bb39c507f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-31fd0452-f863-4562-a6eb-28a812445a20 req-6a681c96-8d04-4e08-a742-6d28db891ced service nova] Acquired lock "refresh_cache-1154d1f9-80b8-405b-8fd8-c10bb39c507f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG nova.network.neutron [req-31fd0452-f863-4562-a6eb-28a812445a20 req-6a681c96-8d04-4e08-a742-6d28db891ced service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Refreshing network info cache for port b915b940-4c54-4954-9996-938c74f1d50f {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG nova.compute.manager [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Received event network-changed-1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG nova.compute.manager [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Refreshing instance network info cache due to event network-changed-1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] Acquiring lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] Acquired lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG nova.network.neutron [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Refreshing network info cache for port 1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG nova.network.neutron [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG nova.network.neutron [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] Releasing lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG nova.compute.manager [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-changed-97328bbf-6210-4167-98ef-df662837d418 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG nova.compute.manager [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing instance network info cache due to event network-changed-97328bbf-6210-4167-98ef-df662837d418. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] Acquiring lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] Acquired lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:15 user nova-compute[74980]: DEBUG nova.network.neutron [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing network info cache for port 97328bbf-6210-4167-98ef-df662837d418 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:16 user nova-compute[74980]: DEBUG nova.network.neutron [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:19:16 user nova-compute[74980]: DEBUG nova.network.neutron [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:16 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Successfully updated port: ab5600fb-8b71-492d-80db-d8a5559d2087 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ebf34bf7-79a9-4f03-98d3-ffed79abc261 req-5a765f30-9f15-440a-ab02-6d80fb71d74d service nova] Releasing lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:16 user nova-compute[74980]: DEBUG nova.network.neutron [req-31fd0452-f863-4562-a6eb-28a812445a20 req-6a681c96-8d04-4e08-a742-6d28db891ced service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Updated VIF entry in instance network info cache for port b915b940-4c54-4954-9996-938c74f1d50f. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:19:16 user nova-compute[74980]: DEBUG nova.network.neutron [req-31fd0452-f863-4562-a6eb-28a812445a20 req-6a681c96-8d04-4e08-a742-6d28db891ced service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Updating instance_info_cache with network_info: [{"id": "b915b940-4c54-4954-9996-938c74f1d50f", "address": "fa:16:3e:5d:ba:b9", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb915b940-4c", "ovs_interfaceid": "b915b940-4c54-4954-9996-938c74f1d50f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-31fd0452-f863-4562-a6eb-28a812445a20 req-6a681c96-8d04-4e08-a742-6d28db891ced service nova] Releasing lock "refresh_cache-1154d1f9-80b8-405b-8fd8-c10bb39c507f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:16 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Successfully updated port: 43469d86-f716-49ce-bb76-f9cc4016366b {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Received event network-changed-ab5600fb-8b71-492d-80db-d8a5559d2087 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Refreshing instance network info cache due to event network-changed-ab5600fb-8b71-492d-80db-d8a5559d2087. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] Acquiring lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] Acquired lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:17 user nova-compute[74980]: DEBUG nova.network.neutron [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Refreshing network info cache for port ab5600fb-8b71-492d-80db-d8a5559d2087 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:17 user nova-compute[74980]: DEBUG nova.network.neutron [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:19:17 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Successfully updated port: 70d88ea5-2a37-49ac-a8cf-726ab5c5eac3 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:18 user nova-compute[74980]: DEBUG nova.network.neutron [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] Releasing lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:18 user nova-compute[74980]: DEBUG nova.compute.manager [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-changed-43469d86-f716-49ce-bb76-f9cc4016366b {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:18 user nova-compute[74980]: DEBUG nova.compute.manager [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing instance network info cache due to event network-changed-43469d86-f716-49ce-bb76-f9cc4016366b. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] Acquiring lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] Acquired lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:18 user nova-compute[74980]: DEBUG nova.network.neutron [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing network info cache for port 43469d86-f716-49ce-bb76-f9cc4016366b {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:18 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Successfully updated port: 774d9b42-edc6-4b48-92cc-ab4aed571c55 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:18 user nova-compute[74980]: DEBUG nova.network.neutron [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:19:18 user nova-compute[74980]: DEBUG nova.network.neutron [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4b7ad909-8ae8-40b4-8c06-2d75be4c65a5 req-c380d866-01d0-4cbf-b32f-367914367f69 service nova] Releasing lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Received event network-changed-70d88ea5-2a37-49ac-a8cf-726ab5c5eac3 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Refreshing instance network info cache due to event network-changed-70d88ea5-2a37-49ac-a8cf-726ab5c5eac3. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] Acquiring lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] Acquired lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:19 user nova-compute[74980]: DEBUG nova.network.neutron [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Refreshing network info cache for port 70d88ea5-2a37-49ac-a8cf-726ab5c5eac3 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:19 user nova-compute[74980]: DEBUG nova.network.neutron [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:19:19 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Successfully updated port: a198f607-58f8-4ce4-81e1-6621b1978970 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:20 user nova-compute[74980]: DEBUG nova.network.neutron [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] Releasing lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:20 user nova-compute[74980]: DEBUG nova.compute.manager [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-changed-774d9b42-edc6-4b48-92cc-ab4aed571c55 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:20 user nova-compute[74980]: DEBUG nova.compute.manager [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing instance network info cache due to event network-changed-774d9b42-edc6-4b48-92cc-ab4aed571c55. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] Acquiring lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] Acquired lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:20 user nova-compute[74980]: DEBUG nova.network.neutron [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing network info cache for port 774d9b42-edc6-4b48-92cc-ab4aed571c55 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:20 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Successfully updated port: 2b25c905-b2e0-4108-8cfc-f98176dbcb80 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:20 user nova-compute[74980]: DEBUG nova.network.neutron [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:19:20 user nova-compute[74980]: DEBUG nova.network.neutron [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-03835638-f3b2-471c-9177-9cbec64b864a req-7ff394e4-d0d4-4f8e-a39a-b1f178c7eb1d service nova] Releasing lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:21 user nova-compute[74980]: DEBUG nova.compute.manager [req-50857545-d2d5-42a3-9db8-84beea632627 req-0b5808e7-465d-4e1f-8212-11cc7344722f service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Received event network-changed-d9d93843-971c-477e-9e3a-f3065c32bf63 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:21 user nova-compute[74980]: DEBUG nova.compute.manager [req-50857545-d2d5-42a3-9db8-84beea632627 req-0b5808e7-465d-4e1f-8212-11cc7344722f service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Refreshing instance network info cache due to event network-changed-d9d93843-971c-477e-9e3a-f3065c32bf63. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-50857545-d2d5-42a3-9db8-84beea632627 req-0b5808e7-465d-4e1f-8212-11cc7344722f service nova] Acquiring lock "refresh_cache-9ef84810-0506-4439-9302-72b239c8dddd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-50857545-d2d5-42a3-9db8-84beea632627 req-0b5808e7-465d-4e1f-8212-11cc7344722f service nova] Acquired lock "refresh_cache-9ef84810-0506-4439-9302-72b239c8dddd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:21 user nova-compute[74980]: DEBUG nova.network.neutron [req-50857545-d2d5-42a3-9db8-84beea632627 req-0b5808e7-465d-4e1f-8212-11cc7344722f service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Refreshing network info cache for port d9d93843-971c-477e-9e3a-f3065c32bf63 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:21 user nova-compute[74980]: DEBUG nova.compute.manager [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Received event network-changed-a198f607-58f8-4ce4-81e1-6621b1978970 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:21 user nova-compute[74980]: DEBUG nova.compute.manager [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Refreshing instance network info cache due to event network-changed-a198f607-58f8-4ce4-81e1-6621b1978970. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] Acquiring lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] Acquired lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:21 user nova-compute[74980]: DEBUG nova.network.neutron [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Refreshing network info cache for port a198f607-58f8-4ce4-81e1-6621b1978970 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:21 user nova-compute[74980]: DEBUG nova.network.neutron [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG nova.network.neutron [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] Releasing lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG nova.compute.manager [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-changed-2b25c905-b2e0-4108-8cfc-f98176dbcb80 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG nova.compute.manager [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing instance network info cache due to event network-changed-2b25c905-b2e0-4108-8cfc-f98176dbcb80. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] Acquiring lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] Acquired lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG nova.network.neutron [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing network info cache for port 2b25c905-b2e0-4108-8cfc-f98176dbcb80 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Successfully updated port: 5fe1ced3-ac4c-4ed5-a69c-2503051039c4 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG nova.network.neutron [req-50857545-d2d5-42a3-9db8-84beea632627 req-0b5808e7-465d-4e1f-8212-11cc7344722f service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Updated VIF entry in instance network info cache for port d9d93843-971c-477e-9e3a-f3065c32bf63. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG nova.network.neutron [req-50857545-d2d5-42a3-9db8-84beea632627 req-0b5808e7-465d-4e1f-8212-11cc7344722f service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Updating instance_info_cache with network_info: [{"id": "d9d93843-971c-477e-9e3a-f3065c32bf63", "address": "fa:16:3e:42:50:a7", "network": {"id": "77a350e1-e514-4d3b-889c-0b93f203d3a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-403711479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5510f386174150b459057618f4d82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d93843-97", "ovs_interfaceid": "d9d93843-971c-477e-9e3a-f3065c32bf63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-50857545-d2d5-42a3-9db8-84beea632627 req-0b5808e7-465d-4e1f-8212-11cc7344722f service nova] Releasing lock "refresh_cache-9ef84810-0506-4439-9302-72b239c8dddd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG nova.network.neutron [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Successfully updated port: 4b98210b-a018-4279-8528-69992920e5cc {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG nova.network.neutron [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6a204cc8-7e2b-49af-884a-e92dfee6a3c8 req-6bf83bfc-d3d1-4630-9643-5db1237fc634 service nova] Releasing lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:22 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Successfully updated port: 0747d143-a415-4448-acdb-11603f52e1af {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Successfully updated port: 8b69b12c-b024-44d8-81ff-7c6c9f869743 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquired lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-37dc93da-b460-4a0e-ae0e-f1b852be78e7 req-9f11f6cc-3b74-4baf-8794-44cc0e6f203b service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Received event network-changed-0747d143-a415-4448-acdb-11603f52e1af {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-37dc93da-b460-4a0e-ae0e-f1b852be78e7 req-9f11f6cc-3b74-4baf-8794-44cc0e6f203b service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Refreshing instance network info cache due to event network-changed-0747d143-a415-4448-acdb-11603f52e1af. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-37dc93da-b460-4a0e-ae0e-f1b852be78e7 req-9f11f6cc-3b74-4baf-8794-44cc0e6f203b service nova] Acquiring lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-37dc93da-b460-4a0e-ae0e-f1b852be78e7 req-9f11f6cc-3b74-4baf-8794-44cc0e6f203b service nova] Acquired lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG nova.network.neutron [req-37dc93da-b460-4a0e-ae0e-f1b852be78e7 req-9f11f6cc-3b74-4baf-8794-44cc0e6f203b service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Refreshing network info cache for port 0747d143-a415-4448-acdb-11603f52e1af {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG nova.network.neutron [req-37dc93da-b460-4a0e-ae0e-f1b852be78e7 req-9f11f6cc-3b74-4baf-8794-44cc0e6f203b service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Successfully updated port: abc62b54-e6f4-4980-a9a9-449ccacfa04f {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Acquiring lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Received event network-changed-5fe1ced3-ac4c-4ed5-a69c-2503051039c4 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Refreshing instance network info cache due to event network-changed-5fe1ced3-ac4c-4ed5-a69c-2503051039c4. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] Acquiring lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG nova.network.neutron [req-37dc93da-b460-4a0e-ae0e-f1b852be78e7 req-9f11f6cc-3b74-4baf-8794-44cc0e6f203b service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-37dc93da-b460-4a0e-ae0e-f1b852be78e7 req-9f11f6cc-3b74-4baf-8794-44cc0e6f203b service nova] Releasing lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Acquired lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:19:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:24 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:19:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-5bd3e865-5bf7-4302-808c-e4265a4119f2 req-8e3fbf32-f81e-4bd0-8dd2-9be7fe6db412 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Received event network-changed-abc62b54-e6f4-4980-a9a9-449ccacfa04f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-5bd3e865-5bf7-4302-808c-e4265a4119f2 req-8e3fbf32-f81e-4bd0-8dd2-9be7fe6db412 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Refreshing instance network info cache due to event network-changed-abc62b54-e6f4-4980-a9a9-449ccacfa04f. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5bd3e865-5bf7-4302-808c-e4265a4119f2 req-8e3fbf32-f81e-4bd0-8dd2-9be7fe6db412 service nova] Acquiring lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:26 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating instance_info_cache with network_info: [{"id": "65610a01-9aaa-4755-ba01-ee4e72320408", "address": "fa:16:3e:2b:15:2f", "network": {"id": "e9224f9b-af21-4b41-a592-576ca0bb5ca6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925418223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65610a01-9a", "ovs_interfaceid": "65610a01-9aaa-4755-ba01-ee4e72320408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "address": "fa:16:3e:5a:18:ac", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774d9b42-ed", "ovs_interfaceid": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "address": "fa:16:3e:e4:49:2a", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b25c905-b2", "ovs_interfaceid": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b98210b-a018-4279-8528-69992920e5cc", "address": "fa:16:3e:4a:c0:98", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b98210b-a0", "ovs_interfaceid": "4b98210b-a018-4279-8528-69992920e5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Releasing lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:26 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Instance network_info: |[{"id": "65610a01-9aaa-4755-ba01-ee4e72320408", "address": "fa:16:3e:2b:15:2f", "network": {"id": "e9224f9b-af21-4b41-a592-576ca0bb5ca6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925418223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65610a01-9a", "ovs_interfaceid": "65610a01-9aaa-4755-ba01-ee4e72320408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "address": "fa:16:3e:5a:18:ac", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774d9b42-ed", "ovs_interfaceid": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "address": "fa:16:3e:e4:49:2a", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b25c905-b2", "ovs_interfaceid": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b98210b-a018-4279-8528-69992920e5cc", "address": "fa:16:3e:4a:c0:98", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b98210b-a0", "ovs_interfaceid": "4b98210b-a018-4279-8528-69992920e5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:19:27 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Updating instance_info_cache with network_info: [{"id": "1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f", "address": "fa:16:3e:2b:48:97", "network": {"id": "9d32acae-88da-4088-82dd-12ebba94a307", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117481914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e48e6fa-4c", "ovs_interfaceid": "1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab5600fb-8b71-492d-80db-d8a5559d2087", "address": "fa:16:3e:7f:f2:d7", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5600fb-8b", "ovs_interfaceid": "ab5600fb-8b71-492d-80db-d8a5559d2087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "70d88ea5-2a37-49ac-a8cf-726ab5c5eac3", "address": "fa:16:3e:5d:4f:bc", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d88ea5-2a", "ovs_interfaceid": "70d88ea5-2a37-49ac-a8cf-726ab5c5eac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a198f607-58f8-4ce4-81e1-6621b1978970", "address": "fa:16:3e:2f:42:c6", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa198f607-58", "ovs_interfaceid": "a198f607-58f8-4ce4-81e1-6621b1978970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fe1ced3-ac4c-4ed5-a69c-2503051039c4", "address": "fa:16:3e:1a:3e:58", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe1ced3-ac", "ovs_interfaceid": "5fe1ced3-ac4c-4ed5-a69c-2503051039c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0747d143-a415-4448-acdb-11603f52e1af", "address": "fa:16:3e:fb:e2:b2", "network": {"id": "365a17fe-7226-41ad-a0ec-5ec5fbf09d02", "bridge": "br-int", "label": "tempest-device-tagging-net2-728655755", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0747d143-a4", "ovs_interfaceid": "0747d143-a415-4448-acdb-11603f52e1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abc62b54-e6f4-4980-a9a9-449ccacfa04f", "address": "fa:16:3e:75:ca:86", "network": {"id": "365a17fe-7226-41ad-a0ec-5ec5fbf09d02", "bridge": "br-int", "label": "tempest-device-tagging-net2-728655755", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc62b54-e6", "ovs_interfaceid": "abc62b54-e6f4-4980-a9a9-449ccacfa04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Releasing lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Instance network_info: |[{"id": "1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f", "address": "fa:16:3e:2b:48:97", "network": {"id": "9d32acae-88da-4088-82dd-12ebba94a307", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117481914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e48e6fa-4c", "ovs_interfaceid": "1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab5600fb-8b71-492d-80db-d8a5559d2087", "address": "fa:16:3e:7f:f2:d7", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5600fb-8b", "ovs_interfaceid": "ab5600fb-8b71-492d-80db-d8a5559d2087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "70d88ea5-2a37-49ac-a8cf-726ab5c5eac3", "address": "fa:16:3e:5d:4f:bc", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d88ea5-2a", "ovs_interfaceid": "70d88ea5-2a37-49ac-a8cf-726ab5c5eac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a198f607-58f8-4ce4-81e1-6621b1978970", "address": "fa:16:3e:2f:42:c6", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa198f607-58", "ovs_interfaceid": "a198f607-58f8-4ce4-81e1-6621b1978970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fe1ced3-ac4c-4ed5-a69c-2503051039c4", "address": "fa:16:3e:1a:3e:58", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe1ced3-ac", "ovs_interfaceid": "5fe1ced3-ac4c-4ed5-a69c-2503051039c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0747d143-a415-4448-acdb-11603f52e1af", "address": "fa:16:3e:fb:e2:b2", "network": {"id": "365a17fe-7226-41ad-a0ec-5ec5fbf09d02", "bridge": "br-int", "label": "tempest-device-tagging-net2-728655755", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0747d143-a4", "ovs_interfaceid": "0747d143-a415-4448-acdb-11603f52e1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abc62b54-e6f4-4980-a9a9-449ccacfa04f", "address": "fa:16:3e:75:ca:86", "network": {"id": "365a17fe-7226-41ad-a0ec-5ec5fbf09d02", "bridge": "br-int", "label": "tempest-device-tagging-net2-728655755", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc62b54-e6", "ovs_interfaceid": "abc62b54-e6f4-4980-a9a9-449ccacfa04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:19:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] Acquired lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:27 user nova-compute[74980]: DEBUG nova.network.neutron [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Refreshing network info cache for port 5fe1ced3-ac4c-4ed5-a69c-2503051039c4 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:27 user nova-compute[74980]: DEBUG nova.network.neutron [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Updated VIF entry in instance network info cache for port 5fe1ced3-ac4c-4ed5-a69c-2503051039c4. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:19:27 user nova-compute[74980]: DEBUG nova.network.neutron [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Updating instance_info_cache with network_info: [{"id": "1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f", "address": "fa:16:3e:2b:48:97", "network": {"id": "9d32acae-88da-4088-82dd-12ebba94a307", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117481914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e48e6fa-4c", "ovs_interfaceid": "1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab5600fb-8b71-492d-80db-d8a5559d2087", "address": "fa:16:3e:7f:f2:d7", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5600fb-8b", "ovs_interfaceid": "ab5600fb-8b71-492d-80db-d8a5559d2087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "70d88ea5-2a37-49ac-a8cf-726ab5c5eac3", "address": "fa:16:3e:5d:4f:bc", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d88ea5-2a", "ovs_interfaceid": "70d88ea5-2a37-49ac-a8cf-726ab5c5eac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a198f607-58f8-4ce4-81e1-6621b1978970", "address": "fa:16:3e:2f:42:c6", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa198f607-58", "ovs_interfaceid": "a198f607-58f8-4ce4-81e1-6621b1978970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fe1ced3-ac4c-4ed5-a69c-2503051039c4", "address": "fa:16:3e:1a:3e:58", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe1ced3-ac", "ovs_interfaceid": "5fe1ced3-ac4c-4ed5-a69c-2503051039c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0747d143-a415-4448-acdb-11603f52e1af", "address": "fa:16:3e:fb:e2:b2", "network": {"id": "365a17fe-7226-41ad-a0ec-5ec5fbf09d02", "bridge": "br-int", "label": "tempest-device-tagging-net2-728655755", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0747d143-a4", "ovs_interfaceid": "0747d143-a415-4448-acdb-11603f52e1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abc62b54-e6f4-4980-a9a9-449ccacfa04f", "address": "fa:16:3e:75:ca:86", "network": {"id": "365a17fe-7226-41ad-a0ec-5ec5fbf09d02", "bridge": "br-int", "label": "tempest-device-tagging-net2-728655755", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc62b54-e6", "ovs_interfaceid": "abc62b54-e6f4-4980-a9a9-449ccacfa04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] Releasing lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:27 user nova-compute[74980]: DEBUG nova.compute.manager [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-changed-4b98210b-a018-4279-8528-69992920e5cc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:27 user nova-compute[74980]: DEBUG nova.compute.manager [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing instance network info cache due to event network-changed-4b98210b-a018-4279-8528-69992920e5cc. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] Acquiring lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] Acquired lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:27 user nova-compute[74980]: DEBUG nova.network.neutron [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing network info cache for port 4b98210b-a018-4279-8528-69992920e5cc {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5bd3e865-5bf7-4302-808c-e4265a4119f2 req-8e3fbf32-f81e-4bd0-8dd2-9be7fe6db412 service nova] Acquired lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:27 user nova-compute[74980]: DEBUG nova.network.neutron [req-5bd3e865-5bf7-4302-808c-e4265a4119f2 req-8e3fbf32-f81e-4bd0-8dd2-9be7fe6db412 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Refreshing network info cache for port abc62b54-e6f4-4980-a9a9-449ccacfa04f {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:28 user nova-compute[74980]: DEBUG nova.network.neutron [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updated VIF entry in instance network info cache for port 4b98210b-a018-4279-8528-69992920e5cc. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:19:28 user nova-compute[74980]: DEBUG nova.network.neutron [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating instance_info_cache with network_info: [{"id": "65610a01-9aaa-4755-ba01-ee4e72320408", "address": "fa:16:3e:2b:15:2f", "network": {"id": "e9224f9b-af21-4b41-a592-576ca0bb5ca6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925418223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65610a01-9a", "ovs_interfaceid": "65610a01-9aaa-4755-ba01-ee4e72320408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "address": "fa:16:3e:5a:18:ac", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774d9b42-ed", "ovs_interfaceid": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "address": "fa:16:3e:e4:49:2a", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b25c905-b2", "ovs_interfaceid": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b98210b-a018-4279-8528-69992920e5cc", "address": "fa:16:3e:4a:c0:98", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b98210b-a0", "ovs_interfaceid": "4b98210b-a018-4279-8528-69992920e5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:28 user nova-compute[74980]: DEBUG nova.network.neutron [req-5bd3e865-5bf7-4302-808c-e4265a4119f2 req-8e3fbf32-f81e-4bd0-8dd2-9be7fe6db412 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Updated VIF entry in instance network info cache for port abc62b54-e6f4-4980-a9a9-449ccacfa04f. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:19:28 user nova-compute[74980]: DEBUG nova.network.neutron [req-5bd3e865-5bf7-4302-808c-e4265a4119f2 req-8e3fbf32-f81e-4bd0-8dd2-9be7fe6db412 service nova] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Updating instance_info_cache with network_info: [{"id": "1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f", "address": "fa:16:3e:2b:48:97", "network": {"id": "9d32acae-88da-4088-82dd-12ebba94a307", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117481914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e48e6fa-4c", "ovs_interfaceid": "1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab5600fb-8b71-492d-80db-d8a5559d2087", "address": "fa:16:3e:7f:f2:d7", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5600fb-8b", "ovs_interfaceid": "ab5600fb-8b71-492d-80db-d8a5559d2087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "70d88ea5-2a37-49ac-a8cf-726ab5c5eac3", "address": "fa:16:3e:5d:4f:bc", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d88ea5-2a", "ovs_interfaceid": "70d88ea5-2a37-49ac-a8cf-726ab5c5eac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a198f607-58f8-4ce4-81e1-6621b1978970", "address": "fa:16:3e:2f:42:c6", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa198f607-58", "ovs_interfaceid": "a198f607-58f8-4ce4-81e1-6621b1978970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5fe1ced3-ac4c-4ed5-a69c-2503051039c4", "address": "fa:16:3e:1a:3e:58", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe1ced3-ac", "ovs_interfaceid": "5fe1ced3-ac4c-4ed5-a69c-2503051039c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0747d143-a415-4448-acdb-11603f52e1af", "address": "fa:16:3e:fb:e2:b2", "network": {"id": "365a17fe-7226-41ad-a0ec-5ec5fbf09d02", "bridge": "br-int", "label": "tempest-device-tagging-net2-728655755", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0747d143-a4", "ovs_interfaceid": "0747d143-a415-4448-acdb-11603f52e1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abc62b54-e6f4-4980-a9a9-449ccacfa04f", "address": "fa:16:3e:75:ca:86", "network": {"id": "365a17fe-7226-41ad-a0ec-5ec5fbf09d02", "bridge": "br-int", "label": "tempest-device-tagging-net2-728655755", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc62b54-e6", "ovs_interfaceid": "abc62b54-e6f4-4980-a9a9-449ccacfa04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5bd3e865-5bf7-4302-808c-e4265a4119f2 req-8e3fbf32-f81e-4bd0-8dd2-9be7fe6db412 service nova] Releasing lock "refresh_cache-f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] Releasing lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:28 user nova-compute[74980]: DEBUG nova.compute.manager [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-changed-8b69b12c-b024-44d8-81ff-7c6c9f869743 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:28 user nova-compute[74980]: DEBUG nova.compute.manager [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing instance network info cache due to event network-changed-8b69b12c-b024-44d8-81ff-7c6c9f869743. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] Acquiring lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] Acquired lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:28 user nova-compute[74980]: DEBUG nova.network.neutron [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing network info cache for port 8b69b12c-b024-44d8-81ff-7c6c9f869743 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:28 user nova-compute[74980]: DEBUG nova.network.neutron [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updated VIF entry in instance network info cache for port 8b69b12c-b024-44d8-81ff-7c6c9f869743. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:19:28 user nova-compute[74980]: DEBUG nova.network.neutron [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating instance_info_cache with network_info: [{"id": "65610a01-9aaa-4755-ba01-ee4e72320408", "address": "fa:16:3e:2b:15:2f", "network": {"id": "e9224f9b-af21-4b41-a592-576ca0bb5ca6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925418223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65610a01-9a", "ovs_interfaceid": "65610a01-9aaa-4755-ba01-ee4e72320408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "address": "fa:16:3e:5a:18:ac", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774d9b42-ed", "ovs_interfaceid": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "address": "fa:16:3e:e4:49:2a", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b25c905-b2", "ovs_interfaceid": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b98210b-a018-4279-8528-69992920e5cc", "address": "fa:16:3e:4a:c0:98", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b98210b-a0", "ovs_interfaceid": "4b98210b-a018-4279-8528-69992920e5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f8ad226-7ca5-4482-8b9a-2e9cfcdd0d92 req-4b48294d-265d-4a62-8f57-a734d46f32e1 service nova] Releasing lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:29 user nova-compute[74980]: INFO nova.virt.block_device [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Booting with volume e605ef5b-8746-4a57-87d2-ddfd8a8f0098 at /dev/vdb
Nov 02 17:19:29 user nova-compute[74980]: INFO nova.virt.block_device [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Booting with volume 79077389-e2f5-4ab3-89d8-00ed8355065d at /dev/vdb
Nov 02 17:19:29 user nova-compute[74980]: DEBUG os_brick.utils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2266a0be-081b-4a79-ac4b-f4f6f8271f83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG os_brick.utils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d0273f-7881-4745-8a59-2c6e0814aaee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14f6599-3a62-49f0-9f45-9111fe7fa4e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3a12e3-7f17-4944-9e01-d58f31c53578]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[717f7023-2692-4d57-a060-e9643cb79eb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:30 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a55b0b-f976-4014-8541-bb13711a0c6f]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.utils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating existing volume attachment record: ece0cccb-9a7a-4663-9bf6-cfbd3e2ddf79 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07f7cd4-0fec-445e-899e-71f6d2017d6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3f352c-d3ad-446a-9eaf-f029f85d4872]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4531dc6c-aad4-4b10-ab4e-0b52276b0ed0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:30 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0573722-498b-4390-8b83-f9d0ede1bd26]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.utils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] <== get_connector_properties: return (220ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Updating existing volume attachment record: 418e475a-c93a-4705-ba56-60efffd32571 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KLhqCiMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:19:30 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:19:30 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:19:30 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9408892-0227-4aed-a7b7-4c29a1b84824]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:19:30 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-2afbe585-c1fa-4e6a-99b1-dd5a848409d5 req-eaa48656-cccf-4847-ac5c-c0aacd99605e service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received event network-changed-7434f94a-713e-4434-9262-8da6a26d4006 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-2afbe585-c1fa-4e6a-99b1-dd5a848409d5 req-eaa48656-cccf-4847-ac5c-c0aacd99605e service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Refreshing instance network info cache due to event network-changed-7434f94a-713e-4434-9262-8da6a26d4006. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2afbe585-c1fa-4e6a-99b1-dd5a848409d5 req-eaa48656-cccf-4847-ac5c-c0aacd99605e service nova] Acquiring lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2afbe585-c1fa-4e6a-99b1-dd5a848409d5 req-eaa48656-cccf-4847-ac5c-c0aacd99605e service nova] Acquired lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG nova.network.neutron [req-2afbe585-c1fa-4e6a-99b1-dd5a848409d5 req-eaa48656-cccf-4847-ac5c-c0aacd99605e service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Refreshing network info cache for port 7434f94a-713e-4434-9262-8da6a26d4006 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[58335771-e0cd-44e1-be19-d9c4bb40267c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b] added
Nov 02 17:19:30 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8521ff-fb51-499a-87ee-d9b6f8a8cf32]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[93826103-2d19-462d-931f-70e7b84b1c23]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KLhqCiMU {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KLhqCiMU" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc32610f-733d-4f30-97e5-3b7d388a17f9]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KLhqCiMU'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7394bf-6ffd-47f0-91f9-a09d7dc82d2d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d166712c-ff4a-416d-af63-771476be0bc4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:19:30 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:19:30 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[789ddb7f-e727-44bb-89e3-99e8fa0e9627]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b, portal: 172.16.0.220,3260]
Nov 02 17:19:30 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b, portal: 172.16.0.220,3260] successful.
Nov 02 17:19:30 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a012f4-e250-4aef-95e0-c49bfd30cbee]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[291e8caf-0fe6-4472-b98e-973aa1daace2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:19:30 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:19:30 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:19:30 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:19:30 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76a177c-5ba7-44fd-ae3d-2ee5d947be0e]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KLhqCiMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG nova.network.neutron [req-2afbe585-c1fa-4e6a-99b1-dd5a848409d5 req-eaa48656-cccf-4847-ac5c-c0aacd99605e service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Updated VIF entry in instance network info cache for port 7434f94a-713e-4434-9262-8da6a26d4006. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG nova.network.neutron [req-2afbe585-c1fa-4e6a-99b1-dd5a848409d5 req-eaa48656-cccf-4847-ac5c-c0aacd99605e service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Updating instance_info_cache with network_info: [{"id": "7434f94a-713e-4434-9262-8da6a26d4006", "address": "fa:16:3e:d3:89:3a", "network": {"id": "6f6330e7-ef7b-4457-a97b-798bb8365964", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-523904489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7434f94a-71", "ovs_interfaceid": "7434f94a-713e-4434-9262-8da6a26d4006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "interface-aeae0fe6-ffc2-48f7-8b59-c6485851be3d-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "interface-aeae0fe6-ffc2-48f7-8b59-c6485851be3d-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG nova.objects.instance [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lazy-loading 'flavor' on Instance uuid aeae0fe6-ffc2-48f7-8b59-c6485851be3d {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2afbe585-c1fa-4e6a-99b1-dd5a848409d5 req-eaa48656-cccf-4847-ac5c-c0aacd99605e service nova] Releasing lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG nova.objects.instance [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lazy-loading 'pci_requests' on Instance uuid aeae0fe6-ffc2-48f7-8b59-c6485851be3d {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG nova.objects.base [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Object Instance<aeae0fe6-ffc2-48f7-8b59-c6485851be3d> lazy-loaded attributes: flavor,pci_requests {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:19:30 user nova-compute[74980]: DEBUG nova.network.neutron [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:19:31 user nova-compute[74980]: DEBUG nova.policy [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59c1bf383d2a48449244708dea3cd95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '061cfdc41fc64eea9bd281d8c51424c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:19:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:19:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23561623430303761', 'path': '/dev/sdc'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:19:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561623430303761', 'path': '/dev/sdc'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:19:31 user nova-compute[74980]: DEBUG nova.objects.instance [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'flavor' on Instance uuid d7f2fa00-48af-4277-93b4-af930e4a650f {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:19:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:19:31 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:19:31 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:19:31 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:19:31 user nova-compute[74980]:   <serial>e3c99903-2f39-4a4b-8558-4c83878f1d5b</serial>
Nov 02 17:19:31 user nova-compute[74980]: </disk>
Nov 02 17:19:31 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:19:31 user nova-compute[74980]: DEBUG nova.network.neutron [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Successfully created port: 8ca932f4-4d4e-4481-970f-161340d7bccc {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:19:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:19:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:19:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No VIF found with MAC fa:16:3e:28:61:3f, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:19:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7d53bd73-16ba-4534-80d8-9e42cfc318ad tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.753s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:32 user nova-compute[74980]: DEBUG nova.network.neutron [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Successfully updated port: 8ca932f4-4d4e-4481-970f-161340d7bccc {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquired lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:32 user nova-compute[74980]: DEBUG nova.network.neutron [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:19:32 user nova-compute[74980]: DEBUG nova.compute.manager [req-6f1e1950-fcd5-4838-bfd0-d258cb6cb7ca req-6b8911f2-70ca-412d-aff1-2eab245d73a5 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received event network-changed-8ca932f4-4d4e-4481-970f-161340d7bccc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:32 user nova-compute[74980]: DEBUG nova.compute.manager [req-6f1e1950-fcd5-4838-bfd0-d258cb6cb7ca req-6b8911f2-70ca-412d-aff1-2eab245d73a5 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Refreshing instance network info cache due to event network-changed-8ca932f4-4d4e-4481-970f-161340d7bccc. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6f1e1950-fcd5-4838-bfd0-d258cb6cb7ca req-6b8911f2-70ca-412d-aff1-2eab245d73a5 service nova] Acquiring lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG nova.network.neutron [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Updating instance_info_cache with network_info: [{"id": "7434f94a-713e-4434-9262-8da6a26d4006", "address": "fa:16:3e:d3:89:3a", "network": {"id": "6f6330e7-ef7b-4457-a97b-798bb8365964", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-523904489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7434f94a-71", "ovs_interfaceid": "7434f94a-713e-4434-9262-8da6a26d4006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ca932f4-4d4e-4481-970f-161340d7bccc", "address": "fa:16:3e:e5:c0:c9", "network": {"id": "7e642d05-f3e4-4a5e-b251-eb51e2525ef9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870506038", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca932f4-4d", "ovs_interfaceid": "8ca932f4-4d4e-4481-970f-161340d7bccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Releasing lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6f1e1950-fcd5-4838-bfd0-d258cb6cb7ca req-6b8911f2-70ca-412d-aff1-2eab245d73a5 service nova] Acquired lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG nova.network.neutron [req-6f1e1950-fcd5-4838-bfd0-d258cb6cb7ca req-6b8911f2-70ca-412d-aff1-2eab245d73a5 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Refreshing network info cache for port 8ca932f4-4d4e-4481-970f-161340d7bccc {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1956055295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1956055295',id=7,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxrQckQxr69xMzJYNTLEjM/WTe1wsExTJezKCnbJ7jnYlT8mZTga0YewAJ2OnZA6lwf50l3CWjDefeId4ykNOk9L89xqNa/3p6b4bQjrJI1+UpsUWudVowdG28U6uyqAA==',key_name='tempest-keypair-347748516',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='061cfdc41fc64eea9bd281d8c51424c8',ramdisk_id='',reservation_id='r-qbp9xyqq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2126535582',owner_user_name='tempest-TaggedAttachmentsTest-2126535582-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59c1bf383d2a48449244708dea3cd95b',uuid=aeae0fe6-ffc2-48f7-8b59-c6485851be3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ca932f4-4d4e-4481-970f-161340d7bccc", "address": "fa:16:3e:e5:c0:c9", "network": {"id": "7e642d05-f3e4-4a5e-b251-eb51e2525ef9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870506038", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca932f4-4d", "ovs_interfaceid": "8ca932f4-4d4e-4481-970f-161340d7bccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Converting VIF {"id": "8ca932f4-4d4e-4481-970f-161340d7bccc", "address": "fa:16:3e:e5:c0:c9", "network": {"id": "7e642d05-f3e4-4a5e-b251-eb51e2525ef9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870506038", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca932f4-4d", "ovs_interfaceid": "8ca932f4-4d4e-4481-970f-161340d7bccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c0:c9,bridge_name='br-int',has_traffic_filtering=True,id=8ca932f4-4d4e-4481-970f-161340d7bccc,network=Network(7e642d05-f3e4-4a5e-b251-eb51e2525ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca932f4-4d') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG os_vif [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c0:c9,bridge_name='br-int',has_traffic_filtering=True,id=8ca932f4-4d4e-4481-970f-161340d7bccc,network=Network(7e642d05-f3e4-4a5e-b251-eb51e2525ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca932f4-4d') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3da0acf2-c25c-504c-a246-8e365baffcae', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ca932f4-4d, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ca932f4-4d, col_values=(('qos', UUID('6f22d50d-567d-4e08-8cc5-21e7ee61f975')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ca932f4-4d, col_values=(('external_ids', {'iface-id': '8ca932f4-4d4e-4481-970f-161340d7bccc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:c0:c9', 'vm-uuid': 'aeae0fe6-ffc2-48f7-8b59-c6485851be3d'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:33 user nova-compute[74980]: INFO os_vif [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c0:c9,bridge_name='br-int',has_traffic_filtering=True,id=8ca932f4-4d4e-4481-970f-161340d7bccc,network=Network(7e642d05-f3e4-4a5e-b251-eb51e2525ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca932f4-4d')
Nov 02 17:19:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1956055295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1956055295',id=7,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxrQckQxr69xMzJYNTLEjM/WTe1wsExTJezKCnbJ7jnYlT8mZTga0YewAJ2OnZA6lwf50l3CWjDefeId4ykNOk9L89xqNa/3p6b4bQjrJI1+UpsUWudVowdG28U6uyqAA==',key_name='tempest-keypair-347748516',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='061cfdc41fc64eea9bd281d8c51424c8',ramdisk_id='',reservation_id='r-qbp9xyqq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2126535582',owner_user_name='tempest-TaggedAttachmentsTest-2126535582-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59c1bf383d2a48449244708dea3cd95b',uuid=aeae0fe6-ffc2-48f7-8b59-c6485851be3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ca932f4-4d4e-4481-970f-161340d7bccc", "address": "fa:16:3e:e5:c0:c9", "network": {"id": "7e642d05-f3e4-4a5e-b251-eb51e2525ef9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870506038", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca932f4-4d", "ovs_interfaceid": "8ca932f4-4d4e-4481-970f-161340d7bccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Converting VIF {"id": "8ca932f4-4d4e-4481-970f-161340d7bccc", "address": "fa:16:3e:e5:c0:c9", "network": {"id": "7e642d05-f3e4-4a5e-b251-eb51e2525ef9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870506038", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca932f4-4d", "ovs_interfaceid": "8ca932f4-4d4e-4481-970f-161340d7bccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c0:c9,bridge_name='br-int',has_traffic_filtering=True,id=8ca932f4-4d4e-4481-970f-161340d7bccc,network=Network(7e642d05-f3e4-4a5e-b251-eb51e2525ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca932f4-4d') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] attach device xml: <interface type="ethernet">
Nov 02 17:19:33 user nova-compute[74980]:   <mac address="fa:16:3e:e5:c0:c9"/>
Nov 02 17:19:33 user nova-compute[74980]:   <model type="virtio"/>
Nov 02 17:19:33 user nova-compute[74980]:   <mtu size="1442"/>
Nov 02 17:19:33 user nova-compute[74980]:   <target dev="tap8ca932f4-4d"/>
Nov 02 17:19:33 user nova-compute[74980]: </interface>
Nov 02 17:19:33 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-e939a820-f878-45ed-b272-514f4069030a req-63278d51-49f7-4031-a386-ecdf43534b05 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received event network-vif-plugged-8ca932f4-4d4e-4481-970f-161340d7bccc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e939a820-f878-45ed-b272-514f4069030a req-63278d51-49f7-4031-a386-ecdf43534b05 service nova] Acquiring lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e939a820-f878-45ed-b272-514f4069030a req-63278d51-49f7-4031-a386-ecdf43534b05 service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e939a820-f878-45ed-b272-514f4069030a req-63278d51-49f7-4031-a386-ecdf43534b05 service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-e939a820-f878-45ed-b272-514f4069030a req-63278d51-49f7-4031-a386-ecdf43534b05 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] No waiting events found dispatching network-vif-plugged-8ca932f4-4d4e-4481-970f-161340d7bccc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:19:33 user nova-compute[74980]: WARNING nova.compute.manager [req-e939a820-f878-45ed-b272-514f4069030a req-63278d51-49f7-4031-a386-ecdf43534b05 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received unexpected event network-vif-plugged-8ca932f4-4d4e-4481-970f-161340d7bccc for instance with vm_state active and task_state None.
Nov 02 17:19:34 user nova-compute[74980]: DEBUG nova.network.neutron [req-6f1e1950-fcd5-4838-bfd0-d258cb6cb7ca req-6b8911f2-70ca-412d-aff1-2eab245d73a5 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Updated VIF entry in instance network info cache for port 8ca932f4-4d4e-4481-970f-161340d7bccc. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG nova.network.neutron [req-6f1e1950-fcd5-4838-bfd0-d258cb6cb7ca req-6b8911f2-70ca-412d-aff1-2eab245d73a5 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Updating instance_info_cache with network_info: [{"id": "7434f94a-713e-4434-9262-8da6a26d4006", "address": "fa:16:3e:d3:89:3a", "network": {"id": "6f6330e7-ef7b-4457-a97b-798bb8365964", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-523904489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7434f94a-71", "ovs_interfaceid": "7434f94a-713e-4434-9262-8da6a26d4006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ca932f4-4d4e-4481-970f-161340d7bccc", "address": "fa:16:3e:e5:c0:c9", "network": {"id": "7e642d05-f3e4-4a5e-b251-eb51e2525ef9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870506038", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca932f4-4d", "ovs_interfaceid": "8ca932f4-4d4e-4481-970f-161340d7bccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] No BDM found with device name hda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] No VIF found with MAC fa:16:3e:d3:89:3a, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6f1e1950-fcd5-4838-bfd0-d258cb6cb7ca req-6b8911f2-70ca-412d-aff1-2eab245d73a5 service nova] Releasing lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:19:34 user nova-compute[74980]:   <nova:package version="0.0.0"/>
Nov 02 17:19:34 user nova-compute[74980]:   <nova:name>tempest-device-tagging-server-1956055295</nova:name>
Nov 02 17:19:34 user nova-compute[74980]:   <nova:creationTime>2023-11-02 17:19:34</nova:creationTime>
Nov 02 17:19:34 user nova-compute[74980]:   <nova:flavor name="m1.tiny">
Nov 02 17:19:34 user nova-compute[74980]:     <nova:memory>512</nova:memory>
Nov 02 17:19:34 user nova-compute[74980]:     <nova:disk>1</nova:disk>
Nov 02 17:19:34 user nova-compute[74980]:     <nova:swap>0</nova:swap>
Nov 02 17:19:34 user nova-compute[74980]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:19:34 user nova-compute[74980]:     <nova:vcpus>1</nova:vcpus>
Nov 02 17:19:34 user nova-compute[74980]:   </nova:flavor>
Nov 02 17:19:34 user nova-compute[74980]:   <nova:owner>
Nov 02 17:19:34 user nova-compute[74980]:     <nova:user uuid="59c1bf383d2a48449244708dea3cd95b">tempest-TaggedAttachmentsTest-2126535582-project-member</nova:user>
Nov 02 17:19:34 user nova-compute[74980]:     <nova:project uuid="061cfdc41fc64eea9bd281d8c51424c8">tempest-TaggedAttachmentsTest-2126535582</nova:project>
Nov 02 17:19:34 user nova-compute[74980]:   </nova:owner>
Nov 02 17:19:34 user nova-compute[74980]:   <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:19:34 user nova-compute[74980]:   <nova:ports>
Nov 02 17:19:34 user nova-compute[74980]:     <nova:port uuid="7434f94a-713e-4434-9262-8da6a26d4006">
Nov 02 17:19:34 user nova-compute[74980]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 17:19:34 user nova-compute[74980]:     </nova:port>
Nov 02 17:19:34 user nova-compute[74980]:     <nova:port uuid="8ca932f4-4d4e-4481-970f-161340d7bccc">
Nov 02 17:19:34 user nova-compute[74980]:       <nova:ip type="fixed" address="10.10.10.199" ipVersion="4"/>
Nov 02 17:19:34 user nova-compute[74980]:     </nova:port>
Nov 02 17:19:34 user nova-compute[74980]:   </nova:ports>
Nov 02 17:19:34 user nova-compute[74980]: </nova:instance>
Nov 02 17:19:34 user nova-compute[74980]:  {{(pid=74980) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-81f6b0f6-5dfb-47c2-9d9d-fe3b26fd334b tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "interface-aeae0fe6-ffc2-48f7-8b59-c6485851be3d-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.355s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG nova.objects.instance [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lazy-loading 'flavor' on Instance uuid aeae0fe6-ffc2-48f7-8b59-c6485851be3d {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:34 user nova-compute[74980]: INFO nova.compute.manager [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Attaching volume fb464298-7fb9-4fd5-b384-0b42e5d31bea to /dev/vdb
Nov 02 17:19:35 user nova-compute[74980]: DEBUG os_brick.utils [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d59d0c-00fb-47c2-bf83-7a67a37b5534]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9970f31a-8531-44ec-835e-5399fec04b59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cabcf14-70d9-4ff4-8176-77ebc364b178]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8a30ed-f827-42f4-b82d-54a18f4f2d02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:35 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:19:35 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[217a0bc2-5951-4703-aa1b-9ad3977fa1cc]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG os_brick.utils [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:19:35 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Updating existing volume attachment record: 675af9b7-8b8a-4283-be7e-d027ed50e90a {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:19:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-2981c3de-dfdf-4f3f-99af-5bac7b2a4d3b req-96e35dea-6595-446f-8fea-29575a50cb5d service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received event network-vif-plugged-8ca932f4-4d4e-4481-970f-161340d7bccc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2981c3de-dfdf-4f3f-99af-5bac7b2a4d3b req-96e35dea-6595-446f-8fea-29575a50cb5d service nova] Acquiring lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2981c3de-dfdf-4f3f-99af-5bac7b2a4d3b req-96e35dea-6595-446f-8fea-29575a50cb5d service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2981c3de-dfdf-4f3f-99af-5bac7b2a4d3b req-96e35dea-6595-446f-8fea-29575a50cb5d service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-2981c3de-dfdf-4f3f-99af-5bac7b2a4d3b req-96e35dea-6595-446f-8fea-29575a50cb5d service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] No waiting events found dispatching network-vif-plugged-8ca932f4-4d4e-4481-970f-161340d7bccc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:19:36 user nova-compute[74980]: WARNING nova.compute.manager [req-2981c3de-dfdf-4f3f-99af-5bac7b2a4d3b req-96e35dea-6595-446f-8fea-29575a50cb5d service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received unexpected event network-vif-plugged-8ca932f4-4d4e-4481-970f-161340d7bccc for instance with vm_state active and task_state None.
Nov 02 17:19:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "805deaa2-b2ca-4d1c-9580-317b0548282b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "805deaa2-b2ca-4d1c-9580-317b0548282b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:36 user nova-compute[74980]: DEBUG nova.compute.manager [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:19:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:36 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:19:36 user nova-compute[74980]: INFO nova.compute.claims [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Claim successful on node user
Nov 02 17:19:36 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:19:36 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:19:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:36 user nova-compute[74980]: DEBUG nova.compute.manager [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG nova.network.neutron [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:19:37 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:19:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG nova.policy [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a979e164900348beaab104704c92b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889d98476584bb1b18080bfa0664810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:19:37 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Creating image(s)
Nov 02 17:19:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "/opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "/opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "/opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.183s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk 1073741824" returned: 0 in 0.055s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG nova.network.neutron [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Successfully created port: 1ef68686-5086-4b8c-9bca-411d492a7102 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.195s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:19:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Cannot resize image /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Ensure instance console log exists: /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.network.neutron [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Successfully updated port: 1ef68686-5086-4b8c-9bca-411d492a7102 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "refresh_cache-805deaa2-b2ca-4d1c-9580-317b0548282b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquired lock "refresh_cache-805deaa2-b2ca-4d1c-9580-317b0548282b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.network.neutron [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.compute.manager [req-9a3a8593-ee28-45b6-a023-d5dcaea87c20 req-4b59634a-b2db-4dc2-a2fc-5eeb9906ceac service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Received event network-changed-1ef68686-5086-4b8c-9bca-411d492a7102 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.compute.manager [req-9a3a8593-ee28-45b6-a023-d5dcaea87c20 req-4b59634a-b2db-4dc2-a2fc-5eeb9906ceac service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Refreshing instance network info cache due to event network-changed-1ef68686-5086-4b8c-9bca-411d492a7102. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9a3a8593-ee28-45b6-a023-d5dcaea87c20 req-4b59634a-b2db-4dc2-a2fc-5eeb9906ceac service nova] Acquiring lock "refresh_cache-805deaa2-b2ca-4d1c-9580-317b0548282b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.network.neutron [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.network.neutron [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Updating instance_info_cache with network_info: [{"id": "1ef68686-5086-4b8c-9bca-411d492a7102", "address": "fa:16:3e:1a:34:61", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef68686-50", "ovs_interfaceid": "1ef68686-5086-4b8c-9bca-411d492a7102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Releasing lock "refresh_cache-805deaa2-b2ca-4d1c-9580-317b0548282b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.compute.manager [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Instance network_info: |[{"id": "1ef68686-5086-4b8c-9bca-411d492a7102", "address": "fa:16:3e:1a:34:61", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef68686-50", "ovs_interfaceid": "1ef68686-5086-4b8c-9bca-411d492a7102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9a3a8593-ee28-45b6-a023-d5dcaea87c20 req-4b59634a-b2db-4dc2-a2fc-5eeb9906ceac service nova] Acquired lock "refresh_cache-805deaa2-b2ca-4d1c-9580-317b0548282b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.network.neutron [req-9a3a8593-ee28-45b6-a023-d5dcaea87c20 req-4b59634a-b2db-4dc2-a2fc-5eeb9906ceac service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Refreshing network info cache for port 1ef68686-5086-4b8c-9bca-411d492a7102 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Start _get_guest_xml network_info=[{"id": "1ef68686-5086-4b8c-9bca-411d492a7102", "address": "fa:16:3e:1a:34:61", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef68686-50", "ovs_interfaceid": "1ef68686-5086-4b8c-9bca-411d492a7102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:19:38 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:19:38 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:19:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1693906051',display_name='tempest-AttachVolumeNegativeTest-server-1693906051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1693906051',id=13,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvRSnYz3tCCLQkcyrcK+R9mvY8XK19GscNsiSrR3fu7/WL3qnP/8rbrd3/C8Tsg4G1mslUeW+09VBrPp9fyY9sKKw3KgQadnCjWmLyqZIjC6BH11FB5dLaRNrTAcPMkKw==',key_name='tempest-keypair-1030283866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b889d98476584bb1b18080bfa0664810',ramdisk_id='',reservation_id='r-ghngjw4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1956142060',owner_user_name='tempest-AttachVolumeNegativeTest-1956142060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a979e164900348beaab104704c92b722',uuid=805deaa2-b2ca-4d1c-9580-317b0548282b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ef68686-5086-4b8c-9bca-411d492a7102", "address": "fa:16:3e:1a:34:61", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef68686-50", "ovs_interfaceid": "1ef68686-5086-4b8c-9bca-411d492a7102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converting VIF {"id": "1ef68686-5086-4b8c-9bca-411d492a7102", "address": "fa:16:3e:1a:34:61", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef68686-50", "ovs_interfaceid": "1ef68686-5086-4b8c-9bca-411d492a7102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:34:61,bridge_name='br-int',has_traffic_filtering=True,id=1ef68686-5086-4b8c-9bca-411d492a7102,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef68686-50') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.objects.instance [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'pci_devices' on Instance uuid 805deaa2-b2ca-4d1c-9580-317b0548282b {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:19:38 user nova-compute[74980]:   <uuid>805deaa2-b2ca-4d1c-9580-317b0548282b</uuid>
Nov 02 17:19:38 user nova-compute[74980]:   <name>instance-0000000d</name>
Nov 02 17:19:38 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:19:38 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:19:38 user nova-compute[74980]:   <metadata>
Nov 02 17:19:38 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:19:38 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:19:38 user nova-compute[74980]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1693906051</nova:name>
Nov 02 17:19:38 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:19:38</nova:creationTime>
Nov 02 17:19:38 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:19:38 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:19:38 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:19:38 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:19:38 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:19:38 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:19:38 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:19:38 user nova-compute[74980]:       <nova:owner>
Nov 02 17:19:38 user nova-compute[74980]:         <nova:user uuid="a979e164900348beaab104704c92b722">tempest-AttachVolumeNegativeTest-1956142060-project-member</nova:user>
Nov 02 17:19:38 user nova-compute[74980]:         <nova:project uuid="b889d98476584bb1b18080bfa0664810">tempest-AttachVolumeNegativeTest-1956142060</nova:project>
Nov 02 17:19:38 user nova-compute[74980]:       </nova:owner>
Nov 02 17:19:38 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:19:38 user nova-compute[74980]:       <nova:ports>
Nov 02 17:19:38 user nova-compute[74980]:         <nova:port uuid="1ef68686-5086-4b8c-9bca-411d492a7102">
Nov 02 17:19:38 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 17:19:38 user nova-compute[74980]:         </nova:port>
Nov 02 17:19:38 user nova-compute[74980]:       </nova:ports>
Nov 02 17:19:38 user nova-compute[74980]:     </nova:instance>
Nov 02 17:19:38 user nova-compute[74980]:   </metadata>
Nov 02 17:19:38 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:19:38 user nova-compute[74980]:     <system>
Nov 02 17:19:38 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:19:38 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:19:38 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:19:38 user nova-compute[74980]:       <entry name="serial">805deaa2-b2ca-4d1c-9580-317b0548282b</entry>
Nov 02 17:19:38 user nova-compute[74980]:       <entry name="uuid">805deaa2-b2ca-4d1c-9580-317b0548282b</entry>
Nov 02 17:19:38 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:19:38 user nova-compute[74980]:     </system>
Nov 02 17:19:38 user nova-compute[74980]:   </sysinfo>
Nov 02 17:19:38 user nova-compute[74980]:   <os>
Nov 02 17:19:38 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:19:38 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:19:38 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:19:38 user nova-compute[74980]:   </os>
Nov 02 17:19:38 user nova-compute[74980]:   <features>
Nov 02 17:19:38 user nova-compute[74980]:     <acpi/>
Nov 02 17:19:38 user nova-compute[74980]:     <apic/>
Nov 02 17:19:38 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:19:38 user nova-compute[74980]:   </features>
Nov 02 17:19:38 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:19:38 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:19:38 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:19:38 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:19:38 user nova-compute[74980]:   </clock>
Nov 02 17:19:38 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:19:38 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:19:38 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:19:38 user nova-compute[74980]:   </cpu>
Nov 02 17:19:38 user nova-compute[74980]:   <devices>
Nov 02 17:19:38 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:19:38 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:19:38 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk"/>
Nov 02 17:19:38 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:19:38 user nova-compute[74980]:     </disk>
Nov 02 17:19:38 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:19:38 user nova-compute[74980]:       <mac address="fa:16:3e:1a:34:61"/>
Nov 02 17:19:38 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:19:38 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:19:38 user nova-compute[74980]:       <target dev="tap1ef68686-50"/>
Nov 02 17:19:38 user nova-compute[74980]:     </interface>
Nov 02 17:19:38 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:19:38 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/console.log" append="off"/>
Nov 02 17:19:38 user nova-compute[74980]:     </serial>
Nov 02 17:19:38 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:19:38 user nova-compute[74980]:     <video>
Nov 02 17:19:38 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:19:38 user nova-compute[74980]:     </video>
Nov 02 17:19:38 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:19:38 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:19:38 user nova-compute[74980]:     </rng>
Nov 02 17:19:38 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:19:38 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:19:38 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:19:38 user nova-compute[74980]:     </memballoon>
Nov 02 17:19:38 user nova-compute[74980]:   </devices>
Nov 02 17:19:38 user nova-compute[74980]: </domain>
Nov 02 17:19:38 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:19:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1693906051',display_name='tempest-AttachVolumeNegativeTest-server-1693906051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1693906051',id=13,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvRSnYz3tCCLQkcyrcK+R9mvY8XK19GscNsiSrR3fu7/WL3qnP/8rbrd3/C8Tsg4G1mslUeW+09VBrPp9fyY9sKKw3KgQadnCjWmLyqZIjC6BH11FB5dLaRNrTAcPMkKw==',key_name='tempest-keypair-1030283866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b889d98476584bb1b18080bfa0664810',ramdisk_id='',reservation_id='r-ghngjw4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1956142060',owner_user_name='tempest-AttachVolumeNegativeTest-1956142060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a979e164900348beaab104704c92b722',uuid=805deaa2-b2ca-4d1c-9580-317b0548282b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ef68686-5086-4b8c-9bca-411d492a7102", "address": "fa:16:3e:1a:34:61", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef68686-50", "ovs_interfaceid": "1ef68686-5086-4b8c-9bca-411d492a7102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converting VIF {"id": "1ef68686-5086-4b8c-9bca-411d492a7102", "address": "fa:16:3e:1a:34:61", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef68686-50", "ovs_interfaceid": "1ef68686-5086-4b8c-9bca-411d492a7102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:34:61,bridge_name='br-int',has_traffic_filtering=True,id=1ef68686-5086-4b8c-9bca-411d492a7102,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef68686-50') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG os_vif [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:34:61,bridge_name='br-int',has_traffic_filtering=True,id=1ef68686-5086-4b8c-9bca-411d492a7102,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef68686-50') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fca521d7-26d0-5bfd-a0f6-b8d88ecbbd98', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ef68686-50, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ef68686-50, col_values=(('qos', UUID('33d86529-9f88-4d35-bd24-8b8d10b6adf6')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ef68686-50, col_values=(('external_ids', {'iface-id': '1ef68686-5086-4b8c-9bca-411d492a7102', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:34:61', 'vm-uuid': '805deaa2-b2ca-4d1c-9580-317b0548282b'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:38 user nova-compute[74980]: INFO os_vif [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:34:61,bridge_name='br-int',has_traffic_filtering=True,id=1ef68686-5086-4b8c-9bca-411d492a7102,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef68686-50')
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:19:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No VIF found with MAC fa:16:3e:1a:34:61, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:19:39 user nova-compute[74980]: DEBUG nova.network.neutron [req-9a3a8593-ee28-45b6-a023-d5dcaea87c20 req-4b59634a-b2db-4dc2-a2fc-5eeb9906ceac service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Updated VIF entry in instance network info cache for port 1ef68686-5086-4b8c-9bca-411d492a7102. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:19:39 user nova-compute[74980]: DEBUG nova.network.neutron [req-9a3a8593-ee28-45b6-a023-d5dcaea87c20 req-4b59634a-b2db-4dc2-a2fc-5eeb9906ceac service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Updating instance_info_cache with network_info: [{"id": "1ef68686-5086-4b8c-9bca-411d492a7102", "address": "fa:16:3e:1a:34:61", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef68686-50", "ovs_interfaceid": "1ef68686-5086-4b8c-9bca-411d492a7102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9a3a8593-ee28-45b6-a023-d5dcaea87c20 req-4b59634a-b2db-4dc2-a2fc-5eeb9906ceac service nova] Releasing lock "refresh_cache-805deaa2-b2ca-4d1c-9580-317b0548282b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:39 user nova-compute[74980]: DEBUG nova.compute.manager [req-3dbff2f2-6e14-425a-ae2b-24f10d2fcdb4 req-092e3c2a-1c53-40df-a4d6-96f3ece0085c service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Received event network-changed-7acd4ed3-a111-48a7-9ddd-4da7246f5d28 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:39 user nova-compute[74980]: DEBUG nova.compute.manager [req-3dbff2f2-6e14-425a-ae2b-24f10d2fcdb4 req-092e3c2a-1c53-40df-a4d6-96f3ece0085c service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Refreshing instance network info cache due to event network-changed-7acd4ed3-a111-48a7-9ddd-4da7246f5d28. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:19:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3dbff2f2-6e14-425a-ae2b-24f10d2fcdb4 req-092e3c2a-1c53-40df-a4d6-96f3ece0085c service nova] Acquiring lock "refresh_cache-8f08eaa2-92d1-4081-9bc7-fe3e7123e831" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:19:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3dbff2f2-6e14-425a-ae2b-24f10d2fcdb4 req-092e3c2a-1c53-40df-a4d6-96f3ece0085c service nova] Acquired lock "refresh_cache-8f08eaa2-92d1-4081-9bc7-fe3e7123e831" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:19:39 user nova-compute[74980]: DEBUG nova.network.neutron [req-3dbff2f2-6e14-425a-ae2b-24f10d2fcdb4 req-092e3c2a-1c53-40df-a4d6-96f3ece0085c service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Refreshing network info cache for port 7acd4ed3-a111-48a7-9ddd-4da7246f5d28 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:19:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:40 user nova-compute[74980]: DEBUG nova.compute.manager [req-a9055215-e1ce-4bc6-90de-e931b82f506e req-8a31aecd-df88-4375-bb92-483f822f2185 service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Received event network-vif-plugged-1ef68686-5086-4b8c-9bca-411d492a7102 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a9055215-e1ce-4bc6-90de-e931b82f506e req-8a31aecd-df88-4375-bb92-483f822f2185 service nova] Acquiring lock "805deaa2-b2ca-4d1c-9580-317b0548282b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a9055215-e1ce-4bc6-90de-e931b82f506e req-8a31aecd-df88-4375-bb92-483f822f2185 service nova] Lock "805deaa2-b2ca-4d1c-9580-317b0548282b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a9055215-e1ce-4bc6-90de-e931b82f506e req-8a31aecd-df88-4375-bb92-483f822f2185 service nova] Lock "805deaa2-b2ca-4d1c-9580-317b0548282b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:40 user nova-compute[74980]: DEBUG nova.compute.manager [req-a9055215-e1ce-4bc6-90de-e931b82f506e req-8a31aecd-df88-4375-bb92-483f822f2185 service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] No waiting events found dispatching network-vif-plugged-1ef68686-5086-4b8c-9bca-411d492a7102 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:19:40 user nova-compute[74980]: WARNING nova.compute.manager [req-a9055215-e1ce-4bc6-90de-e931b82f506e req-8a31aecd-df88-4375-bb92-483f822f2185 service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Received unexpected event network-vif-plugged-1ef68686-5086-4b8c-9bca-411d492a7102 for instance with vm_state building and task_state spawning.
Nov 02 17:19:40 user nova-compute[74980]: DEBUG nova.network.neutron [req-3dbff2f2-6e14-425a-ae2b-24f10d2fcdb4 req-092e3c2a-1c53-40df-a4d6-96f3ece0085c service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Updated VIF entry in instance network info cache for port 7acd4ed3-a111-48a7-9ddd-4da7246f5d28. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:19:40 user nova-compute[74980]: DEBUG nova.network.neutron [req-3dbff2f2-6e14-425a-ae2b-24f10d2fcdb4 req-092e3c2a-1c53-40df-a4d6-96f3ece0085c service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Updating instance_info_cache with network_info: [{"id": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "address": "fa:16:3e:a3:43:90", "network": {"id": "4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-496537762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64f1fee6570a42bd9ec5f9899e7618f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7acd4ed3-a1", "ovs_interfaceid": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:19:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3dbff2f2-6e14-425a-ae2b-24f10d2fcdb4 req-092e3c2a-1c53-40df-a4d6-96f3ece0085c service nova] Releasing lock "refresh_cache-8f08eaa2-92d1-4081-9bc7-fe3e7123e831" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:19:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:19:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:19:42 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Instance spawned successfully.
Nov 02 17:19:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:19:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:19:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:19:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:19:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:19:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:19:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:19:42 user nova-compute[74980]: INFO nova.compute.manager [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 02 17:19:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:19:42 user nova-compute[74980]: INFO nova.compute.manager [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Took 6.21 seconds to build instance.
Nov 02 17:19:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-42877487-d0f2-492c-965b-a36413a30302 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "805deaa2-b2ca-4d1c-9580-317b0548282b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.301s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-78590ea6-842b-4a3e-91d9-28a410e0d199 req-4a72382e-d3da-47bb-b4ce-fce1ef206493 service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Received event network-vif-plugged-1ef68686-5086-4b8c-9bca-411d492a7102 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-78590ea6-842b-4a3e-91d9-28a410e0d199 req-4a72382e-d3da-47bb-b4ce-fce1ef206493 service nova] Acquiring lock "805deaa2-b2ca-4d1c-9580-317b0548282b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-78590ea6-842b-4a3e-91d9-28a410e0d199 req-4a72382e-d3da-47bb-b4ce-fce1ef206493 service nova] Lock "805deaa2-b2ca-4d1c-9580-317b0548282b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-78590ea6-842b-4a3e-91d9-28a410e0d199 req-4a72382e-d3da-47bb-b4ce-fce1ef206493 service nova] Lock "805deaa2-b2ca-4d1c-9580-317b0548282b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-78590ea6-842b-4a3e-91d9-28a410e0d199 req-4a72382e-d3da-47bb-b4ce-fce1ef206493 service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] No waiting events found dispatching network-vif-plugged-1ef68686-5086-4b8c-9bca-411d492a7102 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:19:42 user nova-compute[74980]: WARNING nova.compute.manager [req-78590ea6-842b-4a3e-91d9-28a410e0d199 req-4a72382e-d3da-47bb-b4ce-fce1ef206493 service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Received unexpected event network-vif-plugged-1ef68686-5086-4b8c-9bca-411d492a7102 for instance with vm_state active and task_state None.
Nov 02 17:19:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Acquiring lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG nova.objects.instance [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Lazy-loading 'flavor' on Instance uuid 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:19:53 user nova-compute[74980]: INFO nova.virt.block_device [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Booting with volume abd5d6d7-4e08-4099-8ff9-1eef798c4bfe at /dev/vdc
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "9ef84810-0506-4439-9302-72b239c8dddd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "9ef84810-0506-4439-9302-72b239c8dddd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG nova.objects.instance [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lazy-loading 'flavor' on Instance uuid 9ef84810-0506-4439-9302-72b239c8dddd {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG nova.objects.instance [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lazy-loading 'flavor' on Instance uuid 1154d1f9-80b8-405b-8fd8-c10bb39c507f {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG os_brick.utils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "9ef84810-0506-4439-9302-72b239c8dddd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.151s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceca48e-f2ea-42a3-a597-b4ce824be1b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df051a3-4bcf-4617-a107-a60b090fb0f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7fbf77-d569-4d99-af3e-13e06800049c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f65264-db4c-44bf-9ae8-5309fd253303]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:53 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[37131532-620b-44ca-a73c-121e1cf4e3b7]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG os_brick.utils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating existing volume attachment record: 6ad18c69-e6ef-4ff5-b21e-0433e70a4a13 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Acquiring lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:53 user nova-compute[74980]: INFO nova.compute.manager [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Attaching volume f0509f86-d65f-42ec-84dd-eef34fa25f11 to /dev/vdb
Nov 02 17:19:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "e9d8737b-e341-4c00-bb8c-6e1847d24418" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "e9d8737b-e341-4c00-bb8c-6e1847d24418" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:54 user nova-compute[74980]: INFO nova.compute.manager [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Shelving
Nov 02 17:19:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:55 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Instance destroyed successfully.
Nov 02 17:19:55 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Beginning cold snapshot process
Nov 02 17:19:56 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:19:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk /opt/stack/data/nova/instances/snapshots/tmpe826lwx7/59014ac72bcd4c05a67f5720a57b99a1 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-92ea40f6-1e90-43af-b69c-aa5ebb665eee req-07a48508-1681-4f64-8f60-21ce4390d67a service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Received event network-vif-unplugged-0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-92ea40f6-1e90-43af-b69c-aa5ebb665eee req-07a48508-1681-4f64-8f60-21ce4390d67a service nova] Acquiring lock "e9d8737b-e341-4c00-bb8c-6e1847d24418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-92ea40f6-1e90-43af-b69c-aa5ebb665eee req-07a48508-1681-4f64-8f60-21ce4390d67a service nova] Lock "e9d8737b-e341-4c00-bb8c-6e1847d24418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-92ea40f6-1e90-43af-b69c-aa5ebb665eee req-07a48508-1681-4f64-8f60-21ce4390d67a service nova] Lock "e9d8737b-e341-4c00-bb8c-6e1847d24418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-92ea40f6-1e90-43af-b69c-aa5ebb665eee req-07a48508-1681-4f64-8f60-21ce4390d67a service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] No waiting events found dispatching network-vif-unplugged-0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:19:56 user nova-compute[74980]: WARNING nova.compute.manager [req-92ea40f6-1e90-43af-b69c-aa5ebb665eee req-07a48508-1681-4f64-8f60-21ce4390d67a service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Received unexpected event network-vif-unplugged-0864571c-261a-43f1-a1ec-0c481e22f430 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 02 17:19:57 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqeyibTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:19:57 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:19:57 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:19:57 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5bfeea-e7ea-4b8d-b06e-61a779cf243f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:19:57 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a0faa4-dcb6-400f-84f9-3c6e9af6cadd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea] added
Nov 02 17:19:57 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418/disk /opt/stack/data/nova/instances/snapshots/tmpe826lwx7/59014ac72bcd4c05a67f5720a57b99a1" returned: 0 in 1.316s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:57 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Snapshot extracted, beginning image upload
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[44376f9e-4b82-46d7-b682-4e42be48a1b9]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b8e3db-16ad-451d-9bed-3b9c47f55c4a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OqeyibTj {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OqeyibTj" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9bb3f1-b5a8-403b-ab9d-5b9512ab850b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OqeyibTj'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6bfc75-5d26-4491-b4df-e14cd807fbe2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcd90df-4800-4dc3-9e9e-29bd871bfde8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:19:57 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:19:57 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:19:57 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:19:57 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[96296db2-49eb-4ecf-9046-b19db1811f4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea, portal: 172.16.0.220,3260]
Nov 02 17:19:57 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea, portal: 172.16.0.220,3260] successful.
Nov 02 17:19:57 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cedf21-b717-4b29-b4e4-ac0cf65a773e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[365ebe06-6348-400b-8eac-7ac05c1b8196]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:19:57 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:19:57 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:19:57 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:19:57 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:19:57 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:19:57 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf3a627-a8e5-4eb2-8745-41f854c2087b]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqeyibTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:19:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "9ef84810-0506-4439-9302-72b239c8dddd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "9ef84810-0506-4439-9302-72b239c8dddd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:58 user nova-compute[74980]: INFO nova.compute.manager [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Attaching volume 7d3d65b1-96f4-4e4f-9d86-c2a0d967493f to /dev/sdc
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:58 user nova-compute[74980]: INFO nova.compute.manager [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Attaching volume fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e to /dev/vdb
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.utils [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e2bf2e-50c3-43fb-85c0-a3b297c2bbbc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.utils [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[609197d0-1c61-4c51-a012-30527c4fa1f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: INFO nova.virt.block_device [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Booting with volume 793aeaca-6c72-4a4e-9f0d-0a1161962175 at /dev/vdc
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.utils [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea932640-b0b9-4dc9-957c-787c6c747d5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.101s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9bae59-acfd-4309-b97a-18d4c123d419]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.059s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00262e2-e93b-4e7b-8a45-81af27e87e64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deba055-1974-440a-b392-22945fd3e819]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93816a0-98f8-42c7-9539-6c3c8d778d3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78a15db-8c5d-4000-8e0c-461d98cf198c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[899f878f-daa8-4057-a0ce-92ee7288b5ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.utils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e717756-cc07-4396-9083-892cb3f2a04a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8403b1b-18fc-45be-b20e-df548c0f866e]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[275e9e46-90bd-4289-8e88-cb7f13eb3e3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0d3b7d-3eb9-427c-9da5-6bb34d80fd7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.utils [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] <== get_connector_properties: return (281ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Updating existing volume attachment record: 0707e7e1-b54b-44a6-b8ed-3f64bf5a4960 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a144af-853f-4db2-80c8-ee0a0bfee732]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:58 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fde76e-290e-4d4d-b3b6-d0a3acdea4cb]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a234259a-ee12-4eb8-9780-bcba1637f8a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.utils [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] <== get_connector_properties: return (312ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Updating existing volume attachment record: 4a1d24d0-932b-473e-b67f-ef36b2c28ecf {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23964663433383638', 'path': '/dev/sdd'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964663433383638', 'path': '/dev/sdd'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-5a1e58c4-1090-462e-8907-a68744405075 req-b4b88f13-5d93-483c-a151-4b48f4b25165 service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Received event network-vif-plugged-0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5a1e58c4-1090-462e-8907-a68744405075 req-b4b88f13-5d93-483c-a151-4b48f4b25165 service nova] Acquiring lock "e9d8737b-e341-4c00-bb8c-6e1847d24418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5a1e58c4-1090-462e-8907-a68744405075 req-b4b88f13-5d93-483c-a151-4b48f4b25165 service nova] Lock "e9d8737b-e341-4c00-bb8c-6e1847d24418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5a1e58c4-1090-462e-8907-a68744405075 req-b4b88f13-5d93-483c-a151-4b48f4b25165 service nova] Lock "e9d8737b-e341-4c00-bb8c-6e1847d24418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-5a1e58c4-1090-462e-8907-a68744405075 req-b4b88f13-5d93-483c-a151-4b48f4b25165 service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] No waiting events found dispatching network-vif-plugged-0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:19:58 user nova-compute[74980]: WARNING nova.compute.manager [req-5a1e58c4-1090-462e-8907-a68744405075 req-b4b88f13-5d93-483c-a151-4b48f4b25165 service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Received unexpected event network-vif-plugged-0864571c-261a-43f1-a1ec-0c481e22f430 for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04adb7b-7776-4564-9f27-b80474f2a37c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7acb4f-a54a-404c-8b48-56ca70dd6617]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:58 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04b1457-8514-4dd1-adf9-d6acb821aeee]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.utils [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] <== get_connector_properties: return (339ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Updating existing volume attachment record: 91d2c43d-4e03-40ab-9733-7ff590dd2b59 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG nova.objects.instance [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lazy-loading 'flavor' on Instance uuid aeae0fe6-ffc2-48f7-8b59-c6485851be3d {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:19:58 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:19:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fde245-629a-4c1f-932f-cdfdc6433907]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG os_brick.utils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] <== get_connector_properties: return (258ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Updating existing volume attachment record: 6eb40347-9135-4c7d-99ad-db13ad92931f {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:19:58 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:19:58 user nova-compute[74980]:   <source dev="/dev/sdd"/>
Nov 02 17:19:58 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:19:58 user nova-compute[74980]:   <serial>fb464298-7fb9-4fd5-b384-0b42e5d31bea</serial>
Nov 02 17:19:58 user nova-compute[74980]: </disk>
Nov 02 17:19:58 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:19:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:19:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:19:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] No BDM found with device name hda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:19:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] No VIF found with MAC fa:16:3e:d3:89:3a, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:19:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:20:00 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Snapshot image upload complete
Nov 02 17:20:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:20:00 user nova-compute[74980]: INFO nova.compute.manager [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Shelve offloading
Nov 02 17:20:00 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Instance destroyed successfully.
Nov 02 17:20:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:20:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "refresh_cache-e9d8737b-e341-4c00-bb8c-6e1847d24418" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:20:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquired lock "refresh_cache-e9d8737b-e341-4c00-bb8c-6e1847d24418" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:20:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:20:00 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:20:00 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:20:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:20:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Updating instance_info_cache with network_info: [{"id": "0864571c-261a-43f1-a1ec-0c481e22f430", "address": "fa:16:3e:08:8e:66", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0864571c-26", "ovs_interfaceid": "0864571c-261a-43f1-a1ec-0c481e22f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:20:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Releasing lock "refresh_cache-e9d8737b-e341-4c00-bb8c-6e1847d24418" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:20:01 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Instance destroyed successfully.
Nov 02 17:20:01 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lazy-loading 'resources' on Instance uuid e9d8737b-e341-4c00-bb8c-6e1847d24418 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1400154423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1400154423',id=4,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEP4qQYJL6H6UKq6nH6AswOA1zi+zAJjZ+sS43goRLZGiDdVoXCQpJwUxjB41ygCvVugbyNvx0HHWG74gfXP/7htzc43wKdNJJ5GPfvY8Iv0gNOxFnxRbspNqN3E5KvnEQ==',key_name='tempest-keypair-1546098073',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ccb03b0bde444fbc82be742d0027c0ec',ramdisk_id='',reservation_id='r-c55pmg0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1991165793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1991165793-project-member',shelved_at='2023-11-02T17:20:00.188641',shelved_host='user',shelved_image_id='79511bf7-c365-4bc4-8c10-7983350be815'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:19:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1f92dd53761465592b6d5390090f59f',uuid=e9d8737b-e341-4c00-bb8c-6e1847d24418,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0864571c-261a-43f1-a1ec-0c481e22f430", "address": "fa:16:3e:08:8e:66", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0864571c-26", "ovs_interfaceid": "0864571c-261a-43f1-a1ec-0c481e22f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converting VIF {"id": "0864571c-261a-43f1-a1ec-0c481e22f430", "address": "fa:16:3e:08:8e:66", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0864571c-26", "ovs_interfaceid": "0864571c-261a-43f1-a1ec-0c481e22f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:8e:66,bridge_name='br-int',has_traffic_filtering=True,id=0864571c-261a-43f1-a1ec-0c481e22f430,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0864571c-26') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG os_vif [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:8e:66,bridge_name='br-int',has_traffic_filtering=True,id=0864571c-261a-43f1-a1ec-0c481e22f430,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0864571c-26') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0864571c-26, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG nova.compute.manager [req-7d40e09d-584f-4580-b642-addcfbb1b6be req-ba66250d-6692-4732-a124-7b49f8c7b71e service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Received event network-changed-0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG nova.compute.manager [req-7d40e09d-584f-4580-b642-addcfbb1b6be req-ba66250d-6692-4732-a124-7b49f8c7b71e service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Refreshing instance network info cache due to event network-changed-0864571c-261a-43f1-a1ec-0c481e22f430. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7d40e09d-584f-4580-b642-addcfbb1b6be req-ba66250d-6692-4732-a124-7b49f8c7b71e service nova] Acquiring lock "refresh_cache-e9d8737b-e341-4c00-bb8c-6e1847d24418" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7d40e09d-584f-4580-b642-addcfbb1b6be req-ba66250d-6692-4732-a124-7b49f8c7b71e service nova] Acquired lock "refresh_cache-e9d8737b-e341-4c00-bb8c-6e1847d24418" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG nova.network.neutron [req-7d40e09d-584f-4580-b642-addcfbb1b6be req-ba66250d-6692-4732-a124-7b49f8c7b71e service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Refreshing network info cache for port 0864571c-261a-43f1-a1ec-0c481e22f430 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e956cfea-7aa5-42f2-9af1-0596553fdb1f) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:01 user nova-compute[74980]: INFO os_vif [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:8e:66,bridge_name='br-int',has_traffic_filtering=True,id=0864571c-261a-43f1-a1ec-0c481e22f430,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0864571c-26')
Nov 02 17:20:01 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Deleting instance files /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418_del
Nov 02 17:20:01 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Deletion of /opt/stack/data/nova/instances/e9d8737b-e341-4c00-bb8c-6e1847d24418_del complete
Nov 02 17:20:01 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74980) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 02 17:20:01 user nova-compute[74980]: INFO nova.virt.libvirt.host [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] UEFI support detected
Nov 02 17:20:01 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Deleted allocations for instance e9d8737b-e341-4c00-bb8c-6e1847d24418
Nov 02 17:20:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lazy-loading 'numa_topology' on Instance uuid e9d8737b-e341-4c00-bb8c-6e1847d24418 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG nova.objects.base [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Object Instance<e9d8737b-e341-4c00-bb8c-6e1847d24418> lazy-loaded attributes: resources,numa_topology {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:20:01 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG nova.network.neutron [req-7d40e09d-584f-4580-b642-addcfbb1b6be req-ba66250d-6692-4732-a124-7b49f8c7b71e service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Updated VIF entry in instance network info cache for port 0864571c-261a-43f1-a1ec-0c481e22f430. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG nova.network.neutron [req-7d40e09d-584f-4580-b642-addcfbb1b6be req-ba66250d-6692-4732-a124-7b49f8c7b71e service nova] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Updating instance_info_cache with network_info: [{"id": "0864571c-261a-43f1-a1ec-0c481e22f430", "address": "fa:16:3e:08:8e:66", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0864571c-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7d40e09d-584f-4580-b642-addcfbb1b6be req-ba66250d-6692-4732-a124-7b49f8c7b71e service nova] Releasing lock "refresh_cache-e9d8737b-e341-4c00-bb8c-6e1847d24418" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b028c811-0680-48c1-9b91-8c837c747a6d tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "e9d8737b-e341-4c00-bb8c-6e1847d24418" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.448s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updating instance_info_cache with network_info: [{"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:20:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:20:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:05 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:20:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:06 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:20:06 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:20:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=7199MB free_disk=25.396018981933594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 82362140-8606-41dc-a574-86b0b89a7a35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1154d1f9-80b8-405b-8fd8-c10bb39c507f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 805deaa2-b2ca-4d1c-9580-317b0548282b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance d7f2fa00-48af-4277-93b4-af930e4a650f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 9ef84810-0506-4439-9302-72b239c8dddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 4e6bfb81-f01c-47e6-b771-7c2b34587623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:20:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:20:07 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:20:07 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:20:07 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:20:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-a17c950b-42c5-4dc9-8622-1725917dec5d req-a39370a4-62be-47c6-a7dd-358d7fcb6a44 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received event network-changed-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-a17c950b-42c5-4dc9-8622-1725917dec5d req-a39370a4-62be-47c6-a7dd-358d7fcb6a44 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Refreshing instance network info cache due to event network-changed-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:20:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a17c950b-42c5-4dc9-8622-1725917dec5d req-a39370a4-62be-47c6-a7dd-358d7fcb6a44 service nova] Acquiring lock "refresh_cache-82362140-8606-41dc-a574-86b0b89a7a35" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:20:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a17c950b-42c5-4dc9-8622-1725917dec5d req-a39370a4-62be-47c6-a7dd-358d7fcb6a44 service nova] Acquired lock "refresh_cache-82362140-8606-41dc-a574-86b0b89a7a35" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:20:19 user nova-compute[74980]: DEBUG nova.network.neutron [req-a17c950b-42c5-4dc9-8622-1725917dec5d req-a39370a4-62be-47c6-a7dd-358d7fcb6a44 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Refreshing network info cache for port 3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:20:19 user nova-compute[74980]: DEBUG nova.network.neutron [req-a17c950b-42c5-4dc9-8622-1725917dec5d req-a39370a4-62be-47c6-a7dd-358d7fcb6a44 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Updated VIF entry in instance network info cache for port 3d7df4f6-fa0e-4b6e-b96d-08126d2765f8. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:20:19 user nova-compute[74980]: DEBUG nova.network.neutron [req-a17c950b-42c5-4dc9-8622-1725917dec5d req-a39370a4-62be-47c6-a7dd-358d7fcb6a44 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Updating instance_info_cache with network_info: [{"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:20:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a17c950b-42c5-4dc9-8622-1725917dec5d req-a39370a4-62be-47c6-a7dd-358d7fcb6a44 service nova] Releasing lock "refresh_cache-82362140-8606-41dc-a574-86b0b89a7a35" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:20:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:20:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEekmQxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:20:20 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:20:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:20 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:20:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:20 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:20:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260" returned: 21 in 0.037s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:20 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[390826c8-5117-4a15-a0ee-5d7f25d5f59c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:20:20 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8801fe4b-06e5-4935-a6bd-ac3a8c59663c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11] added
Nov 02 17:20:21 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb08bf8-5317-4664-90da-85ad48a3c32d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfb7c22-4429-4529-88fb-5103eb547782]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uEekmQxp {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uEekmQxp" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a63edf-eade-4183-9db4-6e47cd3371e3]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uEekmQxp'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46b1d71-be50-48a9-a16b-c3e45dd96b29]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbKLXzYj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:20:21 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67a6114-0302-4a20-bf77-8f8ad93f0aa3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:20:21 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:21 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:21 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:20:21 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:21 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:21 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb4f20b-f119-4bf0-aa0d-378d4d9281f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11, portal: 172.16.0.220,3260]
Nov 02 17:20:21 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11, portal: 172.16.0.220,3260] successful.
Nov 02 17:20:21 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cf420d-5c7f-4b9c-9f5a-a6b8deb2bc01]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[679c1242-ef3e-43b7-b451-98789cc3f89f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:20:21 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:21 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:21 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:21 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:20:21 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:21 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:21 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:21 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbd37f1-594f-4a96-be78-b01868ea54cf]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEekmQxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c7add243-27b0-4d82-ac6d-92de3a3a9f50 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 46.391s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:20:21 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Creating image(s)
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Ensure instance console log exists: /opt/stack/data/nova/instances/3587ff70-6c7d-4753-91f7-d7ee1dc8bdac/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Start _get_guest_xml network_info=[{"id": "65610a01-9aaa-4755-ba01-ee4e72320408", "address": "fa:16:3e:2b:15:2f", "network": {"id": "e9224f9b-af21-4b41-a592-576ca0bb5ca6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925418223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65610a01-9a", "ovs_interfaceid": "65610a01-9aaa-4755-ba01-ee4e72320408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "address": "fa:16:3e:5a:18:ac", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774d9b42-ed", "ovs_interfaceid": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "address": "fa:16:3e:e4:49:2a", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b25c905-b2", "ovs_interfaceid": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b98210b-a018-4279-8528-69992920e5cc", "address": "fa:16:3e:4a:c0:98", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b98210b-a0", "ovs_interfaceid": "4b98210b-a018-4279-8528-69992920e5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvElQCor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3587ff70-6c7d-4753-91f7-d7ee1dc8bdac', 'attached_at': '', 'detached_at': '', 'volume_id': '20786b37-ba1d-4adc-a8c1-a25648258b63', 'serial': '20786b37-ba1d-4adc-a8c1-a25648258b63'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '2312c515-8dbc-4228-b6f9-42c205303b20', 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkzKloIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3587ff70-6c7d-4753-91f7-d7ee1dc8bdac', 'attached_at': '', 'detached_at': '', 'volume_id': 'e605ef5b-8746-4a57-87d2-ddfd8a8f0098', 'serial': 'e605ef5b-8746-4a57-87d2-ddfd8a8f0098'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'ece0cccb-9a7a-4663-9bf6-cfbd3e2ddf79', 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rTKQvLxS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3587ff70-6c7d-4753-91f7-d7ee1dc8bdac', 'attached_at': '', 'detached_at': '', 'volume_id': 'abd5d6d7-4e08-4099-8ff9-1eef798c4bfe', 'serial': 'abd5d6d7-4e08-4099-8ff9-1eef798c4bfe'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '6ad18c69-e6ef-4ff5-b21e-0433e70a4a13', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:20:21 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:20:21 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvElQCor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:20:21 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:20:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23337343066323166', 'path': '/dev/sde'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337343066323166', 'path': '/dev/sde'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.166s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:22 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:22 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG nova.objects.instance [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Lazy-loading 'flavor' on Instance uuid 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb982223-0079-46b5-9a78-17f17cfc542f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:20:22 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64c4f33-beb2-4d00-add4-0362f075fb42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f] added
Nov 02 17:20:22 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[87919da1-819e-407e-99fc-bfd561647144]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] attach device xml: <disk type="block" device="disk">
Nov 02 17:20:22 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:20:22 user nova-compute[74980]:   <source dev="/dev/sde"/>
Nov 02 17:20:22 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:20:22 user nova-compute[74980]:   <serial>f0509f86-d65f-42ec-84dd-eef34fa25f11</serial>
Nov 02 17:20:22 user nova-compute[74980]: </disk>
Nov 02 17:20:22 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bba7c69-d4df-4c43-85c5-7ce62bbe1e9a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mbKLXzYj {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mbKLXzYj" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af454a8-1d3b-4ab8-b026-ff53496ca47b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mbKLXzYj'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8789f4e-7dae-4509-aae2-c1d20dc11142]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d040e0e2-7227-4268-8261-0a4ae887d4d5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:20:22 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:22 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:22 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:22 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:20:22 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:22 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:22 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:22 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:22 user nova-compute[74980]: INFO nova.compute.manager [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Rebuilding instance
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b0cced-060a-4e15-bc87-b754854bdd6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f, portal: 172.16.0.220,3260]
Nov 02 17:20:22 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f, portal: 172.16.0.220,3260] successful.
Nov 02 17:20:22 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50cbe2b-2245-4872-ae1c-0be378af85fe]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eff6a09-4cbf-4638-988b-574eb34d7967]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:20:22 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:22 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:22 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:22 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:22 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:20:22 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:22 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:22 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:22 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:22 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.029s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f03486-ada1-4f11-ad39-779e3313476a]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbKLXzYj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:20:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] No VIF found with MAC fa:16:3e:a3:43:90, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-27996db0-1bc4-4ee8-b2a6-456e983afc34 req-8acfc173-7df3-431c-8c26-9db138064904 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received event network-vif-unplugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-27996db0-1bc4-4ee8-b2a6-456e983afc34 req-8acfc173-7df3-431c-8c26-9db138064904 service nova] Acquiring lock "82362140-8606-41dc-a574-86b0b89a7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-27996db0-1bc4-4ee8-b2a6-456e983afc34 req-8acfc173-7df3-431c-8c26-9db138064904 service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-27996db0-1bc4-4ee8-b2a6-456e983afc34 req-8acfc173-7df3-431c-8c26-9db138064904 service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-27996db0-1bc4-4ee8-b2a6-456e983afc34 req-8acfc173-7df3-431c-8c26-9db138064904 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] No waiting events found dispatching network-vif-unplugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:23 user nova-compute[74980]: WARNING nova.compute.manager [req-27996db0-1bc4-4ee8-b2a6-456e983afc34 req-8acfc173-7df3-431c-8c26-9db138064904 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received unexpected event network-vif-unplugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 for instance with vm_state active and task_state rebuilding.
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a7b286b2-11e1-46ef-8fe6-f285ff17e135 tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.512s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:23 user nova-compute[74980]: INFO nova.compute.manager [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Detaching volume fb464298-7fb9-4fd5-b384-0b42e5d31bea
Nov 02 17:20:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:23 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Instance destroyed successfully.
Nov 02 17:20:23 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Instance destroyed successfully.
Nov 02 17:20:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2076827604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-346112830',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTpqQoNo0W/Ba15IuwqtzMdO/Ma8YaqmK05K42Vul1aCdWd3AbpNWmrW5hXKt7oCzZVApl7jhtUwG4COeOBNbHItGsTrb/+JmrW4jXwqzDTsf4vNkzsXUpAI4g1UfSHEw==',key_name='tempest-keypair-703339062',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:18:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='086eda6bb22c44eea8cdcdf2138d6c8a',ramdisk_id='',reservation_id='r-y52rxoqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2119202372',owner_user_name='tempest-ServerActionsV293TestJSON-2119202372-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='349fb060d5d9496d89a25ce6c777c4b4',uuid=82362140-8606-41dc-a574-86b0b89a7a35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Converting VIF {"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:63:d1,bridge_name='br-int',has_traffic_filtering=True,id=3d7df4f6-fa0e-4b6e-b96d-08126d2765f8,network=Network(66fd33fd-9ae9-4d77-8000-8d54202a5c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d7df4f6-fa') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_vif [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:63:d1,bridge_name='br-int',has_traffic_filtering=True,id=3d7df4f6-fa0e-4b6e-b96d-08126d2765f8,network=Network(66fd33fd-9ae9-4d77-8000-8d54202a5c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d7df4f6-fa') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d7df4f6-fa, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1eb7b90-87ae-4fbc-99d8-0af684946297) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:23 user nova-compute[74980]: INFO nova.virt.block_device [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Attempting to driver detach volume fb464298-7fb9-4fd5-b384-0b42e5d31bea from mountpoint /dev/vdb
Nov 02 17:20:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:23 user nova-compute[74980]: INFO os_vif [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:63:d1,bridge_name='br-int',has_traffic_filtering=True,id=3d7df4f6-fa0e-4b6e-b96d-08126d2765f8,network=Network(66fd33fd-9ae9-4d77-8000-8d54202a5c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d7df4f6-fa')
Nov 02 17:20:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuIqYUnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:20:23 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Attempting to detach device vdb from instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:20:23 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:20:23 user nova-compute[74980]:   <source dev="/dev/sdd"/>
Nov 02 17:20:23 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:20:23 user nova-compute[74980]:   <serial>fb464298-7fb9-4fd5-b384-0b42e5d31bea</serial>
Nov 02 17:20:23 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 17:20:23 user nova-compute[74980]: </disk>
Nov 02 17:20:23 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:20:23 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Successfully detached device vdb from instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d from the persistent domain config.
Nov 02 17:20:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:20:23 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:20:23 user nova-compute[74980]:   <source dev="/dev/sdd"/>
Nov 02 17:20:23 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:20:23 user nova-compute[74980]:   <serial>fb464298-7fb9-4fd5-b384-0b42e5d31bea</serial>
Nov 02 17:20:23 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 17:20:23 user nova-compute[74980]: </disk>
Nov 02 17:20:23 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] <== connect_volume: return (2568ms) {'type': 'block', 'scsi_wwn': '26462663266656234', 'path': '/dev/sdf'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462663266656234', 'path': '/dev/sdf'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.989s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:23 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:23 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG nova.objects.instance [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lazy-loading 'flavor' on Instance uuid 9ef84810-0506-4439-9302-72b239c8dddd {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[94786b28-b5be-4758-9e0f-b0f133bb4e2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:20:23 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:20:23 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:20:23 user nova-compute[74980]:   <source dev="/dev/sdf"/>
Nov 02 17:20:23 user nova-compute[74980]:   <target dev="sdc" bus="scsi"/>
Nov 02 17:20:23 user nova-compute[74980]:   <serial>7d3d65b1-96f4-4e4f-9d86-c2a0d967493f</serial>
Nov 02 17:20:23 user nova-compute[74980]:   <address type="drive" controller="0" unit="2"/>
Nov 02 17:20:23 user nova-compute[74980]: </disk>
Nov 02 17:20:23 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[494a7dec-7257-4648-a097-a6caba407bbb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63] added
Nov 02 17:20:23 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50b891f-8bd0-4ef8-bdfa-9be04f0c326e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f88c8e1-275d-4833-9cec-cde9220a33c7]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvElQCor {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvElQCor" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a6f748-4044-410e-9801-f47127fb83fd]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvElQCor'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[72586790-36d3-462b-8cb2-da4862c913ad]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4e6c90-ed05-431f-bdb0-ce854bf1a7a1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:20:23 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:23 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:23 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:23 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:23 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:20:23 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:23 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:23 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:23 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:23 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb03f59-57b4-4ce9-8a45-fdaaaa8e1741]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63, portal: 172.16.0.220,3260]
Nov 02 17:20:24 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63, portal: 172.16.0.220,3260] successful.
Nov 02 17:20:24 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e260f96d-51d9-4003-8a0f-39f004afc95d tempest-VolumesAssistedSnapshotsTest-2113581737 tempest-VolumesAssistedSnapshotsTest-2113581737-project] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] volume_snapshot_create: create_info: {'snapshot_id': 'fd6435ce-c031-4412-966d-2a05379f8139', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74980) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5375f6-e661-4693-9c29-bbb33dc5f4a6]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e260f96d-51d9-4003-8a0f-39f004afc95d tempest-VolumesAssistedSnapshotsTest-2113581737 tempest-VolumesAssistedSnapshotsTest-2113581737-project] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] snap xml: <domainsnapshot>
Nov 02 17:20:24 user nova-compute[74980]:   <disks>
Nov 02 17:20:24 user nova-compute[74980]:     <disk name="/dev/sde" snapshot="external" type="file">
Nov 02 17:20:24 user nova-compute[74980]:       <source file="/dev/new_file"/>
Nov 02 17:20:24 user nova-compute[74980]:     </disk>
Nov 02 17:20:24 user nova-compute[74980]:     <disk name="vda" snapshot="no"/>
Nov 02 17:20:24 user nova-compute[74980]:   </disks>
Nov 02 17:20:24 user nova-compute[74980]: </domainsnapshot>
Nov 02 17:20:24 user nova-compute[74980]:  {{(pid=74980) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG nova.objects.instance [None req-e260f96d-51d9-4003-8a0f-39f004afc95d tempest-VolumesAssistedSnapshotsTest-2113581737 tempest-VolumesAssistedSnapshotsTest-2113581737-project] Lazy-loading 'system_metadata' on Instance uuid 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f378a6-a347-4916-a5ca-5333d2de39a0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:20:24 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:24 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:24 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:24 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:24 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:24 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:20:24 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:24 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:24 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:24 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:24 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:24 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca7f605-0aaf-4649-b041-4a331c46c851]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvElQCor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:24 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-e260f96d-51d9-4003-8a0f-39f004afc95d tempest-VolumesAssistedSnapshotsTest-2113581737 tempest-VolumesAssistedSnapshotsTest-2113581737-project] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 17:20:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-16cebb57-95e9-4903-9347-03615120a8ec tempest-VolumesAssistedSnapshotsTest-2113581737 tempest-VolumesAssistedSnapshotsTest-2113581737-project] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] volume_snapshot_delete: delete_info: {'volume_id': 'f0509f86-d65f-42ec-84dd-eef34fa25f11'} {{(pid=74980) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [None req-16cebb57-95e9-4903-9347-03615120a8ec tempest-VolumesAssistedSnapshotsTest-2113581737 tempest-VolumesAssistedSnapshotsTest-2113581737-project] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Traceback (most recent call last):
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     if delete_info['type'] != 'qcow2':
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] KeyError: 'type'
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] 
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [None req-e260f96d-51d9-4003-8a0f-39f004afc95d tempest-VolumesAssistedSnapshotsTest-2113581737 tempest-VolumesAssistedSnapshotsTest-2113581737-project] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Traceback (most recent call last):
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     rv = execute(f, *args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     six.reraise(c, e, tb)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     raise value
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     rv = meth(*args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] 
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [None req-e260f96d-51d9-4003-8a0f-39f004afc95d tempest-VolumesAssistedSnapshotsTest-2113581737 tempest-VolumesAssistedSnapshotsTest-2113581737-project] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Traceback (most recent call last):
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     self._volume_snapshot_create(context, instance, guest,
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     rv = execute(f, *args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     six.reraise(c, e, tb)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     raise value
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     rv = meth(*args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] 
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [None req-16cebb57-95e9-4903-9347-03615120a8ec tempest-VolumesAssistedSnapshotsTest-2113581737 tempest-VolumesAssistedSnapshotsTest-2113581737-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver 
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver 
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f8ff3b06-1cf5-452a-aa8b-df60f77d6feb)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver 
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver 
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver 
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server [None req-16cebb57-95e9-4903-9347-03615120a8ec tempest-VolumesAssistedSnapshotsTest-2113581737 tempest-VolumesAssistedSnapshotsTest-2113581737-project] Exception during message handling: KeyError: 'type'
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server 
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver [None req-e260f96d-51d9-4003-8a0f-39f004afc95d tempest-VolumesAssistedSnapshotsTest-2113581737 tempest-VolumesAssistedSnapshotsTest-2113581737-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot fd6435ce-c031-4412-966d-2a05379f8139 could not be found.
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     raise value
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver 
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver 
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot fd6435ce-c031-4412-966d-2a05379f8139 could not be found. (HTTP 404) (Request-ID: req-a946d79f-a2ca-418c-9847-5f3ac90ce47d)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver 
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver 
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot fd6435ce-c031-4412-966d-2a05379f8139 could not be found.
Nov 02 17:20:24 user nova-compute[74980]: ERROR nova.virt.libvirt.driver 
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server [None req-e260f96d-51d9-4003-8a0f-39f004afc95d tempest-VolumesAssistedSnapshotsTest-2113581737 tempest-VolumesAssistedSnapshotsTest-2113581737-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     raise value
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 17:20:24 user nova-compute[74980]: ERROR oslo_messaging.rpc.server 
Nov 02 17:20:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] No BDM found with device name sda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] No VIF found with MAC fa:16:3e:42:50:a7, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Acquiring lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:24 user nova-compute[74980]: INFO nova.compute.manager [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Detaching volume f0509f86-d65f-42ec-84dd-eef34fa25f11
Nov 02 17:20:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d5e61746-3a99-43fd-9c16-3ac199b973c6 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "9ef84810-0506-4439-9302-72b239c8dddd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.563s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:24 user nova-compute[74980]: INFO nova.virt.block_device [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Attempting to driver detach volume f0509f86-d65f-42ec-84dd-eef34fa25f11 from mountpoint /dev/vdb
Nov 02 17:20:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Attempting to detach device vdb from instance 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] detach device xml: <disk type="block" device="disk">
Nov 02 17:20:24 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:20:24 user nova-compute[74980]:   <source dev="/dev/sde"/>
Nov 02 17:20:24 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:20:24 user nova-compute[74980]:   <serial>f0509f86-d65f-42ec-84dd-eef34fa25f11</serial>
Nov 02 17:20:24 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:20:24 user nova-compute[74980]: </disk>
Nov 02 17:20:24 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:20:24 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Successfully detached device vdb from instance 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 from the persistent domain config.
Nov 02 17:20:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:20:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] detach device xml: <disk type="block" device="disk">
Nov 02 17:20:24 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:20:24 user nova-compute[74980]:   <source dev="/dev/sde"/>
Nov 02 17:20:24 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:20:24 user nova-compute[74980]:   <serial>f0509f86-d65f-42ec-84dd-eef34fa25f11</serial>
Nov 02 17:20:24 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:20:24 user nova-compute[74980]: </disk>
Nov 02 17:20:24 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-6d7462b8-2405-47e7-948d-0596c2dc634a req-95879a9f-8a58-46a6-bd31-f37395e1d660 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received event network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6d7462b8-2405-47e7-948d-0596c2dc634a req-95879a9f-8a58-46a6-bd31-f37395e1d660 service nova] Acquiring lock "82362140-8606-41dc-a574-86b0b89a7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6d7462b8-2405-47e7-948d-0596c2dc634a req-95879a9f-8a58-46a6-bd31-f37395e1d660 service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6d7462b8-2405-47e7-948d-0596c2dc634a req-95879a9f-8a58-46a6-bd31-f37395e1d660 service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-6d7462b8-2405-47e7-948d-0596c2dc634a req-95879a9f-8a58-46a6-bd31-f37395e1d660 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] No waiting events found dispatching network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:25 user nova-compute[74980]: WARNING nova.compute.manager [req-6d7462b8-2405-47e7-948d-0596c2dc634a req-95879a9f-8a58-46a6-bd31-f37395e1d660 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received unexpected event network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 for instance with vm_state active and task_state rebuilding.
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] <== connect_volume: return (3421ms) {'type': 'block', 'scsi_wwn': '23131313234376338', 'path': '/dev/sdg'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131313234376338', 'path': '/dev/sdg'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.612s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkzKloIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:20:25 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2b370c-d6c9-42a6-bc88-d03bb5d168eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:20:25 user nova-compute[74980]: No targets found.
Nov 02 17:20:25 user nova-compute[74980]: iSNS:
Nov 02 17:20:25 user nova-compute[74980]: No targets found.
Nov 02 17:20:25 user nova-compute[74980]: STATIC:
Nov 02 17:20:25 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63
Nov 02 17:20:25 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:25 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:25 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11
Nov 02 17:20:25 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:25 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:25 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f
Nov 02 17:20:25 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:25 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:25 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea
Nov 02 17:20:25 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:25 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:25 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b
Nov 02 17:20:25 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:25 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:25 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf
Nov 02 17:20:25 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:25 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:25 user nova-compute[74980]: FIRMWARE:
Nov 02 17:20:25 user nova-compute[74980]: No targets found.
Nov 02 17:20:25 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:20:25 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:20:25 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdc04f9-31fd-4606-83b8-2735f098d1ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a003d8ce-c75e-4c57-9fa6-5da00df28d01]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:25 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:25 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59c4237490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bea7172-3956-427e-a4ec-3d5f8ed7da09]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf92f2f-1a6b-4989-be39-25f3d0956005]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[565cccd6-3cc0-48d5-b263-b1215cc4b525]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f51514b-585f-4183-84e0-4092b53ff671]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[11149574-a480-4ad9-8900-02baed81ddf7]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d149cb84-5425-481c-9a6d-972472470c21]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260]
Nov 02 17:20:25 user nova-compute[74980]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260] successful.
Nov 02 17:20:25 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ec71db-0fe8-4593-b053-bc10bc5b7246]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] <== disconnect_volume: return (1960ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:20:25 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Deleting instance files /opt/stack/data/nova/instances/82362140-8606-41dc-a574-86b0b89a7a35_del
Nov 02 17:20:25 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Deletion of /opt/stack/data/nova/instances/82362140-8606-41dc-a574-86b0b89a7a35_del complete
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.337s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:25 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:25 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b768563-1881-4c58-afaf-b56985e9f201]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:20:25 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e4a889-3e81-4dee-8ac7-d2bda23a4ff4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098] added
Nov 02 17:20:25 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a91bec-f591-4871-884f-3ff279dcc6a9]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[533caf85-a03f-415f-a312-a1df8f5b4745]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WkzKloIX {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WkzKloIX" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb881f9-bd07-4660-b33f-816bbdd54159]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WkzKloIX'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7bea38-1dc9-4bf3-b52a-e306119f73e5]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7660f1f-c839-42d5-babd-888e8bae0ede]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:25 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:25 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 82362140-8606-41dc-a574-86b0b89a7a35 could not be found.
Nov 02 17:20:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuIqYUnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:20:25 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6a925c-6885-461a-9474-5b916fa015f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098, portal: 172.16.0.220,3260]
Nov 02 17:20:25 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098, portal: 172.16.0.220,3260] successful.
Nov 02 17:20:25 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[773d6764-9295-4aba-b6b2-9029035352b1]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ec2733-2bd0-4835-94e6-dcea867c864c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:25 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:25 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:25 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff2eae4-04cc-4054-a30c-abda23bd7610]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:20:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkzKloIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:20:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "9ef84810-0506-4439-9302-72b239c8dddd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "9ef84810-0506-4439-9302-72b239c8dddd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:26 user nova-compute[74980]: INFO nova.compute.manager [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Detaching volume 7d3d65b1-96f4-4e4f-9d86-c2a0d967493f
Nov 02 17:20:26 user nova-compute[74980]: INFO nova.virt.block_device [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Attempting to driver detach volume 7d3d65b1-96f4-4e4f-9d86-c2a0d967493f from mountpoint /dev/sdc
Nov 02 17:20:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Attempting to detach device sdc from instance 9ef84810-0506-4439-9302-72b239c8dddd from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:20:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:20:26 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:20:26 user nova-compute[74980]:   <source dev="/dev/sdf"/>
Nov 02 17:20:26 user nova-compute[74980]:   <target dev="sdc" bus="scsi"/>
Nov 02 17:20:26 user nova-compute[74980]:   <serial>7d3d65b1-96f4-4e4f-9d86-c2a0d967493f</serial>
Nov 02 17:20:26 user nova-compute[74980]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 02 17:20:26 user nova-compute[74980]: </disk>
Nov 02 17:20:26 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:20:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] <== connect_volume: return (1789ms) {'type': 'block', 'scsi_wwn': '26261306334383235', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:20:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261306334383235', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:20:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.162s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:27 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Successfully detached device sdc from instance 9ef84810-0506-4439-9302-72b239c8dddd from the persistent domain config.
Nov 02 17:20:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 9ef84810-0506-4439-9302-72b239c8dddd from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:20:27 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:20:27 user nova-compute[74980]:   <source dev="/dev/sdf"/>
Nov 02 17:20:27 user nova-compute[74980]:   <target dev="sdc" bus="scsi"/>
Nov 02 17:20:27 user nova-compute[74980]:   <serial>7d3d65b1-96f4-4e4f-9d86-c2a0d967493f</serial>
Nov 02 17:20:27 user nova-compute[74980]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 02 17:20:27 user nova-compute[74980]: </disk>
Nov 02 17:20:27 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.050s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c713fa20-3f6c-45e7-9ecf-2fc0bbcdc7f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:20:27 user nova-compute[74980]: No targets found.
Nov 02 17:20:27 user nova-compute[74980]: iSNS:
Nov 02 17:20:27 user nova-compute[74980]: No targets found.
Nov 02 17:20:27 user nova-compute[74980]: STATIC:
Nov 02 17:20:27 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63
Nov 02 17:20:27 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:27 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:27 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11
Nov 02 17:20:27 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:27 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:27 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f
Nov 02 17:20:27 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:27 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:27 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea
Nov 02 17:20:27 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:27 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:27 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b
Nov 02 17:20:27 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:27 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:27 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098
Nov 02 17:20:27 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:27 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:27 user nova-compute[74980]: FIRMWARE:
Nov 02 17:20:27 user nova-compute[74980]: No targets found.
Nov 02 17:20:27 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:20:27 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:20:27 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rTKQvLxS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:20:27 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c8325b-e492-47ce-b697-e47d3a56984b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d22d0b7-ba6c-442e-b067-ee2cba2db0b7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b46d7520>, {}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Disconnecting from: [] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.148s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] <== disconnect_volume: return (1311ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.056s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:27 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:27 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9fbdce-ffc7-4bb9-b670-5982857c6acb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:20:27 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4df603-8337-442b-b8e2-f1bf16d5538c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe] added
Nov 02 17:20:27 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dabbdf2-72d9-4565-944d-406ee446fb2d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[473ef7b9-a0d1-4b1a-b0e2-907a083d7d66]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rTKQvLxS {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rTKQvLxS" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c59dd4-9932-430e-a195-a3fd5589fa57]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rTKQvLxS'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a97d92-94ba-48ee-ba3c-e86b644655f6]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eb7552-5707-4865-8733-fc73dee8a2e8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef7f51a-e7ee-44be-8cb3-e147d9bfcf3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe, portal: 172.16.0.220,3260]
Nov 02 17:20:27 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe, portal: 172.16.0.220,3260] successful.
Nov 02 17:20:27 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 9ef84810-0506-4439-9302-72b239c8dddd {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[674a25dc-a181-4859-b95a-a28f3e9331ae]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a28806b-9c6b-49aa-95b4-b610e54edf7d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:20:27 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:27 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:20:27 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead8f914-5d8e-44a6-b4cf-ed29ec00637f]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:27 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rTKQvLxS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] <== connect_volume: return (1484ms) {'type': 'block', 'scsi_wwn': '23937313262643132', 'path': '/dev/sdh'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937313262643132', 'path': '/dev/sdh'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65610a01-9aaa-4755-ba01-ee4e72320408", "address": "fa:16:3e:2b:15:2f", "network": {"id": "e9224f9b-af21-4b41-a592-576ca0bb5ca6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925418223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65610a01-9a", "ovs_interfaceid": "65610a01-9aaa-4755-ba01-ee4e72320408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "65610a01-9aaa-4755-ba01-ee4e72320408", "address": "fa:16:3e:2b:15:2f", "network": {"id": "e9224f9b-af21-4b41-a592-576ca0bb5ca6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925418223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65610a01-9a", "ovs_interfaceid": "65610a01-9aaa-4755-ba01-ee4e72320408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=65610a01-9aaa-4755-ba01-ee4e72320408,network=Network(e9224f9b-af21-4b41-a592-576ca0bb5ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65610a01-9a') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f7:d8,bridge_name='br-int',has_traffic_filtering=True,id=97328bbf-6210-4167-98ef-df662837d418,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap97328bbf-62') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:69:94,bridge_name='br-int',has_traffic_filtering=True,id=43469d86-f716-49ce-bb76-f9cc4016366b,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap43469d86-f7') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "address": "fa:16:3e:5a:18:ac", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774d9b42-ed", "ovs_interfaceid": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "address": "fa:16:3e:5a:18:ac", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774d9b42-ed", "ovs_interfaceid": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:18:ac,bridge_name='br-int',has_traffic_filtering=True,id=774d9b42-edc6-4b48-92cc-ab4aed571c55,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap774d9b42-ed') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "address": "fa:16:3e:e4:49:2a", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b25c905-b2", "ovs_interfaceid": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "address": "fa:16:3e:e4:49:2a", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b25c905-b2", "ovs_interfaceid": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:49:2a,bridge_name='br-int',has_traffic_filtering=True,id=2b25c905-b2e0-4108-8cfc-f98176dbcb80,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b25c905-b2') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b98210b-a018-4279-8528-69992920e5cc", "address": "fa:16:3e:4a:c0:98", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b98210b-a0", "ovs_interfaceid": "4b98210b-a018-4279-8528-69992920e5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "4b98210b-a018-4279-8528-69992920e5cc", "address": "fa:16:3e:4a:c0:98", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b98210b-a0", "ovs_interfaceid": "4b98210b-a018-4279-8528-69992920e5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c0:98,bridge_name='br-int',has_traffic_filtering=True,id=4b98210b-a018-4279-8528-69992920e5cc,network=Network(388d3a91-478d-4088-8785-5d6ae280cf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b98210b-a0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:96:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b69b12c-b024-44d8-81ff-7c6c9f869743,network=Network(388d3a91-478d-4088-8785-5d6ae280cf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b69b12c-b0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.objects.instance [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lazy-loading 'pci_devices' on Instance uuid 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:20:28 user nova-compute[74980]:   <uuid>3587ff70-6c7d-4753-91f7-d7ee1dc8bdac</uuid>
Nov 02 17:20:28 user nova-compute[74980]:   <name>instance-0000000b</name>
Nov 02 17:20:28 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:20:28 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:20:28 user nova-compute[74980]:   <metadata>
Nov 02 17:20:28 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:20:28 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:20:28 user nova-compute[74980]:       <nova:name>tempest-device-tagging-server-1936774023</nova:name>
Nov 02 17:20:28 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:20:21</nova:creationTime>
Nov 02 17:20:28 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:20:28 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:20:28 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:20:28 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:20:28 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:20:28 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:20:28 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:20:28 user nova-compute[74980]:       <nova:owner>
Nov 02 17:20:28 user nova-compute[74980]:         <nova:user uuid="e420faa880a6456bbd1d7d63d8af2883">tempest-TaggedBootDevicesTest_v242-1889592963-project-member</nova:user>
Nov 02 17:20:28 user nova-compute[74980]:         <nova:project uuid="d5bd832a86ce41938aedfddef7ac7fd5">tempest-TaggedBootDevicesTest_v242-1889592963</nova:project>
Nov 02 17:20:28 user nova-compute[74980]:       </nova:owner>
Nov 02 17:20:28 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:20:28 user nova-compute[74980]:       <nova:ports>
Nov 02 17:20:28 user nova-compute[74980]:         <nova:port uuid="65610a01-9aaa-4755-ba01-ee4e72320408">
Nov 02 17:20:28 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 17:20:28 user nova-compute[74980]:         </nova:port>
Nov 02 17:20:28 user nova-compute[74980]:         <nova:port uuid="97328bbf-6210-4167-98ef-df662837d418">
Nov 02 17:20:28 user nova-compute[74980]:           <nova:ip type="fixed" address="10.1.1.44" ipVersion="4"/>
Nov 02 17:20:28 user nova-compute[74980]:         </nova:port>
Nov 02 17:20:28 user nova-compute[74980]:         <nova:port uuid="43469d86-f716-49ce-bb76-f9cc4016366b">
Nov 02 17:20:28 user nova-compute[74980]:           <nova:ip type="fixed" address="10.1.1.188" ipVersion="4"/>
Nov 02 17:20:28 user nova-compute[74980]:         </nova:port>
Nov 02 17:20:28 user nova-compute[74980]:         <nova:port uuid="774d9b42-edc6-4b48-92cc-ab4aed571c55">
Nov 02 17:20:28 user nova-compute[74980]:           <nova:ip type="fixed" address="10.1.1.243" ipVersion="4"/>
Nov 02 17:20:28 user nova-compute[74980]:         </nova:port>
Nov 02 17:20:28 user nova-compute[74980]:         <nova:port uuid="2b25c905-b2e0-4108-8cfc-f98176dbcb80">
Nov 02 17:20:28 user nova-compute[74980]:           <nova:ip type="fixed" address="10.1.1.174" ipVersion="4"/>
Nov 02 17:20:28 user nova-compute[74980]:         </nova:port>
Nov 02 17:20:28 user nova-compute[74980]:         <nova:port uuid="4b98210b-a018-4279-8528-69992920e5cc">
Nov 02 17:20:28 user nova-compute[74980]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 02 17:20:28 user nova-compute[74980]:         </nova:port>
Nov 02 17:20:28 user nova-compute[74980]:         <nova:port uuid="8b69b12c-b024-44d8-81ff-7c6c9f869743">
Nov 02 17:20:28 user nova-compute[74980]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 02 17:20:28 user nova-compute[74980]:         </nova:port>
Nov 02 17:20:28 user nova-compute[74980]:       </nova:ports>
Nov 02 17:20:28 user nova-compute[74980]:     </nova:instance>
Nov 02 17:20:28 user nova-compute[74980]:   </metadata>
Nov 02 17:20:28 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:20:28 user nova-compute[74980]:     <system>
Nov 02 17:20:28 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:20:28 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:20:28 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:20:28 user nova-compute[74980]:       <entry name="serial">3587ff70-6c7d-4753-91f7-d7ee1dc8bdac</entry>
Nov 02 17:20:28 user nova-compute[74980]:       <entry name="uuid">3587ff70-6c7d-4753-91f7-d7ee1dc8bdac</entry>
Nov 02 17:20:28 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:20:28 user nova-compute[74980]:     </system>
Nov 02 17:20:28 user nova-compute[74980]:   </sysinfo>
Nov 02 17:20:28 user nova-compute[74980]:   <os>
Nov 02 17:20:28 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:20:28 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:20:28 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:20:28 user nova-compute[74980]:   </os>
Nov 02 17:20:28 user nova-compute[74980]:   <features>
Nov 02 17:20:28 user nova-compute[74980]:     <acpi/>
Nov 02 17:20:28 user nova-compute[74980]:     <apic/>
Nov 02 17:20:28 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:20:28 user nova-compute[74980]:   </features>
Nov 02 17:20:28 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:20:28 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:20:28 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:20:28 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:20:28 user nova-compute[74980]:   </clock>
Nov 02 17:20:28 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:20:28 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:20:28 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:20:28 user nova-compute[74980]:   </cpu>
Nov 02 17:20:28 user nova-compute[74980]:   <devices>
Nov 02 17:20:28 user nova-compute[74980]:     <disk type="file" device="cdrom">
Nov 02 17:20:28 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 17:20:28 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/3587ff70-6c7d-4753-91f7-d7ee1dc8bdac/disk.config"/>
Nov 02 17:20:28 user nova-compute[74980]:       <target dev="hda" bus="ide"/>
Nov 02 17:20:28 user nova-compute[74980]:     </disk>
Nov 02 17:20:28 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:20:28 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:20:28 user nova-compute[74980]:       <source dev="/dev/sdg"/>
Nov 02 17:20:28 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:20:28 user nova-compute[74980]:       <serial>20786b37-ba1d-4adc-a8c1-a25648258b63</serial>
Nov 02 17:20:28 user nova-compute[74980]:     </disk>
Nov 02 17:20:28 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:20:28 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:20:28 user nova-compute[74980]:       <source dev="/dev/sdb"/>
Nov 02 17:20:28 user nova-compute[74980]:       <target dev="vdb" bus="virtio"/>
Nov 02 17:20:28 user nova-compute[74980]:       <serial>e605ef5b-8746-4a57-87d2-ddfd8a8f0098</serial>
Nov 02 17:20:28 user nova-compute[74980]:     </disk>
Nov 02 17:20:28 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:20:28 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:20:28 user nova-compute[74980]:       <source dev="/dev/sdh"/>
Nov 02 17:20:28 user nova-compute[74980]:       <target dev="vdc" bus="virtio"/>
Nov 02 17:20:28 user nova-compute[74980]:       <serial>abd5d6d7-4e08-4099-8ff9-1eef798c4bfe</serial>
Nov 02 17:20:28 user nova-compute[74980]:     </disk>
Nov 02 17:20:28 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:20:28 user nova-compute[74980]:       <mac address="fa:16:3e:2b:15:2f"/>
Nov 02 17:20:28 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:20:28 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:20:28 user nova-compute[74980]:       <target dev="tap65610a01-9a"/>
Nov 02 17:20:28 user nova-compute[74980]:     </interface>
Nov 02 17:20:28 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:20:28 user nova-compute[74980]:       <mac address="fa:16:3e:a6:f7:d8"/>
Nov 02 17:20:28 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:20:28 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:20:28 user nova-compute[74980]:       <target dev="tap97328bbf-62"/>
Nov 02 17:20:28 user nova-compute[74980]:     </interface>
Nov 02 17:20:28 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:20:28 user nova-compute[74980]:       <mac address="fa:16:3e:b5:69:94"/>
Nov 02 17:20:28 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:20:28 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:20:28 user nova-compute[74980]:       <target dev="tap43469d86-f7"/>
Nov 02 17:20:28 user nova-compute[74980]:     </interface>
Nov 02 17:20:28 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:20:28 user nova-compute[74980]:       <mac address="fa:16:3e:5a:18:ac"/>
Nov 02 17:20:28 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:20:28 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:20:28 user nova-compute[74980]:       <target dev="tap774d9b42-ed"/>
Nov 02 17:20:28 user nova-compute[74980]:     </interface>
Nov 02 17:20:28 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:20:28 user nova-compute[74980]:       <mac address="fa:16:3e:e4:49:2a"/>
Nov 02 17:20:28 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:20:28 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:20:28 user nova-compute[74980]:       <target dev="tap2b25c905-b2"/>
Nov 02 17:20:28 user nova-compute[74980]:     </interface>
Nov 02 17:20:28 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:20:28 user nova-compute[74980]:       <mac address="fa:16:3e:4a:c0:98"/>
Nov 02 17:20:28 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:20:28 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:20:28 user nova-compute[74980]:       <target dev="tap4b98210b-a0"/>
Nov 02 17:20:28 user nova-compute[74980]:     </interface>
Nov 02 17:20:28 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:20:28 user nova-compute[74980]:       <mac address="fa:16:3e:c3:96:0f"/>
Nov 02 17:20:28 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:20:28 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:20:28 user nova-compute[74980]:       <target dev="tap8b69b12c-b0"/>
Nov 02 17:20:28 user nova-compute[74980]:     </interface>
Nov 02 17:20:28 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:20:28 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/3587ff70-6c7d-4753-91f7-d7ee1dc8bdac/console.log" append="off"/>
Nov 02 17:20:28 user nova-compute[74980]:     </serial>
Nov 02 17:20:28 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:20:28 user nova-compute[74980]:     <video>
Nov 02 17:20:28 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:20:28 user nova-compute[74980]:     </video>
Nov 02 17:20:28 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:20:28 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:20:28 user nova-compute[74980]:     </rng>
Nov 02 17:20:28 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:20:28 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:20:28 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:20:28 user nova-compute[74980]:     </memballoon>
Nov 02 17:20:28 user nova-compute[74980]:   </devices>
Nov 02 17:20:28 user nova-compute[74980]: </domain>
Nov 02 17:20:28 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65610a01-9aaa-4755-ba01-ee4e72320408", "address": "fa:16:3e:2b:15:2f", "network": {"id": "e9224f9b-af21-4b41-a592-576ca0bb5ca6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925418223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65610a01-9a", "ovs_interfaceid": "65610a01-9aaa-4755-ba01-ee4e72320408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "65610a01-9aaa-4755-ba01-ee4e72320408", "address": "fa:16:3e:2b:15:2f", "network": {"id": "e9224f9b-af21-4b41-a592-576ca0bb5ca6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925418223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65610a01-9a", "ovs_interfaceid": "65610a01-9aaa-4755-ba01-ee4e72320408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=65610a01-9aaa-4755-ba01-ee4e72320408,network=Network(e9224f9b-af21-4b41-a592-576ca0bb5ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65610a01-9a') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG os_vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=65610a01-9aaa-4755-ba01-ee4e72320408,network=Network(e9224f9b-af21-4b41-a592-576ca0bb5ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65610a01-9a') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35478e22-557e-536c-8073-9488194c7fc8', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65610a01-9a, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65610a01-9a, col_values=(('qos', UUID('229c7557-78c6-44b2-9f0b-54194e552e13')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65610a01-9a, col_values=(('external_ids', {'iface-id': '65610a01-9aaa-4755-ba01-ee4e72320408', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:15:2f', 'vm-uuid': '3587ff70-6c7d-4753-91f7-d7ee1dc8bdac'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: INFO os_vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=65610a01-9aaa-4755-ba01-ee4e72320408,network=Network(e9224f9b-af21-4b41-a592-576ca0bb5ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65610a01-9a')
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f7:d8,bridge_name='br-int',has_traffic_filtering=True,id=97328bbf-6210-4167-98ef-df662837d418,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap97328bbf-62') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG os_vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f7:d8,bridge_name='br-int',has_traffic_filtering=True,id=97328bbf-6210-4167-98ef-df662837d418,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap97328bbf-62') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfa8b3d0-3cc4-5cd3-96e6-5c8311ac219e', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97328bbf-62, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97328bbf-62, col_values=(('qos', UUID('b595a5fb-e913-4529-a4ec-469f6f05b1a2')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97328bbf-62, col_values=(('external_ids', {'iface-id': '97328bbf-6210-4167-98ef-df662837d418', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:f7:d8', 'vm-uuid': '3587ff70-6c7d-4753-91f7-d7ee1dc8bdac'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: INFO os_vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f7:d8,bridge_name='br-int',has_traffic_filtering=True,id=97328bbf-6210-4167-98ef-df662837d418,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap97328bbf-62')
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:69:94,bridge_name='br-int',has_traffic_filtering=True,id=43469d86-f716-49ce-bb76-f9cc4016366b,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap43469d86-f7') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG os_vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:69:94,bridge_name='br-int',has_traffic_filtering=True,id=43469d86-f716-49ce-bb76-f9cc4016366b,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap43469d86-f7') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f9ef66c-2ea9-52b4-9e02-a043ec61031e', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43469d86-f7, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43469d86-f7, col_values=(('qos', UUID('203a977d-bea6-4650-b793-3eb611bd0776')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43469d86-f7, col_values=(('external_ids', {'iface-id': '43469d86-f716-49ce-bb76-f9cc4016366b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:69:94', 'vm-uuid': '3587ff70-6c7d-4753-91f7-d7ee1dc8bdac'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: INFO os_vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:69:94,bridge_name='br-int',has_traffic_filtering=True,id=43469d86-f716-49ce-bb76-f9cc4016366b,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap43469d86-f7')
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "address": "fa:16:3e:5a:18:ac", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774d9b42-ed", "ovs_interfaceid": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "address": "fa:16:3e:5a:18:ac", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774d9b42-ed", "ovs_interfaceid": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:18:ac,bridge_name='br-int',has_traffic_filtering=True,id=774d9b42-edc6-4b48-92cc-ab4aed571c55,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap774d9b42-ed') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG os_vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:18:ac,bridge_name='br-int',has_traffic_filtering=True,id=774d9b42-edc6-4b48-92cc-ab4aed571c55,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap774d9b42-ed') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa9decd3-e80b-5bcf-bf98-8479a4bf8da7', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap774d9b42-ed, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap774d9b42-ed, col_values=(('qos', UUID('47ad4a6e-f23b-4427-9580-5573779247de')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap774d9b42-ed, col_values=(('external_ids', {'iface-id': '774d9b42-edc6-4b48-92cc-ab4aed571c55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:18:ac', 'vm-uuid': '3587ff70-6c7d-4753-91f7-d7ee1dc8bdac'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: INFO os_vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:18:ac,bridge_name='br-int',has_traffic_filtering=True,id=774d9b42-edc6-4b48-92cc-ab4aed571c55,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap774d9b42-ed')
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "address": "fa:16:3e:e4:49:2a", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b25c905-b2", "ovs_interfaceid": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "address": "fa:16:3e:e4:49:2a", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b25c905-b2", "ovs_interfaceid": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:49:2a,bridge_name='br-int',has_traffic_filtering=True,id=2b25c905-b2e0-4108-8cfc-f98176dbcb80,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b25c905-b2') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG os_vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:49:2a,bridge_name='br-int',has_traffic_filtering=True,id=2b25c905-b2e0-4108-8cfc-f98176dbcb80,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b25c905-b2') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '714d78b2-b1d1-5d4c-ad97-c9e29e15e8cb', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b25c905-b2, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b25c905-b2, col_values=(('qos', UUID('d2e460be-caf9-4540-8c9e-8de372c3532a')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b25c905-b2, col_values=(('external_ids', {'iface-id': '2b25c905-b2e0-4108-8cfc-f98176dbcb80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:49:2a', 'vm-uuid': '3587ff70-6c7d-4753-91f7-d7ee1dc8bdac'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:29 user nova-compute[74980]: INFO os_vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:49:2a,bridge_name='br-int',has_traffic_filtering=True,id=2b25c905-b2e0-4108-8cfc-f98176dbcb80,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b25c905-b2')
Nov 02 17:20:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b98210b-a018-4279-8528-69992920e5cc", "address": "fa:16:3e:4a:c0:98", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b98210b-a0", "ovs_interfaceid": "4b98210b-a018-4279-8528-69992920e5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "4b98210b-a018-4279-8528-69992920e5cc", "address": "fa:16:3e:4a:c0:98", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b98210b-a0", "ovs_interfaceid": "4b98210b-a018-4279-8528-69992920e5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c0:98,bridge_name='br-int',has_traffic_filtering=True,id=4b98210b-a018-4279-8528-69992920e5cc,network=Network(388d3a91-478d-4088-8785-5d6ae280cf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b98210b-a0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG os_vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c0:98,bridge_name='br-int',has_traffic_filtering=True,id=4b98210b-a018-4279-8528-69992920e5cc,network=Network(388d3a91-478d-4088-8785-5d6ae280cf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b98210b-a0') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df1d41a8-f5b5-55d0-bb3e-532aee6ad966', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b98210b-a0, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b98210b-a0, col_values=(('qos', UUID('41f89570-206a-4eec-a813-2d6b0544e171')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b98210b-a0, col_values=(('external_ids', {'iface-id': '4b98210b-a018-4279-8528-69992920e5cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:c0:98', 'vm-uuid': '3587ff70-6c7d-4753-91f7-d7ee1dc8bdac'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:29 user nova-compute[74980]: INFO os_vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c0:98,bridge_name='br-int',has_traffic_filtering=True,id=4b98210b-a018-4279-8528-69992920e5cc,network=Network(388d3a91-478d-4088-8785-5d6ae280cf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b98210b-a0')
Nov 02 17:20:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:96:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b69b12c-b024-44d8-81ff-7c6c9f869743,network=Network(388d3a91-478d-4088-8785-5d6ae280cf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b69b12c-b0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG os_vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:96:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b69b12c-b024-44d8-81ff-7c6c9f869743,network=Network(388d3a91-478d-4088-8785-5d6ae280cf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b69b12c-b0') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '784a928f-6585-5027-803f-f52e99686550', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b69b12c-b0, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b69b12c-b0, col_values=(('qos', UUID('787cfbd6-be01-415e-bc16-336868e4f20c')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b69b12c-b0, col_values=(('external_ids', {'iface-id': '8b69b12c-b024-44d8-81ff-7c6c9f869743', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:96:0f', 'vm-uuid': '3587ff70-6c7d-4753-91f7-d7ee1dc8bdac'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:29 user nova-compute[74980]: INFO os_vif [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:96:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b69b12c-b024-44d8-81ff-7c6c9f869743,network=Network(388d3a91-478d-4088-8785-5d6ae280cf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b69b12c-b0')
Nov 02 17:20:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] No BDM found with device name hda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] No VIF found with MAC fa:16:3e:2b:15:2f, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] No VIF found with MAC fa:16:3e:e4:49:2a, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:20:29 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Using config drive
Nov 02 17:20:29 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Creating config drive at /opt/stack/data/nova/instances/3587ff70-6c7d-4753-91f7-d7ee1dc8bdac/disk.config
Nov 02 17:20:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3587ff70-6c7d-4753-91f7-d7ee1dc8bdac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptt2hdcvn {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3587ff70-6c7d-4753-91f7-d7ee1dc8bdac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptt2hdcvn" returned: 0 in 0.061s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG nova.compute.manager [req-fba1d54b-9d1c-4701-97d0-01a7fedbc7d5 req-047cea14-6cd5-45fa-81b3-d445b631e14a service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-65610a01-9aaa-4755-ba01-ee4e72320408 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fba1d54b-9d1c-4701-97d0-01a7fedbc7d5 req-047cea14-6cd5-45fa-81b3-d445b631e14a service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fba1d54b-9d1c-4701-97d0-01a7fedbc7d5 req-047cea14-6cd5-45fa-81b3-d445b631e14a service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fba1d54b-9d1c-4701-97d0-01a7fedbc7d5 req-047cea14-6cd5-45fa-81b3-d445b631e14a service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG nova.compute.manager [req-fba1d54b-9d1c-4701-97d0-01a7fedbc7d5 req-047cea14-6cd5-45fa-81b3-d445b631e14a service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-65610a01-9aaa-4755-ba01-ee4e72320408 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:31 user nova-compute[74980]: WARNING nova.compute.manager [req-fba1d54b-9d1c-4701-97d0-01a7fedbc7d5 req-047cea14-6cd5-45fa-81b3-d445b631e14a service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-65610a01-9aaa-4755-ba01-ee4e72320408 for instance with vm_state building and task_state spawning.
Nov 02 17:20:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-65610a01-9aaa-4755-ba01-ee4e72320408 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-65610a01-9aaa-4755-ba01-ee4e72320408 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:33 user nova-compute[74980]: WARNING nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-65610a01-9aaa-4755-ba01-ee4e72320408 for instance with vm_state building and task_state spawning.
Nov 02 17:20:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-97328bbf-6210-4167-98ef-df662837d418 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-97328bbf-6210-4167-98ef-df662837d418 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:33 user nova-compute[74980]: WARNING nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-97328bbf-6210-4167-98ef-df662837d418 for instance with vm_state building and task_state spawning.
Nov 02 17:20:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-97328bbf-6210-4167-98ef-df662837d418 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-97328bbf-6210-4167-98ef-df662837d418 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:33 user nova-compute[74980]: WARNING nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-97328bbf-6210-4167-98ef-df662837d418 for instance with vm_state building and task_state spawning.
Nov 02 17:20:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-43469d86-f716-49ce-bb76-f9cc4016366b {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-43469d86-f716-49ce-bb76-f9cc4016366b {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:33 user nova-compute[74980]: WARNING nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-43469d86-f716-49ce-bb76-f9cc4016366b for instance with vm_state building and task_state spawning.
Nov 02 17:20:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-43469d86-f716-49ce-bb76-f9cc4016366b {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-43469d86-f716-49ce-bb76-f9cc4016366b {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:33 user nova-compute[74980]: WARNING nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-43469d86-f716-49ce-bb76-f9cc4016366b for instance with vm_state building and task_state spawning.
Nov 02 17:20:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-774d9b42-edc6-4b48-92cc-ab4aed571c55 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-774d9b42-edc6-4b48-92cc-ab4aed571c55 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:33 user nova-compute[74980]: WARNING nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-774d9b42-edc6-4b48-92cc-ab4aed571c55 for instance with vm_state building and task_state spawning.
Nov 02 17:20:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-774d9b42-edc6-4b48-92cc-ab4aed571c55 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-774d9b42-edc6-4b48-92cc-ab4aed571c55 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:33 user nova-compute[74980]: WARNING nova.compute.manager [req-f6474752-dc63-4ef2-89bd-041e1b218468 req-ac079944-78cd-4601-ad8b-d7e40232947e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-774d9b42-edc6-4b48-92cc-ab4aed571c55 for instance with vm_state building and task_state spawning.
Nov 02 17:20:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:34 user nova-compute[74980]: DEBUG nova.compute.manager [req-8672f355-3d2b-487c-a3f2-55dd7662ff52 req-602c0682-887b-4aef-9976-f958a9a81976 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-8b69b12c-b024-44d8-81ff-7c6c9f869743 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8672f355-3d2b-487c-a3f2-55dd7662ff52 req-602c0682-887b-4aef-9976-f958a9a81976 service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8672f355-3d2b-487c-a3f2-55dd7662ff52 req-602c0682-887b-4aef-9976-f958a9a81976 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8672f355-3d2b-487c-a3f2-55dd7662ff52 req-602c0682-887b-4aef-9976-f958a9a81976 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:34 user nova-compute[74980]: DEBUG nova.compute.manager [req-8672f355-3d2b-487c-a3f2-55dd7662ff52 req-602c0682-887b-4aef-9976-f958a9a81976 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-8b69b12c-b024-44d8-81ff-7c6c9f869743 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:34 user nova-compute[74980]: WARNING nova.compute.manager [req-8672f355-3d2b-487c-a3f2-55dd7662ff52 req-602c0682-887b-4aef-9976-f958a9a81976 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-8b69b12c-b024-44d8-81ff-7c6c9f869743 for instance with vm_state building and task_state spawning.
Nov 02 17:20:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-2b25c905-b2e0-4108-8cfc-f98176dbcb80 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-2b25c905-b2e0-4108-8cfc-f98176dbcb80 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:35 user nova-compute[74980]: WARNING nova.compute.manager [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-2b25c905-b2e0-4108-8cfc-f98176dbcb80 for instance with vm_state building and task_state spawning.
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-2b25c905-b2e0-4108-8cfc-f98176dbcb80 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-2b25c905-b2e0-4108-8cfc-f98176dbcb80 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:35 user nova-compute[74980]: WARNING nova.compute.manager [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-2b25c905-b2e0-4108-8cfc-f98176dbcb80 for instance with vm_state building and task_state spawning.
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-4b98210b-a018-4279-8528-69992920e5cc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-4b98210b-a018-4279-8528-69992920e5cc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:35 user nova-compute[74980]: WARNING nova.compute.manager [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-4b98210b-a018-4279-8528-69992920e5cc for instance with vm_state building and task_state spawning.
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-4b98210b-a018-4279-8528-69992920e5cc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-4b98210b-a018-4279-8528-69992920e5cc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:35 user nova-compute[74980]: WARNING nova.compute.manager [req-419b59a0-8391-4a6b-8696-40f4e245803e req-c2339c27-c9e6-4d46-946b-259cf5c94054 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-4b98210b-a018-4279-8528-69992920e5cc for instance with vm_state building and task_state spawning.
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:20:35 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Instance spawned successfully.
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:20:35 user nova-compute[74980]: INFO nova.compute.manager [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Took 14.30 seconds to spawn the instance on the hypervisor.
Nov 02 17:20:35 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:20:36 user nova-compute[74980]: INFO nova.compute.manager [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Took 91.91 seconds to build instance.
Nov 02 17:20:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1e9cd507-9c12-4e16-b660-c7ccdbd28c44 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 92.027s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-a1ade493-8508-4c7a-9322-346469eec198 req-a172ed64-a584-485b-9d21-83722534cdaf service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-8b69b12c-b024-44d8-81ff-7c6c9f869743 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a1ade493-8508-4c7a-9322-346469eec198 req-a172ed64-a584-485b-9d21-83722534cdaf service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a1ade493-8508-4c7a-9322-346469eec198 req-a172ed64-a584-485b-9d21-83722534cdaf service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a1ade493-8508-4c7a-9322-346469eec198 req-a172ed64-a584-485b-9d21-83722534cdaf service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-a1ade493-8508-4c7a-9322-346469eec198 req-a172ed64-a584-485b-9d21-83722534cdaf service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-8b69b12c-b024-44d8-81ff-7c6c9f869743 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:36 user nova-compute[74980]: WARNING nova.compute.manager [req-a1ade493-8508-4c7a-9322-346469eec198 req-a172ed64-a584-485b-9d21-83722534cdaf service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-8b69b12c-b024-44d8-81ff-7c6c9f869743 for instance with vm_state active and task_state None.
Nov 02 17:20:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG nova.compute.manager [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Preparing to wait for external event volume-reimaged-756ebe57-479f-485e-8091-9f3771aea8cf {{(pid=74980) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "82362140-8606-41dc-a574-86b0b89a7a35-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GPusyTlL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:20:41 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:20:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:41 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:20:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:41 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6448cdc9-34ee-48a2-8bf5-91e06d4fd803]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:20:41 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2ab892-6a12-453b-a935-8144ec669d0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e] added
Nov 02 17:20:41 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc546cc-c481-43ff-8f1a-059c1ff86abd]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89c62ac-1122-490b-b43c-0a52ad03ea52]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GPusyTlL {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GPusyTlL" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2421731-81ea-42ff-b3ba-d8ac10eb12f8]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GPusyTlL'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6fbe8e-8a78-4289-a5ce-88a6a9dd140a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b860b9-ab5c-4b4f-9b51-85dad9550ee4]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:41 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:41 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:41 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:41 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:41 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:41 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:20:41 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:41 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:41 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:41 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:41 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:41 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:41 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:20:41 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8688da1d-9969-42e6-8e89-564aa628725f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e, portal: 172.16.0.220,3260]
Nov 02 17:20:42 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e, portal: 172.16.0.220,3260] successful.
Nov 02 17:20:42 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef86232-877c-41b9-a9e3-8026322116a0]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f5e394-37d8-46dc-ae1c-eb9e43e7e007]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e (non-flash)
Nov 02 17:20:42 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:42 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:42 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:42 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:42 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:42 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:42 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:20:42 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e (non-flash)
Nov 02 17:20:42 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:42 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:42 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:42 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:42 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:42 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:42 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:20:42 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a4ea13-0489-4c6f-8242-3d7bbff40fca]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:20:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GPusyTlL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:20:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23365623034393930', 'path': '/dev/sdi'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:20:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365623034393930', 'path': '/dev/sdi'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:20:43 user nova-compute[74980]: DEBUG nova.objects.instance [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lazy-loading 'flavor' on Instance uuid 1154d1f9-80b8-405b-8fd8-c10bb39c507f {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:20:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:20:43 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:20:43 user nova-compute[74980]:   <source dev="/dev/sdi"/>
Nov 02 17:20:43 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:20:43 user nova-compute[74980]:   <serial>fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e</serial>
Nov 02 17:20:43 user nova-compute[74980]: </disk>
Nov 02 17:20:43 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:20:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:20:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:20:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] No VIF found with MAC fa:16:3e:5d:ba:b9, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:20:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0a2f3f60-b653-4cf1-a8ca-410b1f4ff52d tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 45.655s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:44 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d is timed out.
Nov 02 17:20:44 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Successfully detached device vdb from instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d from the live domain config.
Nov 02 17:20:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqeyibTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:20:44 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8209438e-9007-4142-b759-01c99a803c68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:20:44 user nova-compute[74980]: No targets found.
Nov 02 17:20:44 user nova-compute[74980]: iSNS:
Nov 02 17:20:44 user nova-compute[74980]: No targets found.
Nov 02 17:20:44 user nova-compute[74980]: STATIC:
Nov 02 17:20:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63
Nov 02 17:20:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11
Nov 02 17:20:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f
Nov 02 17:20:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea
Nov 02 17:20:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b
Nov 02 17:20:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe
Nov 02 17:20:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e
Nov 02 17:20:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098
Nov 02 17:20:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:44 user nova-compute[74980]: FIRMWARE:
Nov 02 17:20:44 user nova-compute[74980]: No targets found.
Nov 02 17:20:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:20:44 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:20:44 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebf3211-bd78-4b21-a4c1-62af4161e916]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[538eb0b8-6f2d-4e3c-b085-328e4fd674d1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e (non-flash)
Nov 02 17:20:44 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:44 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:44 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:44 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:44 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:44 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:44 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:20:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e (non-flash)
Nov 02 17:20:44 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:44 user nova-compute[74980]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea (non-flash)
Nov 02 17:20:44 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:44 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:44 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:44 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:44 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:20:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b4409360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea'): ({'sdd'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Removing single pathed devices sdd {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2fa6f6-73a2-4e97-bdea-f31214b44477]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8ec1b5-8853-4796-bdaf-741b8cdfa424]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Flushing IO for device /dev/sdd {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15a937a-be36-4766-95b8-5e4e9af95230]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf39649-7fa6-4d74-b9df-268eb050ce6c]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] SCSI volumes sdd have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5daadd63-9f21-43b1-a2c9-42638d20d8d7]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[34516664-fa85-42c5-a3b4-75781dbac1c2]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea, portal: 172.16.0.220,3260]
Nov 02 17:20:44 user nova-compute[74980]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea, portal: 172.16.0.220,3260] successful.
Nov 02 17:20:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb464298-7fb9-4fd5-b384-0b42e5d31bea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[162e32d2-11b0-45f0-9a50-ed30c9e9fcaf]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] <== disconnect_volume: return (365ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:44 user nova-compute[74980]: INFO nova.compute.manager [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Detaching volume fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e
Nov 02 17:20:44 user nova-compute[74980]: INFO nova.virt.block_device [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Attempting to driver detach volume fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e from mountpoint /dev/vdb
Nov 02 17:20:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Attempting to detach device vdb from instance 1154d1f9-80b8-405b-8fd8-c10bb39c507f from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:20:44 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:20:44 user nova-compute[74980]:   <source dev="/dev/sdi"/>
Nov 02 17:20:44 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:20:44 user nova-compute[74980]:   <serial>fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e</serial>
Nov 02 17:20:44 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:20:44 user nova-compute[74980]: </disk>
Nov 02 17:20:44 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:20:44 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Successfully detached device vdb from instance 1154d1f9-80b8-405b-8fd8-c10bb39c507f from the persistent domain config.
Nov 02 17:20:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1154d1f9-80b8-405b-8fd8-c10bb39c507f from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:20:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:20:44 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:20:44 user nova-compute[74980]:   <source dev="/dev/sdi"/>
Nov 02 17:20:44 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:20:44 user nova-compute[74980]:   <serial>fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e</serial>
Nov 02 17:20:44 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:20:44 user nova-compute[74980]: </disk>
Nov 02 17:20:44 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:20:45 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 is timed out.
Nov 02 17:20:45 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Successfully detached device vdb from instance 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 from the live domain config.
Nov 02 17:20:45 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEekmQxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:20:45 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab1ff87-f0e9-4520-9444-d381340b88d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:20:45 user nova-compute[74980]: No targets found.
Nov 02 17:20:45 user nova-compute[74980]: iSNS:
Nov 02 17:20:45 user nova-compute[74980]: No targets found.
Nov 02 17:20:45 user nova-compute[74980]: STATIC:
Nov 02 17:20:45 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63
Nov 02 17:20:45 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:45 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:45 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11
Nov 02 17:20:45 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:45 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:45 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f
Nov 02 17:20:45 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:45 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:45 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b
Nov 02 17:20:45 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:45 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:45 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe
Nov 02 17:20:45 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:45 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:45 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e
Nov 02 17:20:45 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:45 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:45 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098
Nov 02 17:20:45 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:45 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:45 user nova-compute[74980]: FIRMWARE:
Nov 02 17:20:45 user nova-compute[74980]: No targets found.
Nov 02 17:20:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:20:45 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:20:45 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1cd3df-f0cf-411e-9b71-0e3c9014f011]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df3cce0-3b0d-4484-aef8-439ff8488f91]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e (non-flash)
Nov 02 17:20:45 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:45 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:45 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:45 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:45 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:45 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:20:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e (non-flash)
Nov 02 17:20:45 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:45 user nova-compute[74980]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 (non-flash)
Nov 02 17:20:45 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:45 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:45 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:45 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:20:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59c4236d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11'): ({'sde'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Removing single pathed devices sde {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[da611b09-e0ab-4137-8960-80e129a4a5c4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1154d1f9-80b8-405b-8fd8-c10bb39c507f {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG nova.objects.instance [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lazy-loading 'flavor' on Instance uuid aeae0fe6-ffc2-48f7-8b59-c6485851be3d {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbffa3f-1f6b-4630-b6f8-ac3247892481]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Flushing IO for device /dev/sde {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd63cea-2d30-494c-9ae2-418106a804e9]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[86386d77-b263-4ee3-b9db-73d310b517d8]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] SCSI volumes sde have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30419bdb-66d4-4172-a0b9-e659dc854a02 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.049s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7b2849-70fb-4709-aa15-022cec5ecaf2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca27ab05-220b-420f-bbfa-2c46318cfc57]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11, portal: 172.16.0.220,3260]
Nov 02 17:20:45 user nova-compute[74980]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11, portal: 172.16.0.220,3260] successful.
Nov 02 17:20:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0509f86-d65f-42ec-84dd-eef34fa25f11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86ba7f2-ef3e-4bd1-b6eb-241a5eeaa658]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] <== disconnect_volume: return (388ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.volume.cinder [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Update attachment failed for attachment 6eb40347-9135-4c7d-99ad-db13ad92931f. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b97e635-5755-4d9e-8f45-e5b6ce2fc1c3) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b97e635-5755-4d9e-8f45-e5b6ce2fc1c3)
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b97e635-5755-4d9e-8f45-e5b6ce2fc1c3)
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Traceback (most recent call last):
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     driver_block_device.attach_block_devices(
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     _log_and_attach(device)
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     bdm.attach(*attach_args, **attach_kwargs)
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     ret_val = method(obj, context, *args, **kwargs)
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     self._do_attach(context, instance, volume, volume_api,
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     self._volume_attach(context, volume, connector, instance,
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     connection_info = volume_api.attachment_update(
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     res = method(self, ctx, *args, **kwargs)
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     with excutils.save_and_reraise_exception():
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     self.force_reraise()
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     raise self.value
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     return method.func(obj, *args, **kwargs)
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     resp = self._update('/attachments/%s' % id, body)
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     return self.request(url, method, **kwargs)
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2]     raise exceptions.from_response(resp, body)
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b97e635-5755-4d9e-8f45-e5b6ce2fc1c3)
Nov 02 17:20:45 user nova-compute[74980]: ERROR nova.compute.manager [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] 
Nov 02 17:20:45 user nova-compute[74980]: DEBUG nova.compute.claims [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Aborting claim: <nova.compute.claims.Claim object at 0x7f59b46c7310> {{(pid=74980) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "interface-aeae0fe6-ffc2-48f7-8b59-c6485851be3d-8ca932f4-4d4e-4481-970f-161340d7bccc" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "interface-aeae0fe6-ffc2-48f7-8b59-c6485851be3d-8ca932f4-4d4e-4481-970f-161340d7bccc" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.objects.instance [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lazy-loading 'flavor' on Instance uuid aeae0fe6-ffc2-48f7-8b59-c6485851be3d {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1956055295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1956055295',id=7,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxrQckQxr69xMzJYNTLEjM/WTe1wsExTJezKCnbJ7jnYlT8mZTga0YewAJ2OnZA6lwf50l3CWjDefeId4ykNOk9L89xqNa/3p6b4bQjrJI1+UpsUWudVowdG28U6uyqAA==',key_name='tempest-keypair-347748516',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='061cfdc41fc64eea9bd281d8c51424c8',ramdisk_id='',reservation_id='r-qbp9xyqq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2126535582',owner_user_name='tempest-TaggedAttachmentsTest-2126535582-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59c1bf383d2a48449244708dea3cd95b',uuid=aeae0fe6-ffc2-48f7-8b59-c6485851be3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ca932f4-4d4e-4481-970f-161340d7bccc", "address": "fa:16:3e:e5:c0:c9", "network": {"id": "7e642d05-f3e4-4a5e-b251-eb51e2525ef9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870506038", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca932f4-4d", "ovs_interfaceid": "8ca932f4-4d4e-4481-970f-161340d7bccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Converting VIF {"id": "8ca932f4-4d4e-4481-970f-161340d7bccc", "address": "fa:16:3e:e5:c0:c9", "network": {"id": "7e642d05-f3e4-4a5e-b251-eb51e2525ef9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870506038", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca932f4-4d", "ovs_interfaceid": "8ca932f4-4d4e-4481-970f-161340d7bccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c0:c9,bridge_name='br-int',has_traffic_filtering=True,id=8ca932f4-4d4e-4481-970f-161340d7bccc,network=Network(7e642d05-f3e4-4a5e-b251-eb51e2525ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca932f4-4d') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:c0:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap8ca932f4-4d"/></interface> {{(pid=74980) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:c0:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap8ca932f4-4d"/></interface> {{(pid=74980) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Attempting to detach device tap8ca932f4-4d from instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] detach device xml: <interface type="ethernet">
Nov 02 17:20:46 user nova-compute[74980]:   <mac address="fa:16:3e:e5:c0:c9"/>
Nov 02 17:20:46 user nova-compute[74980]:   <model type="virtio"/>
Nov 02 17:20:46 user nova-compute[74980]:   <mtu size="1442"/>
Nov 02 17:20:46 user nova-compute[74980]:   <target dev="tap8ca932f4-4d"/>
Nov 02 17:20:46 user nova-compute[74980]: </interface>
Nov 02 17:20:46 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:c0:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap8ca932f4-4d"/></interface> {{(pid=74980) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e5:c0:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap8ca932f4-4d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 02 17:20:46 user nova-compute[74980]:   <name>instance-00000007</name>
Nov 02 17:20:46 user nova-compute[74980]:   <uuid>aeae0fe6-ffc2-48f7-8b59-c6485851be3d</uuid>
Nov 02 17:20:46 user nova-compute[74980]:   <metadata>
Nov 02 17:20:46 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:20:46 user nova-compute[74980]:   <nova:package version="0.0.0"/>
Nov 02 17:20:46 user nova-compute[74980]:   <nova:name>tempest-device-tagging-server-1956055295</nova:name>
Nov 02 17:20:46 user nova-compute[74980]:   <nova:creationTime>2023-11-02 17:19:34</nova:creationTime>
Nov 02 17:20:46 user nova-compute[74980]:   <nova:flavor name="m1.tiny">
Nov 02 17:20:46 user nova-compute[74980]:     <nova:memory>512</nova:memory>
Nov 02 17:20:46 user nova-compute[74980]:     <nova:disk>1</nova:disk>
Nov 02 17:20:46 user nova-compute[74980]:     <nova:swap>0</nova:swap>
Nov 02 17:20:46 user nova-compute[74980]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:20:46 user nova-compute[74980]:     <nova:vcpus>1</nova:vcpus>
Nov 02 17:20:46 user nova-compute[74980]:   </nova:flavor>
Nov 02 17:20:46 user nova-compute[74980]:   <nova:owner>
Nov 02 17:20:46 user nova-compute[74980]:     <nova:user uuid="59c1bf383d2a48449244708dea3cd95b">tempest-TaggedAttachmentsTest-2126535582-project-member</nova:user>
Nov 02 17:20:46 user nova-compute[74980]:     <nova:project uuid="061cfdc41fc64eea9bd281d8c51424c8">tempest-TaggedAttachmentsTest-2126535582</nova:project>
Nov 02 17:20:46 user nova-compute[74980]:   </nova:owner>
Nov 02 17:20:46 user nova-compute[74980]:   <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:20:46 user nova-compute[74980]:   <nova:ports>
Nov 02 17:20:46 user nova-compute[74980]:     <nova:port uuid="7434f94a-713e-4434-9262-8da6a26d4006">
Nov 02 17:20:46 user nova-compute[74980]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 17:20:46 user nova-compute[74980]:     </nova:port>
Nov 02 17:20:46 user nova-compute[74980]:     <nova:port uuid="8ca932f4-4d4e-4481-970f-161340d7bccc">
Nov 02 17:20:46 user nova-compute[74980]:       <nova:ip type="fixed" address="10.10.10.199" ipVersion="4"/>
Nov 02 17:20:46 user nova-compute[74980]:     </nova:port>
Nov 02 17:20:46 user nova-compute[74980]:   </nova:ports>
Nov 02 17:20:46 user nova-compute[74980]: </nova:instance>
Nov 02 17:20:46 user nova-compute[74980]:   </metadata>
Nov 02 17:20:46 user nova-compute[74980]:   <memory unit='KiB'>524288</memory>
Nov 02 17:20:46 user nova-compute[74980]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 17:20:46 user nova-compute[74980]:   <vcpu placement='static'>1</vcpu>
Nov 02 17:20:46 user nova-compute[74980]:   <resource>
Nov 02 17:20:46 user nova-compute[74980]:     <partition>/machine</partition>
Nov 02 17:20:46 user nova-compute[74980]:   </resource>
Nov 02 17:20:46 user nova-compute[74980]:   <sysinfo type='smbios'>
Nov 02 17:20:46 user nova-compute[74980]:     <system>
Nov 02 17:20:46 user nova-compute[74980]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 17:20:46 user nova-compute[74980]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 17:20:46 user nova-compute[74980]:       <entry name='version'>0.0.0</entry>
Nov 02 17:20:46 user nova-compute[74980]:       <entry name='serial'>aeae0fe6-ffc2-48f7-8b59-c6485851be3d</entry>
Nov 02 17:20:46 user nova-compute[74980]:       <entry name='uuid'>aeae0fe6-ffc2-48f7-8b59-c6485851be3d</entry>
Nov 02 17:20:46 user nova-compute[74980]:       <entry name='family'>Virtual Machine</entry>
Nov 02 17:20:46 user nova-compute[74980]:     </system>
Nov 02 17:20:46 user nova-compute[74980]:   </sysinfo>
Nov 02 17:20:46 user nova-compute[74980]:   <os>
Nov 02 17:20:46 user nova-compute[74980]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 17:20:46 user nova-compute[74980]:     <boot dev='hd'/>
Nov 02 17:20:46 user nova-compute[74980]:     <smbios mode='sysinfo'/>
Nov 02 17:20:46 user nova-compute[74980]:   </os>
Nov 02 17:20:46 user nova-compute[74980]:   <features>
Nov 02 17:20:46 user nova-compute[74980]:     <acpi/>
Nov 02 17:20:46 user nova-compute[74980]:     <apic/>
Nov 02 17:20:46 user nova-compute[74980]:     <vmcoreinfo state='on'/>
Nov 02 17:20:46 user nova-compute[74980]:   </features>
Nov 02 17:20:46 user nova-compute[74980]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 17:20:46 user nova-compute[74980]:     <model fallback='forbid'>Nehalem</model>
Nov 02 17:20:46 user nova-compute[74980]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 17:20:46 user nova-compute[74980]:     <feature policy='require' name='vme'/>
Nov 02 17:20:46 user nova-compute[74980]:     <feature policy='require' name='x2apic'/>
Nov 02 17:20:46 user nova-compute[74980]:     <feature policy='require' name='hypervisor'/>
Nov 02 17:20:46 user nova-compute[74980]:   </cpu>
Nov 02 17:20:46 user nova-compute[74980]:   <clock offset='utc'>
Nov 02 17:20:46 user nova-compute[74980]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 17:20:46 user nova-compute[74980]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 17:20:46 user nova-compute[74980]:     <timer name='hpet' present='no'/>
Nov 02 17:20:46 user nova-compute[74980]:   </clock>
Nov 02 17:20:46 user nova-compute[74980]:   <on_poweroff>destroy</on_poweroff>
Nov 02 17:20:46 user nova-compute[74980]:   <on_reboot>restart</on_reboot>
Nov 02 17:20:46 user nova-compute[74980]:   <on_crash>destroy</on_crash>
Nov 02 17:20:46 user nova-compute[74980]:   <devices>
Nov 02 17:20:46 user nova-compute[74980]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 17:20:46 user nova-compute[74980]:     <disk type='file' device='disk'>
Nov 02 17:20:46 user nova-compute[74980]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 17:20:46 user nova-compute[74980]:       <source file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk' index='2'/>
Nov 02 17:20:46 user nova-compute[74980]:       <backingStore type='file' index='3'>
Nov 02 17:20:46 user nova-compute[74980]:         <format type='raw'/>
Nov 02 17:20:46 user nova-compute[74980]:         <source file='/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666'/>
Nov 02 17:20:46 user nova-compute[74980]:         <backingStore/>
Nov 02 17:20:46 user nova-compute[74980]:       </backingStore>
Nov 02 17:20:46 user nova-compute[74980]:       <target dev='vda' bus='virtio'/>
Nov 02 17:20:46 user nova-compute[74980]:       <alias name='virtio-disk0'/>
Nov 02 17:20:46 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 17:20:46 user nova-compute[74980]:     </disk>
Nov 02 17:20:46 user nova-compute[74980]:     <disk type='file' device='cdrom'>
Nov 02 17:20:46 user nova-compute[74980]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 17:20:46 user nova-compute[74980]:       <source file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk.config' index='1'/>
Nov 02 17:20:46 user nova-compute[74980]:       <backingStore/>
Nov 02 17:20:46 user nova-compute[74980]:       <target dev='hda' bus='ide'/>
Nov 02 17:20:46 user nova-compute[74980]:       <readonly/>
Nov 02 17:20:46 user nova-compute[74980]:       <alias name='ide0-0-0'/>
Nov 02 17:20:46 user nova-compute[74980]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 17:20:46 user nova-compute[74980]:     </disk>
Nov 02 17:20:46 user nova-compute[74980]:     <controller type='usb' index='0' model='none'>
Nov 02 17:20:46 user nova-compute[74980]:       <alias name='usb'/>
Nov 02 17:20:46 user nova-compute[74980]:     </controller>
Nov 02 17:20:46 user nova-compute[74980]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 17:20:46 user nova-compute[74980]:       <alias name='pci.0'/>
Nov 02 17:20:46 user nova-compute[74980]:     </controller>
Nov 02 17:20:46 user nova-compute[74980]:     <controller type='ide' index='0'>
Nov 02 17:20:46 user nova-compute[74980]:       <alias name='ide'/>
Nov 02 17:20:46 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 17:20:46 user nova-compute[74980]:     </controller>
Nov 02 17:20:46 user nova-compute[74980]:     <interface type='ethernet'>
Nov 02 17:20:46 user nova-compute[74980]:       <mac address='fa:16:3e:d3:89:3a'/>
Nov 02 17:20:46 user nova-compute[74980]:       <target dev='tap7434f94a-71'/>
Nov 02 17:20:46 user nova-compute[74980]:       <model type='virtio'/>
Nov 02 17:20:46 user nova-compute[74980]:       <mtu size='1442'/>
Nov 02 17:20:46 user nova-compute[74980]:       <alias name='net0'/>
Nov 02 17:20:46 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 17:20:46 user nova-compute[74980]:     </interface>
Nov 02 17:20:46 user nova-compute[74980]:     <interface type='ethernet'>
Nov 02 17:20:46 user nova-compute[74980]:       <mac address='fa:16:3e:e5:c0:c9'/>
Nov 02 17:20:46 user nova-compute[74980]:       <target dev='tap8ca932f4-4d'/>
Nov 02 17:20:46 user nova-compute[74980]:       <model type='virtio'/>
Nov 02 17:20:46 user nova-compute[74980]:       <mtu size='1442'/>
Nov 02 17:20:46 user nova-compute[74980]:       <alias name='net1'/>
Nov 02 17:20:46 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 02 17:20:46 user nova-compute[74980]:     </interface>
Nov 02 17:20:46 user nova-compute[74980]:     <serial type='pty'>
Nov 02 17:20:46 user nova-compute[74980]:       <source path='/dev/pts/6'/>
Nov 02 17:20:46 user nova-compute[74980]:       <log file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/console.log' append='off'/>
Nov 02 17:20:46 user nova-compute[74980]:       <target type='isa-serial' port='0'>
Nov 02 17:20:46 user nova-compute[74980]:         <model name='isa-serial'/>
Nov 02 17:20:46 user nova-compute[74980]:       </target>
Nov 02 17:20:46 user nova-compute[74980]:       <alias name='serial0'/>
Nov 02 17:20:46 user nova-compute[74980]:     </serial>
Nov 02 17:20:46 user nova-compute[74980]:     <console type='pty' tty='/dev/pts/6'>
Nov 02 17:20:46 user nova-compute[74980]:       <source path='/dev/pts/6'/>
Nov 02 17:20:46 user nova-compute[74980]:       <log file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/console.log' append='off'/>
Nov 02 17:20:46 user nova-compute[74980]:       <target type='serial' port='0'/>
Nov 02 17:20:46 user nova-compute[74980]:       <alias name='serial0'/>
Nov 02 17:20:46 user nova-compute[74980]:     </console>
Nov 02 17:20:46 user nova-compute[74980]:     <input type='mouse' bus='ps2'>
Nov 02 17:20:46 user nova-compute[74980]:       <alias name='input0'/>
Nov 02 17:20:46 user nova-compute[74980]:     </input>
Nov 02 17:20:46 user nova-compute[74980]:     <input type='keyboard' bus='ps2'>
Nov 02 17:20:46 user nova-compute[74980]:       <alias name='input1'/>
Nov 02 17:20:46 user nova-compute[74980]:     </input>
Nov 02 17:20:46 user nova-compute[74980]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 02 17:20:46 user nova-compute[74980]:       <listen type='address' address='0.0.0.0'/>
Nov 02 17:20:46 user nova-compute[74980]:     </graphics>
Nov 02 17:20:46 user nova-compute[74980]:     <audio id='1' type='none'/>
Nov 02 17:20:46 user nova-compute[74980]:     <video>
Nov 02 17:20:46 user nova-compute[74980]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 17:20:46 user nova-compute[74980]:       <alias name='video0'/>
Nov 02 17:20:46 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 17:20:46 user nova-compute[74980]:     </video>
Nov 02 17:20:46 user nova-compute[74980]:     <memballoon model='virtio'>
Nov 02 17:20:46 user nova-compute[74980]:       <stats period='10'/>
Nov 02 17:20:46 user nova-compute[74980]:       <alias name='balloon0'/>
Nov 02 17:20:46 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 17:20:46 user nova-compute[74980]:     </memballoon>
Nov 02 17:20:46 user nova-compute[74980]:     <rng model='virtio'>
Nov 02 17:20:46 user nova-compute[74980]:       <backend model='random'>/dev/urandom</backend>
Nov 02 17:20:46 user nova-compute[74980]:       <alias name='rng0'/>
Nov 02 17:20:46 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 17:20:46 user nova-compute[74980]:     </rng>
Nov 02 17:20:46 user nova-compute[74980]:   </devices>
Nov 02 17:20:46 user nova-compute[74980]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 17:20:46 user nova-compute[74980]:     <label>libvirt-aeae0fe6-ffc2-48f7-8b59-c6485851be3d</label>
Nov 02 17:20:46 user nova-compute[74980]:     <imagelabel>libvirt-aeae0fe6-ffc2-48f7-8b59-c6485851be3d</imagelabel>
Nov 02 17:20:46 user nova-compute[74980]:   </seclabel>
Nov 02 17:20:46 user nova-compute[74980]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 17:20:46 user nova-compute[74980]:     <label>+64055:+108</label>
Nov 02 17:20:46 user nova-compute[74980]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 17:20:46 user nova-compute[74980]:   </seclabel>
Nov 02 17:20:46 user nova-compute[74980]: </domain>
Nov 02 17:20:46 user nova-compute[74980]:  {{(pid=74980) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 17:20:46 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Successfully detached device tap8ca932f4-4d from instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d from the persistent domain config.
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] (1/8): Attempting to detach device tap8ca932f4-4d with device alias net1 from instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] detach device xml: <interface type="ethernet">
Nov 02 17:20:46 user nova-compute[74980]:   <mac address="fa:16:3e:e5:c0:c9"/>
Nov 02 17:20:46 user nova-compute[74980]:   <model type="virtio"/>
Nov 02 17:20:46 user nova-compute[74980]:   <mtu size="1442"/>
Nov 02 17:20:46 user nova-compute[74980]:   <target dev="tap8ca932f4-4d"/>
Nov 02 17:20:46 user nova-compute[74980]: </interface>
Nov 02 17:20:46 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.552s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Build of instance f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b97e635-5755-4d9e-8f45-e5b6ce2fc1c3) {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.compute.utils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Build of instance f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74980) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 02 17:20:46 user nova-compute[74980]: ERROR nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Build of instance f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b97e635-5755-4d9e-8f45-e5b6ce2fc1c3): nova.exception.BuildAbortException: Build of instance f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3b97e635-5755-4d9e-8f45-e5b6ce2fc1c3)
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Unplugging VIFs for instance {{(pid=74980) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354909366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354909366',id=12,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxe1rHspqW6e3orF4PDxOV9MgPQOVS3N2V9yfIfrtFUVwLKrcDvOQEwDrT+6GGRSizfX3e7dBj7ftL+pqqOWsrcWnEm0TVNC3QrIQ1Lvq2SqmjQoRTKYzEmHKKXWjRORg==',key_name='tempest-keypair-2004802136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e22b7337cf864f039098d9ca369831ba',ramdisk_id='',reservation_id='r-c723o4i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-868661834',owner_user_name='tempest-TaggedBootDevicesTest-868661834-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='473bdd50c7eb455f943c2ea12fb22617',uuid=f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f", "address": "fa:16:3e:2b:48:97", "network": {"id": "9d32acae-88da-4088-82dd-12ebba94a307", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117481914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e48e6fa-4c", "ovs_interfaceid": "1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Converting VIF {"id": "1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f", "address": "fa:16:3e:2b:48:97", "network": {"id": "9d32acae-88da-4088-82dd-12ebba94a307", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1117481914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e48e6fa-4c", "ovs_interfaceid": "1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:48:97,bridge_name='br-int',has_traffic_filtering=True,id=1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f,network=Network(9d32acae-88da-4088-82dd-12ebba94a307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e48e6fa-4c') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG os_vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:48:97,bridge_name='br-int',has_traffic_filtering=True,id=1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f,network=Network(9d32acae-88da-4088-82dd-12ebba94a307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e48e6fa-4c') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e48e6fa-4c, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:20:46 user nova-compute[74980]: INFO os_vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:48:97,bridge_name='br-int',has_traffic_filtering=True,id=1e48e6fa-4cc6-4c56-ac06-97d1b5e7de8f,network=Network(9d32acae-88da-4088-82dd-12ebba94a307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e48e6fa-4c')
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354909366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354909366',id=12,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxe1rHspqW6e3orF4PDxOV9MgPQOVS3N2V9yfIfrtFUVwLKrcDvOQEwDrT+6GGRSizfX3e7dBj7ftL+pqqOWsrcWnEm0TVNC3QrIQ1Lvq2SqmjQoRTKYzEmHKKXWjRORg==',key_name='tempest-keypair-2004802136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e22b7337cf864f039098d9ca369831ba',ramdisk_id='',reservation_id='r-c723o4i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-868661834',owner_user_name='tempest-TaggedBootDevicesTest-868661834-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='473bdd50c7eb455f943c2ea12fb22617',uuid=f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab5600fb-8b71-492d-80db-d8a5559d2087", "address": "fa:16:3e:7f:f2:d7", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5600fb-8b", "ovs_interfaceid": "ab5600fb-8b71-492d-80db-d8a5559d2087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Converting VIF {"id": "ab5600fb-8b71-492d-80db-d8a5559d2087", "address": "fa:16:3e:7f:f2:d7", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab5600fb-8b", "ovs_interfaceid": "ab5600fb-8b71-492d-80db-d8a5559d2087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=ab5600fb-8b71-492d-80db-d8a5559d2087,network=Network(3fda9a27-9487-485d-a163-54cad9966a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab5600fb-8b') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG os_vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=ab5600fb-8b71-492d-80db-d8a5559d2087,network=Network(3fda9a27-9487-485d-a163-54cad9966a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab5600fb-8b') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab5600fb-8b, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:20:46 user nova-compute[74980]: INFO os_vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=ab5600fb-8b71-492d-80db-d8a5559d2087,network=Network(3fda9a27-9487-485d-a163-54cad9966a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab5600fb-8b')
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354909366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354909366',id=12,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxe1rHspqW6e3orF4PDxOV9MgPQOVS3N2V9yfIfrtFUVwLKrcDvOQEwDrT+6GGRSizfX3e7dBj7ftL+pqqOWsrcWnEm0TVNC3QrIQ1Lvq2SqmjQoRTKYzEmHKKXWjRORg==',key_name='tempest-keypair-2004802136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e22b7337cf864f039098d9ca369831ba',ramdisk_id='',reservation_id='r-c723o4i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-868661834',owner_user_name='tempest-TaggedBootDevicesTest-868661834-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='473bdd50c7eb455f943c2ea12fb22617',uuid=f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70d88ea5-2a37-49ac-a8cf-726ab5c5eac3", "address": "fa:16:3e:5d:4f:bc", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d88ea5-2a", "ovs_interfaceid": "70d88ea5-2a37-49ac-a8cf-726ab5c5eac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Converting VIF {"id": "70d88ea5-2a37-49ac-a8cf-726ab5c5eac3", "address": "fa:16:3e:5d:4f:bc", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d88ea5-2a", "ovs_interfaceid": "70d88ea5-2a37-49ac-a8cf-726ab5c5eac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4f:bc,bridge_name='br-int',has_traffic_filtering=True,id=70d88ea5-2a37-49ac-a8cf-726ab5c5eac3,network=Network(3fda9a27-9487-485d-a163-54cad9966a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70d88ea5-2a') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG os_vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4f:bc,bridge_name='br-int',has_traffic_filtering=True,id=70d88ea5-2a37-49ac-a8cf-726ab5c5eac3,network=Network(3fda9a27-9487-485d-a163-54cad9966a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70d88ea5-2a') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70d88ea5-2a, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:20:46 user nova-compute[74980]: INFO os_vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4f:bc,bridge_name='br-int',has_traffic_filtering=True,id=70d88ea5-2a37-49ac-a8cf-726ab5c5eac3,network=Network(3fda9a27-9487-485d-a163-54cad9966a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap70d88ea5-2a')
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354909366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354909366',id=12,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxe1rHspqW6e3orF4PDxOV9MgPQOVS3N2V9yfIfrtFUVwLKrcDvOQEwDrT+6GGRSizfX3e7dBj7ftL+pqqOWsrcWnEm0TVNC3QrIQ1Lvq2SqmjQoRTKYzEmHKKXWjRORg==',key_name='tempest-keypair-2004802136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e22b7337cf864f039098d9ca369831ba',ramdisk_id='',reservation_id='r-c723o4i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-868661834',owner_user_name='tempest-TaggedBootDevicesTest-868661834-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='473bdd50c7eb455f943c2ea12fb22617',uuid=f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a198f607-58f8-4ce4-81e1-6621b1978970", "address": "fa:16:3e:2f:42:c6", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa198f607-58", "ovs_interfaceid": "a198f607-58f8-4ce4-81e1-6621b1978970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Converting VIF {"id": "a198f607-58f8-4ce4-81e1-6621b1978970", "address": "fa:16:3e:2f:42:c6", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa198f607-58", "ovs_interfaceid": "a198f607-58f8-4ce4-81e1-6621b1978970", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:42:c6,bridge_name='br-int',has_traffic_filtering=True,id=a198f607-58f8-4ce4-81e1-6621b1978970,network=Network(3fda9a27-9487-485d-a163-54cad9966a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa198f607-58') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG os_vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:42:c6,bridge_name='br-int',has_traffic_filtering=True,id=a198f607-58f8-4ce4-81e1-6621b1978970,network=Network(3fda9a27-9487-485d-a163-54cad9966a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa198f607-58') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa198f607-58, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:20:46 user nova-compute[74980]: INFO os_vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:42:c6,bridge_name='br-int',has_traffic_filtering=True,id=a198f607-58f8-4ce4-81e1-6621b1978970,network=Network(3fda9a27-9487-485d-a163-54cad9966a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa198f607-58')
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354909366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354909366',id=12,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxe1rHspqW6e3orF4PDxOV9MgPQOVS3N2V9yfIfrtFUVwLKrcDvOQEwDrT+6GGRSizfX3e7dBj7ftL+pqqOWsrcWnEm0TVNC3QrIQ1Lvq2SqmjQoRTKYzEmHKKXWjRORg==',key_name='tempest-keypair-2004802136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e22b7337cf864f039098d9ca369831ba',ramdisk_id='',reservation_id='r-c723o4i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-868661834',owner_user_name='tempest-TaggedBootDevicesTest-868661834-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='473bdd50c7eb455f943c2ea12fb22617',uuid=f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fe1ced3-ac4c-4ed5-a69c-2503051039c4", "address": "fa:16:3e:1a:3e:58", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe1ced3-ac", "ovs_interfaceid": "5fe1ced3-ac4c-4ed5-a69c-2503051039c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Converting VIF {"id": "5fe1ced3-ac4c-4ed5-a69c-2503051039c4", "address": "fa:16:3e:1a:3e:58", "network": {"id": "3fda9a27-9487-485d-a163-54cad9966a71", "bridge": "br-int", "label": "tempest-device-tagging-net1-1873418724", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe1ced3-ac", "ovs_interfaceid": "5fe1ced3-ac4c-4ed5-a69c-2503051039c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3e:58,bridge_name='br-int',has_traffic_filtering=True,id=5fe1ced3-ac4c-4ed5-a69c-2503051039c4,network=Network(3fda9a27-9487-485d-a163-54cad9966a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe1ced3-ac') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG os_vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3e:58,bridge_name='br-int',has_traffic_filtering=True,id=5fe1ced3-ac4c-4ed5-a69c-2503051039c4,network=Network(3fda9a27-9487-485d-a163-54cad9966a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe1ced3-ac') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fe1ced3-ac, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:20:46 user nova-compute[74980]: INFO os_vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3e:58,bridge_name='br-int',has_traffic_filtering=True,id=5fe1ced3-ac4c-4ed5-a69c-2503051039c4,network=Network(3fda9a27-9487-485d-a163-54cad9966a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe1ced3-ac')
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354909366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354909366',id=12,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxe1rHspqW6e3orF4PDxOV9MgPQOVS3N2V9yfIfrtFUVwLKrcDvOQEwDrT+6GGRSizfX3e7dBj7ftL+pqqOWsrcWnEm0TVNC3QrIQ1Lvq2SqmjQoRTKYzEmHKKXWjRORg==',key_name='tempest-keypair-2004802136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e22b7337cf864f039098d9ca369831ba',ramdisk_id='',reservation_id='r-c723o4i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-868661834',owner_user_name='tempest-TaggedBootDevicesTest-868661834-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='473bdd50c7eb455f943c2ea12fb22617',uuid=f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0747d143-a415-4448-acdb-11603f52e1af", "address": "fa:16:3e:fb:e2:b2", "network": {"id": "365a17fe-7226-41ad-a0ec-5ec5fbf09d02", "bridge": "br-int", "label": "tempest-device-tagging-net2-728655755", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0747d143-a4", "ovs_interfaceid": "0747d143-a415-4448-acdb-11603f52e1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Converting VIF {"id": "0747d143-a415-4448-acdb-11603f52e1af", "address": "fa:16:3e:fb:e2:b2", "network": {"id": "365a17fe-7226-41ad-a0ec-5ec5fbf09d02", "bridge": "br-int", "label": "tempest-device-tagging-net2-728655755", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0747d143-a4", "ovs_interfaceid": "0747d143-a415-4448-acdb-11603f52e1af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:e2:b2,bridge_name='br-int',has_traffic_filtering=True,id=0747d143-a415-4448-acdb-11603f52e1af,network=Network(365a17fe-7226-41ad-a0ec-5ec5fbf09d02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0747d143-a4') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG os_vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:e2:b2,bridge_name='br-int',has_traffic_filtering=True,id=0747d143-a415-4448-acdb-11603f52e1af,network=Network(365a17fe-7226-41ad-a0ec-5ec5fbf09d02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0747d143-a4') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0747d143-a4, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:20:46 user nova-compute[74980]: INFO os_vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:e2:b2,bridge_name='br-int',has_traffic_filtering=True,id=0747d143-a415-4448-acdb-11603f52e1af,network=Network(365a17fe-7226-41ad-a0ec-5ec5fbf09d02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0747d143-a4')
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354909366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354909366',id=12,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxe1rHspqW6e3orF4PDxOV9MgPQOVS3N2V9yfIfrtFUVwLKrcDvOQEwDrT+6GGRSizfX3e7dBj7ftL+pqqOWsrcWnEm0TVNC3QrIQ1Lvq2SqmjQoRTKYzEmHKKXWjRORg==',key_name='tempest-keypair-2004802136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e22b7337cf864f039098d9ca369831ba',ramdisk_id='',reservation_id='r-c723o4i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-868661834',owner_user_name='tempest-TaggedBootDevicesTest-868661834-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:19:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='473bdd50c7eb455f943c2ea12fb22617',uuid=f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abc62b54-e6f4-4980-a9a9-449ccacfa04f", "address": "fa:16:3e:75:ca:86", "network": {"id": "365a17fe-7226-41ad-a0ec-5ec5fbf09d02", "bridge": "br-int", "label": "tempest-device-tagging-net2-728655755", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc62b54-e6", "ovs_interfaceid": "abc62b54-e6f4-4980-a9a9-449ccacfa04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Converting VIF {"id": "abc62b54-e6f4-4980-a9a9-449ccacfa04f", "address": "fa:16:3e:75:ca:86", "network": {"id": "365a17fe-7226-41ad-a0ec-5ec5fbf09d02", "bridge": "br-int", "label": "tempest-device-tagging-net2-728655755", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e22b7337cf864f039098d9ca369831ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc62b54-e6", "ovs_interfaceid": "abc62b54-e6f4-4980-a9a9-449ccacfa04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:ca:86,bridge_name='br-int',has_traffic_filtering=True,id=abc62b54-e6f4-4980-a9a9-449ccacfa04f,network=Network(365a17fe-7226-41ad-a0ec-5ec5fbf09d02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc62b54-e6') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG os_vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:ca:86,bridge_name='br-int',has_traffic_filtering=True,id=abc62b54-e6f4-4980-a9a9-449ccacfa04f,network=Network(365a17fe-7226-41ad-a0ec-5ec5fbf09d02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc62b54-e6') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabc62b54-e6, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:20:46 user nova-compute[74980]: INFO os_vif [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:ca:86,bridge_name='br-int',has_traffic_filtering=True,id=abc62b54-e6f4-4980-a9a9-449ccacfa04f,network=Network(365a17fe-7226-41ad-a0ec-5ec5fbf09d02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc62b54-e6')
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Unplugged VIFs for instance {{(pid=74980) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.objects.instance [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Lazy-loading 'flavor' on Instance uuid 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Start waiting for the detach event from libvirt for device tap8ca932f4-4d with device alias net1 for instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-25fe92ff-260a-4fb1-9025-e45d1b84a56f tempest-VolumesAssistedSnapshotsTest-1193985801 tempest-VolumesAssistedSnapshotsTest-1193985801-project-admin] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.083s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-17a1fd57-53cb-4b6d-a97d-e88bf54879f5 req-e4a80fec-d2e2-43fe-87a8-b8ac30ee3c4f service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received event network-vif-unplugged-8ca932f4-4d4e-4481-970f-161340d7bccc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-17a1fd57-53cb-4b6d-a97d-e88bf54879f5 req-e4a80fec-d2e2-43fe-87a8-b8ac30ee3c4f service nova] Acquiring lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-17a1fd57-53cb-4b6d-a97d-e88bf54879f5 req-e4a80fec-d2e2-43fe-87a8-b8ac30ee3c4f service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-17a1fd57-53cb-4b6d-a97d-e88bf54879f5 req-e4a80fec-d2e2-43fe-87a8-b8ac30ee3c4f service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-17a1fd57-53cb-4b6d-a97d-e88bf54879f5 req-e4a80fec-d2e2-43fe-87a8-b8ac30ee3c4f service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] No waiting events found dispatching network-vif-unplugged-8ca932f4-4d4e-4481-970f-161340d7bccc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:46 user nova-compute[74980]: WARNING nova.compute.manager [req-17a1fd57-53cb-4b6d-a97d-e88bf54879f5 req-e4a80fec-d2e2-43fe-87a8-b8ac30ee3c4f service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received unexpected event network-vif-unplugged-8ca932f4-4d4e-4481-970f-161340d7bccc for instance with vm_state active and task_state None.
Nov 02 17:20:47 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 9ef84810-0506-4439-9302-72b239c8dddd is timed out.
Nov 02 17:20:47 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Successfully detached device sdc from instance 9ef84810-0506-4439-9302-72b239c8dddd from the live domain config.
Nov 02 17:20:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbKLXzYj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:20:47 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f181e1d-10b3-4f58-a0fa-750a05d8ff76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:20:47 user nova-compute[74980]: No targets found.
Nov 02 17:20:47 user nova-compute[74980]: iSNS:
Nov 02 17:20:47 user nova-compute[74980]: No targets found.
Nov 02 17:20:47 user nova-compute[74980]: STATIC:
Nov 02 17:20:47 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63
Nov 02 17:20:47 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:47 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:47 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f
Nov 02 17:20:47 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:47 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:47 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b
Nov 02 17:20:47 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:47 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:47 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe
Nov 02 17:20:47 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:47 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:47 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e
Nov 02 17:20:47 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:47 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:47 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098
Nov 02 17:20:47 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:20:47 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:20:47 user nova-compute[74980]: FIRMWARE:
Nov 02 17:20:47 user nova-compute[74980]: No targets found.
Nov 02 17:20:47 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:20:47 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:20:47 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f957aa-f51a-4faf-9400-2a7b72e35735]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc18774-2660-4a38-8722-616757757751]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e (non-flash)
Nov 02 17:20:47 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:47 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:47 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:47 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:47 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:20:47 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e (non-flash)
Nov 02 17:20:47 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:20:47 user nova-compute[74980]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f (non-flash)
Nov 02 17:20:47 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:20:47 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:20:47 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:20:47 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b41f0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f'): ({'sdf'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Removing single pathed devices sdf {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e759c2-7f5a-41a8-b633-f85b0e2e77b9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba71de9-2707-432b-bb52-c7b340ca8ae3]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Flushing IO for device /dev/sdf {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b517add4-1994-4507-823c-048b825eb300]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f75b72-f90c-4405-8984-42e73d91a26f]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] SCSI volumes sdf have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a343863-d847-47f3-b6f1-8fe1f7080f4a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d31a693-98a8-4488-90ab-f3f2d76f9dfa]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f, portal: 172.16.0.220,3260]
Nov 02 17:20:47 user nova-compute[74980]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f, portal: 172.16.0.220,3260] successful.
Nov 02 17:20:47 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3d65b1-96f4-4e4f-9d86-c2a0d967493f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c863d0-4eb2-4427-a37a-75f53d4f080e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] <== disconnect_volume: return (350ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:20:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:20:48 user nova-compute[74980]: DEBUG nova.objects.instance [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lazy-loading 'flavor' on Instance uuid 9ef84810-0506-4439-9302-72b239c8dddd {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:20:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-464e155d-8768-4999-b369-0fa01e846196 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "9ef84810-0506-4439-9302-72b239c8dddd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.033s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:48 user nova-compute[74980]: DEBUG nova.compute.manager [req-eeab0ec1-724a-4613-a0c3-018d58e7cebb req-c5877c59-8f9a-42f2-874b-250f9e79e6a1 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received event network-vif-plugged-8ca932f4-4d4e-4481-970f-161340d7bccc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-eeab0ec1-724a-4613-a0c3-018d58e7cebb req-c5877c59-8f9a-42f2-874b-250f9e79e6a1 service nova] Acquiring lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-eeab0ec1-724a-4613-a0c3-018d58e7cebb req-c5877c59-8f9a-42f2-874b-250f9e79e6a1 service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-eeab0ec1-724a-4613-a0c3-018d58e7cebb req-c5877c59-8f9a-42f2-874b-250f9e79e6a1 service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:48 user nova-compute[74980]: DEBUG nova.compute.manager [req-eeab0ec1-724a-4613-a0c3-018d58e7cebb req-c5877c59-8f9a-42f2-874b-250f9e79e6a1 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] No waiting events found dispatching network-vif-plugged-8ca932f4-4d4e-4481-970f-161340d7bccc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:48 user nova-compute[74980]: WARNING nova.compute.manager [req-eeab0ec1-724a-4613-a0c3-018d58e7cebb req-c5877c59-8f9a-42f2-874b-250f9e79e6a1 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received unexpected event network-vif-plugged-8ca932f4-4d4e-4481-970f-161340d7bccc for instance with vm_state active and task_state None.
Nov 02 17:20:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:49 user nova-compute[74980]: INFO nova.compute.manager [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Terminating instance
Nov 02 17:20:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:20:49 user nova-compute[74980]: INFO nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Took 3.10 seconds to deallocate network for instance.
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:49 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Instance destroyed successfully.
Nov 02 17:20:49 user nova-compute[74980]: DEBUG nova.objects.instance [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lazy-loading 'resources' on Instance uuid 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:18:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-803444856',display_name='tempest-ServersNegativeTestJSON-server-803444856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-803444856',id=10,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:19:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7978c159e5d431aba9762331de242f1',ramdisk_id='',reservation_id='r-exettqr4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1915471849',owner_user_name='tempest-ServersNegativeTestJSON-1915471849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:19:08Z,user_data=None,user_id='05186d8245f04cb19095cf71ee92f70b',uuid=8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2533a0ac-59e2-4487-956e-6d015258f4a4", "address": "fa:16:3e:76:46:1e", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2533a0ac-59", "ovs_interfaceid": "2533a0ac-59e2-4487-956e-6d015258f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Converting VIF {"id": "2533a0ac-59e2-4487-956e-6d015258f4a4", "address": "fa:16:3e:76:46:1e", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2533a0ac-59", "ovs_interfaceid": "2533a0ac-59e2-4487-956e-6d015258f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:46:1e,bridge_name='br-int',has_traffic_filtering=True,id=2533a0ac-59e2-4487-956e-6d015258f4a4,network=Network(e19b7ac0-cd44-4a92-8414-9f1a78021fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2533a0ac-59') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG os_vif [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:46:1e,bridge_name='br-int',has_traffic_filtering=True,id=2533a0ac-59e2-4487-956e-6d015258f4a4,network=Network(e19b7ac0-cd44-4a92-8414-9f1a78021fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2533a0ac-59') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2533a0ac-59, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Detaching volume: 3e8e2aeb-cd64-4a59-a963-049cd3f9fc6a {{(pid=74980) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 02 17:20:49 user nova-compute[74980]: INFO nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Detaching volume 3e8e2aeb-cd64-4a59-a963-049cd3f9fc6a
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=769c0601-669d-4bca-9452-b72934a11125) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:49 user nova-compute[74980]: INFO os_vif [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:46:1e,bridge_name='br-int',has_traffic_filtering=True,id=2533a0ac-59e2-4487-956e-6d015258f4a4,network=Network(e19b7ac0-cd44-4a92-8414-9f1a78021fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2533a0ac-59')
Nov 02 17:20:49 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Deleting instance files /opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd_del
Nov 02 17:20:49 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Deletion of /opt/stack/data/nova/instances/8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd_del complete
Nov 02 17:20:49 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Skipping driver_detach during remote rebuild. {{(pid=74980) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 02 17:20:49 user nova-compute[74980]: INFO nova.compute.manager [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 02 17:20:49 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "9ef84810-0506-4439-9302-72b239c8dddd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "9ef84810-0506-4439-9302-72b239c8dddd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "9ef84810-0506-4439-9302-72b239c8dddd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "9ef84810-0506-4439-9302-72b239c8dddd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "9ef84810-0506-4439-9302-72b239c8dddd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:49 user nova-compute[74980]: INFO nova.compute.manager [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Terminating instance
Nov 02 17:20:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:20:50 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Took 0.58 seconds to deallocate network for instance.
Nov 02 17:20:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:50 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Instance destroyed successfully.
Nov 02 17:20:50 user nova-compute[74980]: DEBUG nova.objects.instance [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lazy-loading 'resources' on Instance uuid 9ef84810-0506-4439-9302-72b239c8dddd {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-924999295',display_name='tempest-AttachSCSIVolumeTestJSON-server-924999295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-924999295',id=6,image_ref='8c68b031-691b-4379-8c2e-c7776b623872',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcsiz2ukAq9Wv4M/GBGxq1E7VWaPQdwLf13GaWNPNr8rYp6rN5NeNS/9Twg+eNHgDLL75EDTLMjw0WexUAIS0viFZOtH2nnHX4YswipGJ1J4eV1yP3ZyiiGK95+sYALTQ==',key_name='tempest-keypair-1440925866',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:17:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da5510f386174150b459057618f4d82a',ramdisk_id='',reservation_id='r-vsn8y5nh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8c68b031-691b-4379-8c2e-c7776b623872',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1465154663',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1465154663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:17:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b57eb271bb7e41d4a681668205f13fcc',uuid=9ef84810-0506-4439-9302-72b239c8dddd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9d93843-971c-477e-9e3a-f3065c32bf63", "address": "fa:16:3e:42:50:a7", "network": {"id": "77a350e1-e514-4d3b-889c-0b93f203d3a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-403711479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5510f386174150b459057618f4d82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d93843-97", "ovs_interfaceid": "d9d93843-971c-477e-9e3a-f3065c32bf63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Converting VIF {"id": "d9d93843-971c-477e-9e3a-f3065c32bf63", "address": "fa:16:3e:42:50:a7", "network": {"id": "77a350e1-e514-4d3b-889c-0b93f203d3a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-403711479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5510f386174150b459057618f4d82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d93843-97", "ovs_interfaceid": "d9d93843-971c-477e-9e3a-f3065c32bf63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:50:a7,bridge_name='br-int',has_traffic_filtering=True,id=d9d93843-971c-477e-9e3a-f3065c32bf63,network=Network(77a350e1-e514-4d3b-889c-0b93f203d3a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d93843-97') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG os_vif [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:50:a7,bridge_name='br-int',has_traffic_filtering=True,id=d9d93843-971c-477e-9e3a-f3065c32bf63,network=Network(77a350e1-e514-4d3b-889c-0b93f203d3a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d93843-97') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9d93843-97, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:50 user nova-compute[74980]: WARNING nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Failed to detach volume: 3e8e2aeb-cd64-4a59-a963-049cd3f9fc6a due to 'NoneType' object has no attribute 'devices'
Nov 02 17:20:50 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Detaching volume: 79077389-e2f5-4ab3-89d8-00ed8355065d {{(pid=74980) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 02 17:20:50 user nova-compute[74980]: INFO nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Detaching volume 79077389-e2f5-4ab3-89d8-00ed8355065d
Nov 02 17:20:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe28cf13-cdd5-4fca-a243-bcba0e8253ba) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:50 user nova-compute[74980]: INFO os_vif [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:50:a7,bridge_name='br-int',has_traffic_filtering=True,id=d9d93843-971c-477e-9e3a-f3065c32bf63,network=Network(77a350e1-e514-4d3b-889c-0b93f203d3a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d93843-97')
Nov 02 17:20:50 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Deleting instance files /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd_del
Nov 02 17:20:50 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Deletion of /opt/stack/data/nova/instances/9ef84810-0506-4439-9302-72b239c8dddd_del complete
Nov 02 17:20:50 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Skipping driver_detach during remote rebuild. {{(pid=74980) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 02 17:20:50 user nova-compute[74980]: INFO nova.compute.manager [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 02 17:20:50 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG nova.compute.manager [req-f01dfbe9-034a-43f1-b75e-e35cbcc859c3 req-7ca12417-5f53-42b5-9068-13afa15d0cbc service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Received event network-vif-unplugged-2533a0ac-59e2-4487-956e-6d015258f4a4 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f01dfbe9-034a-43f1-b75e-e35cbcc859c3 req-7ca12417-5f53-42b5-9068-13afa15d0cbc service nova] Acquiring lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f01dfbe9-034a-43f1-b75e-e35cbcc859c3 req-7ca12417-5f53-42b5-9068-13afa15d0cbc service nova] Lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f01dfbe9-034a-43f1-b75e-e35cbcc859c3 req-7ca12417-5f53-42b5-9068-13afa15d0cbc service nova] Lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG nova.compute.manager [req-f01dfbe9-034a-43f1-b75e-e35cbcc859c3 req-7ca12417-5f53-42b5-9068-13afa15d0cbc service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] No waiting events found dispatching network-vif-unplugged-2533a0ac-59e2-4487-956e-6d015258f4a4 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:50 user nova-compute[74980]: WARNING nova.compute.manager [req-f01dfbe9-034a-43f1-b75e-e35cbcc859c3 req-7ca12417-5f53-42b5-9068-13afa15d0cbc service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Received unexpected event network-vif-unplugged-2533a0ac-59e2-4487-956e-6d015258f4a4 for instance with vm_state deleted and task_state None.
Nov 02 17:20:50 user nova-compute[74980]: DEBUG nova.compute.manager [req-f01dfbe9-034a-43f1-b75e-e35cbcc859c3 req-7ca12417-5f53-42b5-9068-13afa15d0cbc service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Received event network-vif-plugged-2533a0ac-59e2-4487-956e-6d015258f4a4 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f01dfbe9-034a-43f1-b75e-e35cbcc859c3 req-7ca12417-5f53-42b5-9068-13afa15d0cbc service nova] Acquiring lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f01dfbe9-034a-43f1-b75e-e35cbcc859c3 req-7ca12417-5f53-42b5-9068-13afa15d0cbc service nova] Lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f01dfbe9-034a-43f1-b75e-e35cbcc859c3 req-7ca12417-5f53-42b5-9068-13afa15d0cbc service nova] Lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:50 user nova-compute[74980]: DEBUG nova.compute.manager [req-f01dfbe9-034a-43f1-b75e-e35cbcc859c3 req-7ca12417-5f53-42b5-9068-13afa15d0cbc service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] No waiting events found dispatching network-vif-plugged-2533a0ac-59e2-4487-956e-6d015258f4a4 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:50 user nova-compute[74980]: WARNING nova.compute.manager [req-f01dfbe9-034a-43f1-b75e-e35cbcc859c3 req-7ca12417-5f53-42b5-9068-13afa15d0cbc service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Received unexpected event network-vif-plugged-2533a0ac-59e2-4487-956e-6d015258f4a4 for instance with vm_state deleted and task_state None.
Nov 02 17:20:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.516s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:51 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Deleted allocations for instance 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd
Nov 02 17:20:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2db685ae-a7df-4eef-af82-69b2c1864b49 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.131s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:51 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:20:51 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Took 0.93 seconds to deallocate network for instance.
Nov 02 17:20:51 user nova-compute[74980]: WARNING nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Failed to detach volume: 79077389-e2f5-4ab3-89d8-00ed8355065d due to 'NoneType' object has no attribute 'devices'
Nov 02 17:20:51 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Detaching volume: 793aeaca-6c72-4a4e-9f0d-0a1161962175 {{(pid=74980) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 02 17:20:51 user nova-compute[74980]: INFO nova.compute.manager [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Detaching volume 793aeaca-6c72-4a4e-9f0d-0a1161962175
Nov 02 17:20:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:51 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] [instance: f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2] Skipping driver_detach during remote rebuild. {{(pid=74980) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 02 17:20:52 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Deleted allocations for instance f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2
Nov 02 17:20:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1331d386-f478-41a4-b4a0-3c9b4fa1ac39 tempest-TaggedBootDevicesTest-868661834 tempest-TaggedBootDevicesTest-868661834-project-member] Lock "f4ad8f93-d8a4-4f1a-9938-44133d6a8ae2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 107.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:52 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:20:52 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:20:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-12d26237-ee78-4578-8992-c8fea5f475b6 req-cdcbe7c6-9c27-45bd-82c9-c9e8f6af299f service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Received event network-vif-unplugged-d9d93843-971c-477e-9e3a-f3065c32bf63 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-12d26237-ee78-4578-8992-c8fea5f475b6 req-cdcbe7c6-9c27-45bd-82c9-c9e8f6af299f service nova] Acquiring lock "9ef84810-0506-4439-9302-72b239c8dddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-12d26237-ee78-4578-8992-c8fea5f475b6 req-cdcbe7c6-9c27-45bd-82c9-c9e8f6af299f service nova] Lock "9ef84810-0506-4439-9302-72b239c8dddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-12d26237-ee78-4578-8992-c8fea5f475b6 req-cdcbe7c6-9c27-45bd-82c9-c9e8f6af299f service nova] Lock "9ef84810-0506-4439-9302-72b239c8dddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-12d26237-ee78-4578-8992-c8fea5f475b6 req-cdcbe7c6-9c27-45bd-82c9-c9e8f6af299f service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] No waiting events found dispatching network-vif-unplugged-d9d93843-971c-477e-9e3a-f3065c32bf63 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:52 user nova-compute[74980]: WARNING nova.compute.manager [req-12d26237-ee78-4578-8992-c8fea5f475b6 req-cdcbe7c6-9c27-45bd-82c9-c9e8f6af299f service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Received unexpected event network-vif-unplugged-d9d93843-971c-477e-9e3a-f3065c32bf63 for instance with vm_state deleted and task_state None.
Nov 02 17:20:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-12d26237-ee78-4578-8992-c8fea5f475b6 req-cdcbe7c6-9c27-45bd-82c9-c9e8f6af299f service nova] [instance: 8d5dc7e5-39ff-4182-8c6d-6d9964f78ebd] Received event network-vif-deleted-2533a0ac-59e2-4487-956e-6d015258f4a4 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-12d26237-ee78-4578-8992-c8fea5f475b6 req-cdcbe7c6-9c27-45bd-82c9-c9e8f6af299f service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Received event network-vif-plugged-d9d93843-971c-477e-9e3a-f3065c32bf63 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-12d26237-ee78-4578-8992-c8fea5f475b6 req-cdcbe7c6-9c27-45bd-82c9-c9e8f6af299f service nova] Acquiring lock "9ef84810-0506-4439-9302-72b239c8dddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:20:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-12d26237-ee78-4578-8992-c8fea5f475b6 req-cdcbe7c6-9c27-45bd-82c9-c9e8f6af299f service nova] Lock "9ef84810-0506-4439-9302-72b239c8dddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:20:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-12d26237-ee78-4578-8992-c8fea5f475b6 req-cdcbe7c6-9c27-45bd-82c9-c9e8f6af299f service nova] Lock "9ef84810-0506-4439-9302-72b239c8dddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-12d26237-ee78-4578-8992-c8fea5f475b6 req-cdcbe7c6-9c27-45bd-82c9-c9e8f6af299f service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] No waiting events found dispatching network-vif-plugged-d9d93843-971c-477e-9e3a-f3065c32bf63 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:20:52 user nova-compute[74980]: WARNING nova.compute.manager [req-12d26237-ee78-4578-8992-c8fea5f475b6 req-cdcbe7c6-9c27-45bd-82c9-c9e8f6af299f service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Received unexpected event network-vif-plugged-d9d93843-971c-477e-9e3a-f3065c32bf63 for instance with vm_state deleted and task_state None.
Nov 02 17:20:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-12d26237-ee78-4578-8992-c8fea5f475b6 req-cdcbe7c6-9c27-45bd-82c9-c9e8f6af299f service nova] [instance: 9ef84810-0506-4439-9302-72b239c8dddd] Received event network-vif-deleted-d9d93843-971c-477e-9e3a-f3065c32bf63 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:20:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:52 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Deleted allocations for instance 9ef84810-0506-4439-9302-72b239c8dddd
Nov 02 17:20:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-18a454b3-2e6c-4a13-923f-91df4cb7c382 tempest-AttachSCSIVolumeTestJSON-1465154663 tempest-AttachSCSIVolumeTestJSON-1465154663-project-member] Lock "9ef84810-0506-4439-9302-72b239c8dddd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.476s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:20:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:20:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "1620c8eb-067c-4156-b927-2f64eac9e340" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "1620c8eb-067c-4156-b927-2f64eac9e340" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:21:00 user nova-compute[74980]: INFO nova.compute.claims [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Claim successful on node user
Nov 02 17:21:00 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:00 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:21:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG nova.policy [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e61d486aa0bf4b1fb4332aabfa5dafd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb10da584734aedb3d08879a4ffc2b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:21:00 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Creating image(s)
Nov 02 17:21:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "/opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "/opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "/opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk 1073741824" returned: 0 in 0.049s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Successfully created port: a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.194s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Cannot resize image /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Ensure instance console log exists: /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Successfully updated port: a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "refresh_cache-1620c8eb-067c-4156-b927-2f64eac9e340" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquired lock "refresh_cache-1620c8eb-067c-4156-b927-2f64eac9e340" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG nova.compute.manager [req-b222e3e0-3f6f-4813-b448-4bc609962245 req-fa782d86-c11a-481f-aef5-1a3c04fbccdc service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received event network-changed-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG nova.compute.manager [req-b222e3e0-3f6f-4813-b448-4bc609962245 req-fa782d86-c11a-481f-aef5-1a3c04fbccdc service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Refreshing instance network info cache due to event network-changed-a6485d81-59e2-4d5e-a060-fec023852f67. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:21:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b222e3e0-3f6f-4813-b448-4bc609962245 req-fa782d86-c11a-481f-aef5-1a3c04fbccdc service nova] Acquiring lock "refresh_cache-1620c8eb-067c-4156-b927-2f64eac9e340" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Updating instance_info_cache with network_info: [{"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Releasing lock "refresh_cache-1620c8eb-067c-4156-b927-2f64eac9e340" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Instance network_info: |[{"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b222e3e0-3f6f-4813-b448-4bc609962245 req-fa782d86-c11a-481f-aef5-1a3c04fbccdc service nova] Acquired lock "refresh_cache-1620c8eb-067c-4156-b927-2f64eac9e340" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.network.neutron [req-b222e3e0-3f6f-4813-b448-4bc609962245 req-fa782d86-c11a-481f-aef5-1a3c04fbccdc service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Refreshing network info cache for port a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Start _get_guest_xml network_info=[{"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:21:02 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:21:02 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1941433251',display_name='tempest-tempest.common.compute-instance-1941433251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1941433251',id=14,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/deb8PVkUiwTPZyCApz0Xe3J3eB/fIB0znwI8KF8qFCnRXvv+DwW74/YEGmM9BEGg6vomJjKMtQr16Ao4g8wl5z8W+UC6f7SOilkG+sjnacG9QOoRZHmSkFfpcffyx1g==',key_name='tempest-keypair-703289978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb10da584734aedb3d08879a4ffc2b2',ramdisk_id='',reservation_id='r-jetzfw31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-50427258',owner_user_name='tempest-ServerActionsTestOtherA-50427258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e61d486aa0bf4b1fb4332aabfa5dafd7',uuid=1620c8eb-067c-4156-b927-2f64eac9e340,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converting VIF {"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:60:a9,bridge_name='br-int',has_traffic_filtering=True,id=a6485d81-59e2-4d5e-a060-fec023852f67,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6485d81-59') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.objects.instance [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lazy-loading 'pci_devices' on Instance uuid 1620c8eb-067c-4156-b927-2f64eac9e340 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:21:02 user nova-compute[74980]:   <uuid>1620c8eb-067c-4156-b927-2f64eac9e340</uuid>
Nov 02 17:21:02 user nova-compute[74980]:   <name>instance-0000000e</name>
Nov 02 17:21:02 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:21:02 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:21:02 user nova-compute[74980]:   <metadata>
Nov 02 17:21:02 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:21:02 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:21:02 user nova-compute[74980]:       <nova:name>tempest-tempest.common.compute-instance-1941433251</nova:name>
Nov 02 17:21:02 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:21:02</nova:creationTime>
Nov 02 17:21:02 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:21:02 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:21:02 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:21:02 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:21:02 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:21:02 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:21:02 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:21:02 user nova-compute[74980]:       <nova:owner>
Nov 02 17:21:02 user nova-compute[74980]:         <nova:user uuid="e61d486aa0bf4b1fb4332aabfa5dafd7">tempest-ServerActionsTestOtherA-50427258-project-member</nova:user>
Nov 02 17:21:02 user nova-compute[74980]:         <nova:project uuid="7bb10da584734aedb3d08879a4ffc2b2">tempest-ServerActionsTestOtherA-50427258</nova:project>
Nov 02 17:21:02 user nova-compute[74980]:       </nova:owner>
Nov 02 17:21:02 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:21:02 user nova-compute[74980]:       <nova:ports>
Nov 02 17:21:02 user nova-compute[74980]:         <nova:port uuid="a6485d81-59e2-4d5e-a060-fec023852f67">
Nov 02 17:21:02 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 17:21:02 user nova-compute[74980]:         </nova:port>
Nov 02 17:21:02 user nova-compute[74980]:       </nova:ports>
Nov 02 17:21:02 user nova-compute[74980]:     </nova:instance>
Nov 02 17:21:02 user nova-compute[74980]:   </metadata>
Nov 02 17:21:02 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:21:02 user nova-compute[74980]:     <system>
Nov 02 17:21:02 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:21:02 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:21:02 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:21:02 user nova-compute[74980]:       <entry name="serial">1620c8eb-067c-4156-b927-2f64eac9e340</entry>
Nov 02 17:21:02 user nova-compute[74980]:       <entry name="uuid">1620c8eb-067c-4156-b927-2f64eac9e340</entry>
Nov 02 17:21:02 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:21:02 user nova-compute[74980]:     </system>
Nov 02 17:21:02 user nova-compute[74980]:   </sysinfo>
Nov 02 17:21:02 user nova-compute[74980]:   <os>
Nov 02 17:21:02 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:21:02 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:21:02 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:21:02 user nova-compute[74980]:   </os>
Nov 02 17:21:02 user nova-compute[74980]:   <features>
Nov 02 17:21:02 user nova-compute[74980]:     <acpi/>
Nov 02 17:21:02 user nova-compute[74980]:     <apic/>
Nov 02 17:21:02 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:21:02 user nova-compute[74980]:   </features>
Nov 02 17:21:02 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:21:02 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:21:02 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:21:02 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:21:02 user nova-compute[74980]:   </clock>
Nov 02 17:21:02 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:21:02 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:21:02 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:21:02 user nova-compute[74980]:   </cpu>
Nov 02 17:21:02 user nova-compute[74980]:   <devices>
Nov 02 17:21:02 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:21:02 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:21:02 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk"/>
Nov 02 17:21:02 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:21:02 user nova-compute[74980]:     </disk>
Nov 02 17:21:02 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:21:02 user nova-compute[74980]:       <mac address="fa:16:3e:2a:60:a9"/>
Nov 02 17:21:02 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:21:02 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:21:02 user nova-compute[74980]:       <target dev="tapa6485d81-59"/>
Nov 02 17:21:02 user nova-compute[74980]:     </interface>
Nov 02 17:21:02 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:21:02 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/console.log" append="off"/>
Nov 02 17:21:02 user nova-compute[74980]:     </serial>
Nov 02 17:21:02 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:21:02 user nova-compute[74980]:     <video>
Nov 02 17:21:02 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:21:02 user nova-compute[74980]:     </video>
Nov 02 17:21:02 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:21:02 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:21:02 user nova-compute[74980]:     </rng>
Nov 02 17:21:02 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:21:02 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:21:02 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:21:02 user nova-compute[74980]:     </memballoon>
Nov 02 17:21:02 user nova-compute[74980]:   </devices>
Nov 02 17:21:02 user nova-compute[74980]: </domain>
Nov 02 17:21:02 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1941433251',display_name='tempest-tempest.common.compute-instance-1941433251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1941433251',id=14,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/deb8PVkUiwTPZyCApz0Xe3J3eB/fIB0znwI8KF8qFCnRXvv+DwW74/YEGmM9BEGg6vomJjKMtQr16Ao4g8wl5z8W+UC6f7SOilkG+sjnacG9QOoRZHmSkFfpcffyx1g==',key_name='tempest-keypair-703289978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb10da584734aedb3d08879a4ffc2b2',ramdisk_id='',reservation_id='r-jetzfw31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-50427258',owner_user_name='tempest-ServerActionsTestOtherA-50427258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e61d486aa0bf4b1fb4332aabfa5dafd7',uuid=1620c8eb-067c-4156-b927-2f64eac9e340,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converting VIF {"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:60:a9,bridge_name='br-int',has_traffic_filtering=True,id=a6485d81-59e2-4d5e-a060-fec023852f67,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6485d81-59') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG os_vif [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:60:a9,bridge_name='br-int',has_traffic_filtering=True,id=a6485d81-59e2-4d5e-a060-fec023852f67,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6485d81-59') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36aa55ad-2322-5c34-8525-458d09db6dc6', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6485d81-59, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6485d81-59, col_values=(('qos', UUID('b73ae320-512c-49d4-bd1d-4621b0d4446a')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6485d81-59, col_values=(('external_ids', {'iface-id': 'a6485d81-59e2-4d5e-a060-fec023852f67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:60:a9', 'vm-uuid': '1620c8eb-067c-4156-b927-2f64eac9e340'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:02 user nova-compute[74980]: INFO os_vif [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:60:a9,bridge_name='br-int',has_traffic_filtering=True,id=a6485d81-59e2-4d5e-a060-fec023852f67,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6485d81-59')
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] No VIF found with MAC fa:16:3e:2a:60:a9, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.network.neutron [req-b222e3e0-3f6f-4813-b448-4bc609962245 req-fa782d86-c11a-481f-aef5-1a3c04fbccdc service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Updated VIF entry in instance network info cache for port a6485d81-59e2-4d5e-a060-fec023852f67. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG nova.network.neutron [req-b222e3e0-3f6f-4813-b448-4bc609962245 req-fa782d86-c11a-481f-aef5-1a3c04fbccdc service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Updating instance_info_cache with network_info: [{"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b222e3e0-3f6f-4813-b448-4bc609962245 req-fa782d86-c11a-481f-aef5-1a3c04fbccdc service nova] Releasing lock "refresh_cache-1620c8eb-067c-4156-b927-2f64eac9e340" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-0adc56d4-ce45-4e12-83ff-3b51ae7350ca req-f79f1b5e-9881-4057-a634-0526ada6db16 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received event network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0adc56d4-ce45-4e12-83ff-3b51ae7350ca req-f79f1b5e-9881-4057-a634-0526ada6db16 service nova] Acquiring lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0adc56d4-ce45-4e12-83ff-3b51ae7350ca req-f79f1b5e-9881-4057-a634-0526ada6db16 service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0adc56d4-ce45-4e12-83ff-3b51ae7350ca req-f79f1b5e-9881-4057-a634-0526ada6db16 service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-0adc56d4-ce45-4e12-83ff-3b51ae7350ca req-f79f1b5e-9881-4057-a634-0526ada6db16 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] No waiting events found dispatching network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:03 user nova-compute[74980]: WARNING nova.compute.manager [req-0adc56d4-ce45-4e12-83ff-3b51ae7350ca req-f79f1b5e-9881-4057-a634-0526ada6db16 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received unexpected event network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 for instance with vm_state building and task_state spawning.
Nov 02 17:21:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:05 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1154d1f9-80b8-405b-8fd8-c10bb39c507f is timed out.
Nov 02 17:21:05 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Successfully detached device vdb from instance 1154d1f9-80b8-405b-8fd8-c10bb39c507f from the live domain config.
Nov 02 17:21:05 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GPusyTlL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:21:05 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[03329c12-70de-4ba3-b3cc-9474fc1396a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:21:05 user nova-compute[74980]: No targets found.
Nov 02 17:21:05 user nova-compute[74980]: iSNS:
Nov 02 17:21:05 user nova-compute[74980]: No targets found.
Nov 02 17:21:05 user nova-compute[74980]: STATIC:
Nov 02 17:21:05 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63
Nov 02 17:21:05 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:05 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:05 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b
Nov 02 17:21:05 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:05 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:05 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe
Nov 02 17:21:05 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:05 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:05 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e
Nov 02 17:21:05 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:05 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:05 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098
Nov 02 17:21:05 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:05 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:05 user nova-compute[74980]: FIRMWARE:
Nov 02 17:21:05 user nova-compute[74980]: No targets found.
Nov 02 17:21:05 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:21:05 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:21:05 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[622bbafa-ae7c-494a-9ec4-7d006885a78b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[600c99fd-6ba8-476d-aa54-b65189eaa0e5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e (non-flash)
Nov 02 17:21:05 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:05 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:21:05 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:05 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:21:05 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e (non-flash)
Nov 02 17:21:05 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:05 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:21:05 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:05 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:21:05 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b46adfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e'): ({'sdi'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Removing single pathed devices sdi {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec4358c-290c-4afd-bf02-b1e334d5439a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcf0f03-06db-4db9-98a1-45bed1af6334]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Flushing IO for device /dev/sdi {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1b1c7a-b8d7-4cbb-98fb-baa4537bdb08]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9eb2f7-e03d-4257-bee6-65bf6bd28389]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] SCSI volumes sdi have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[60427fce-f75e-45a0-8181-d0774fd341a7]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e41a15-a343-411b-9f0e-d7be61d05cfc]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e, portal: 172.16.0.220,3260]
Nov 02 17:21:05 user nova-compute[74980]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e, portal: 172.16.0.220,3260] successful.
Nov 02 17:21:05 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb31fd4d-2af7-47c3-ba6b-a4b3ad982f3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce6263e-5dfb-40df-af1b-5535cfd923a9]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] <== disconnect_volume: return (385ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-d66ae816-5dcf-4141-b39c-b4607293aa40 req-03868fad-1793-42ab-bcce-04ed9ef91a10 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received event network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d66ae816-5dcf-4141-b39c-b4607293aa40 req-03868fad-1793-42ab-bcce-04ed9ef91a10 service nova] Acquiring lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d66ae816-5dcf-4141-b39c-b4607293aa40 req-03868fad-1793-42ab-bcce-04ed9ef91a10 service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d66ae816-5dcf-4141-b39c-b4607293aa40 req-03868fad-1793-42ab-bcce-04ed9ef91a10 service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-d66ae816-5dcf-4141-b39c-b4607293aa40 req-03868fad-1793-42ab-bcce-04ed9ef91a10 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] No waiting events found dispatching network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:06 user nova-compute[74980]: WARNING nova.compute.manager [req-d66ae816-5dcf-4141-b39c-b4607293aa40 req-03868fad-1793-42ab-bcce-04ed9ef91a10 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received unexpected event network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 for instance with vm_state building and task_state spawning.
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Instance spawned successfully.
Nov 02 17:21:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:06 user nova-compute[74980]: INFO nova.compute.manager [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:06 user nova-compute[74980]: INFO nova.compute.manager [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Took 6.44 seconds to build instance.
Nov 02 17:21:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2851d939-ebc1-4651-9013-d5ccd7b1ff5b tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "1620c8eb-067c-4156-b927-2f64eac9e340" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.538s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:06 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Waiting for libvirt event about the detach of device tap8ca932f4-4d with device alias net1 from instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d is timed out.
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:c0:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap8ca932f4-4d"/></interface> {{(pid=74980) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e5:c0:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap8ca932f4-4d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 02 17:21:06 user nova-compute[74980]:   <name>instance-00000007</name>
Nov 02 17:21:06 user nova-compute[74980]:   <uuid>aeae0fe6-ffc2-48f7-8b59-c6485851be3d</uuid>
Nov 02 17:21:06 user nova-compute[74980]:   <metadata>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:21:06 user nova-compute[74980]:   <nova:package version="0.0.0"/>
Nov 02 17:21:06 user nova-compute[74980]:   <nova:name>tempest-device-tagging-server-1956055295</nova:name>
Nov 02 17:21:06 user nova-compute[74980]:   <nova:creationTime>2023-11-02 17:19:34</nova:creationTime>
Nov 02 17:21:06 user nova-compute[74980]:   <nova:flavor name="m1.tiny">
Nov 02 17:21:06 user nova-compute[74980]:     <nova:memory>512</nova:memory>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:disk>1</nova:disk>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:swap>0</nova:swap>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:vcpus>1</nova:vcpus>
Nov 02 17:21:06 user nova-compute[74980]:   </nova:flavor>
Nov 02 17:21:06 user nova-compute[74980]:   <nova:owner>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:user uuid="59c1bf383d2a48449244708dea3cd95b">tempest-TaggedAttachmentsTest-2126535582-project-member</nova:user>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:project uuid="061cfdc41fc64eea9bd281d8c51424c8">tempest-TaggedAttachmentsTest-2126535582</nova:project>
Nov 02 17:21:06 user nova-compute[74980]:   </nova:owner>
Nov 02 17:21:06 user nova-compute[74980]:   <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:21:06 user nova-compute[74980]:   <nova:ports>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:port uuid="7434f94a-713e-4434-9262-8da6a26d4006">
Nov 02 17:21:06 user nova-compute[74980]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 17:21:06 user nova-compute[74980]:     </nova:port>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:port uuid="8ca932f4-4d4e-4481-970f-161340d7bccc">
Nov 02 17:21:06 user nova-compute[74980]:       <nova:ip type="fixed" address="10.10.10.199" ipVersion="4"/>
Nov 02 17:21:06 user nova-compute[74980]:     </nova:port>
Nov 02 17:21:06 user nova-compute[74980]:   </nova:ports>
Nov 02 17:21:06 user nova-compute[74980]: </nova:instance>
Nov 02 17:21:06 user nova-compute[74980]:   </metadata>
Nov 02 17:21:06 user nova-compute[74980]:   <memory unit='KiB'>524288</memory>
Nov 02 17:21:06 user nova-compute[74980]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 17:21:06 user nova-compute[74980]:   <vcpu placement='static'>1</vcpu>
Nov 02 17:21:06 user nova-compute[74980]:   <resource>
Nov 02 17:21:06 user nova-compute[74980]:     <partition>/machine</partition>
Nov 02 17:21:06 user nova-compute[74980]:   </resource>
Nov 02 17:21:06 user nova-compute[74980]:   <sysinfo type='smbios'>
Nov 02 17:21:06 user nova-compute[74980]:     <system>
Nov 02 17:21:06 user nova-compute[74980]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 17:21:06 user nova-compute[74980]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 17:21:06 user nova-compute[74980]:       <entry name='version'>0.0.0</entry>
Nov 02 17:21:06 user nova-compute[74980]:       <entry name='serial'>aeae0fe6-ffc2-48f7-8b59-c6485851be3d</entry>
Nov 02 17:21:06 user nova-compute[74980]:       <entry name='uuid'>aeae0fe6-ffc2-48f7-8b59-c6485851be3d</entry>
Nov 02 17:21:06 user nova-compute[74980]:       <entry name='family'>Virtual Machine</entry>
Nov 02 17:21:06 user nova-compute[74980]:     </system>
Nov 02 17:21:06 user nova-compute[74980]:   </sysinfo>
Nov 02 17:21:06 user nova-compute[74980]:   <os>
Nov 02 17:21:06 user nova-compute[74980]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 17:21:06 user nova-compute[74980]:     <boot dev='hd'/>
Nov 02 17:21:06 user nova-compute[74980]:     <smbios mode='sysinfo'/>
Nov 02 17:21:06 user nova-compute[74980]:   </os>
Nov 02 17:21:06 user nova-compute[74980]:   <features>
Nov 02 17:21:06 user nova-compute[74980]:     <acpi/>
Nov 02 17:21:06 user nova-compute[74980]:     <apic/>
Nov 02 17:21:06 user nova-compute[74980]:     <vmcoreinfo state='on'/>
Nov 02 17:21:06 user nova-compute[74980]:   </features>
Nov 02 17:21:06 user nova-compute[74980]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 17:21:06 user nova-compute[74980]:     <model fallback='forbid'>Nehalem</model>
Nov 02 17:21:06 user nova-compute[74980]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 17:21:06 user nova-compute[74980]:     <feature policy='require' name='vme'/>
Nov 02 17:21:06 user nova-compute[74980]:     <feature policy='require' name='x2apic'/>
Nov 02 17:21:06 user nova-compute[74980]:     <feature policy='require' name='hypervisor'/>
Nov 02 17:21:06 user nova-compute[74980]:   </cpu>
Nov 02 17:21:06 user nova-compute[74980]:   <clock offset='utc'>
Nov 02 17:21:06 user nova-compute[74980]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 17:21:06 user nova-compute[74980]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 17:21:06 user nova-compute[74980]:     <timer name='hpet' present='no'/>
Nov 02 17:21:06 user nova-compute[74980]:   </clock>
Nov 02 17:21:06 user nova-compute[74980]:   <on_poweroff>destroy</on_poweroff>
Nov 02 17:21:06 user nova-compute[74980]:   <on_reboot>restart</on_reboot>
Nov 02 17:21:06 user nova-compute[74980]:   <on_crash>destroy</on_crash>
Nov 02 17:21:06 user nova-compute[74980]:   <devices>
Nov 02 17:21:06 user nova-compute[74980]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 17:21:06 user nova-compute[74980]:     <disk type='file' device='disk'>
Nov 02 17:21:06 user nova-compute[74980]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 17:21:06 user nova-compute[74980]:       <source file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk' index='2'/>
Nov 02 17:21:06 user nova-compute[74980]:       <backingStore type='file' index='3'>
Nov 02 17:21:06 user nova-compute[74980]:         <format type='raw'/>
Nov 02 17:21:06 user nova-compute[74980]:         <source file='/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666'/>
Nov 02 17:21:06 user nova-compute[74980]:         <backingStore/>
Nov 02 17:21:06 user nova-compute[74980]:       </backingStore>
Nov 02 17:21:06 user nova-compute[74980]:       <target dev='vda' bus='virtio'/>
Nov 02 17:21:06 user nova-compute[74980]:       <alias name='virtio-disk0'/>
Nov 02 17:21:06 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 17:21:06 user nova-compute[74980]:     </disk>
Nov 02 17:21:06 user nova-compute[74980]:     <disk type='file' device='cdrom'>
Nov 02 17:21:06 user nova-compute[74980]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 17:21:06 user nova-compute[74980]:       <source file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk.config' index='1'/>
Nov 02 17:21:06 user nova-compute[74980]:       <backingStore/>
Nov 02 17:21:06 user nova-compute[74980]:       <target dev='hda' bus='ide'/>
Nov 02 17:21:06 user nova-compute[74980]:       <readonly/>
Nov 02 17:21:06 user nova-compute[74980]:       <alias name='ide0-0-0'/>
Nov 02 17:21:06 user nova-compute[74980]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 17:21:06 user nova-compute[74980]:     </disk>
Nov 02 17:21:06 user nova-compute[74980]:     <controller type='usb' index='0' model='none'>
Nov 02 17:21:06 user nova-compute[74980]:       <alias name='usb'/>
Nov 02 17:21:06 user nova-compute[74980]:     </controller>
Nov 02 17:21:06 user nova-compute[74980]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 17:21:06 user nova-compute[74980]:       <alias name='pci.0'/>
Nov 02 17:21:06 user nova-compute[74980]:     </controller>
Nov 02 17:21:06 user nova-compute[74980]:     <controller type='ide' index='0'>
Nov 02 17:21:06 user nova-compute[74980]:       <alias name='ide'/>
Nov 02 17:21:06 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 17:21:06 user nova-compute[74980]:     </controller>
Nov 02 17:21:06 user nova-compute[74980]:     <interface type='ethernet'>
Nov 02 17:21:06 user nova-compute[74980]:       <mac address='fa:16:3e:d3:89:3a'/>
Nov 02 17:21:06 user nova-compute[74980]:       <target dev='tap7434f94a-71'/>
Nov 02 17:21:06 user nova-compute[74980]:       <model type='virtio'/>
Nov 02 17:21:06 user nova-compute[74980]:       <mtu size='1442'/>
Nov 02 17:21:06 user nova-compute[74980]:       <alias name='net0'/>
Nov 02 17:21:06 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 17:21:06 user nova-compute[74980]:     </interface>
Nov 02 17:21:06 user nova-compute[74980]:     <serial type='pty'>
Nov 02 17:21:06 user nova-compute[74980]:       <source path='/dev/pts/6'/>
Nov 02 17:21:06 user nova-compute[74980]:       <log file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/console.log' append='off'/>
Nov 02 17:21:06 user nova-compute[74980]:       <target type='isa-serial' port='0'>
Nov 02 17:21:06 user nova-compute[74980]:         <model name='isa-serial'/>
Nov 02 17:21:06 user nova-compute[74980]:       </target>
Nov 02 17:21:06 user nova-compute[74980]:       <alias name='serial0'/>
Nov 02 17:21:06 user nova-compute[74980]:     </serial>
Nov 02 17:21:06 user nova-compute[74980]:     <console type='pty' tty='/dev/pts/6'>
Nov 02 17:21:06 user nova-compute[74980]:       <source path='/dev/pts/6'/>
Nov 02 17:21:06 user nova-compute[74980]:       <log file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/console.log' append='off'/>
Nov 02 17:21:06 user nova-compute[74980]:       <target type='serial' port='0'/>
Nov 02 17:21:06 user nova-compute[74980]:       <alias name='serial0'/>
Nov 02 17:21:06 user nova-compute[74980]:     </console>
Nov 02 17:21:06 user nova-compute[74980]:     <input type='mouse' bus='ps2'>
Nov 02 17:21:06 user nova-compute[74980]:       <alias name='input0'/>
Nov 02 17:21:06 user nova-compute[74980]:     </input>
Nov 02 17:21:06 user nova-compute[74980]:     <input type='keyboard' bus='ps2'>
Nov 02 17:21:06 user nova-compute[74980]:       <alias name='input1'/>
Nov 02 17:21:06 user nova-compute[74980]:     </input>
Nov 02 17:21:06 user nova-compute[74980]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 02 17:21:06 user nova-compute[74980]:       <listen type='address' address='0.0.0.0'/>
Nov 02 17:21:06 user nova-compute[74980]:     </graphics>
Nov 02 17:21:06 user nova-compute[74980]:     <audio id='1' type='none'/>
Nov 02 17:21:06 user nova-compute[74980]:     <video>
Nov 02 17:21:06 user nova-compute[74980]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 17:21:06 user nova-compute[74980]:       <alias name='video0'/>
Nov 02 17:21:06 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 17:21:06 user nova-compute[74980]:     </video>
Nov 02 17:21:06 user nova-compute[74980]:     <memballoon model='virtio'>
Nov 02 17:21:06 user nova-compute[74980]:       <stats period='10'/>
Nov 02 17:21:06 user nova-compute[74980]:       <alias name='balloon0'/>
Nov 02 17:21:06 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 17:21:06 user nova-compute[74980]:     </memballoon>
Nov 02 17:21:06 user nova-compute[74980]:     <rng model='virtio'>
Nov 02 17:21:06 user nova-compute[74980]:       <backend model='random'>/dev/urandom</backend>
Nov 02 17:21:06 user nova-compute[74980]:       <alias name='rng0'/>
Nov 02 17:21:06 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 17:21:06 user nova-compute[74980]:     </rng>
Nov 02 17:21:06 user nova-compute[74980]:   </devices>
Nov 02 17:21:06 user nova-compute[74980]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 17:21:06 user nova-compute[74980]:     <label>libvirt-aeae0fe6-ffc2-48f7-8b59-c6485851be3d</label>
Nov 02 17:21:06 user nova-compute[74980]:     <imagelabel>libvirt-aeae0fe6-ffc2-48f7-8b59-c6485851be3d</imagelabel>
Nov 02 17:21:06 user nova-compute[74980]:   </seclabel>
Nov 02 17:21:06 user nova-compute[74980]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 17:21:06 user nova-compute[74980]:     <label>+64055:+108</label>
Nov 02 17:21:06 user nova-compute[74980]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 17:21:06 user nova-compute[74980]:   </seclabel>
Nov 02 17:21:06 user nova-compute[74980]: </domain>
Nov 02 17:21:06 user nova-compute[74980]:  {{(pid=74980) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 17:21:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Successfully detached device tap8ca932f4-4d from instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d from the live domain config.
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1956055295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1956055295',id=7,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxrQckQxr69xMzJYNTLEjM/WTe1wsExTJezKCnbJ7jnYlT8mZTga0YewAJ2OnZA6lwf50l3CWjDefeId4ykNOk9L89xqNa/3p6b4bQjrJI1+UpsUWudVowdG28U6uyqAA==',key_name='tempest-keypair-347748516',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='061cfdc41fc64eea9bd281d8c51424c8',ramdisk_id='',reservation_id='r-qbp9xyqq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2126535582',owner_user_name='tempest-TaggedAttachmentsTest-2126535582-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59c1bf383d2a48449244708dea3cd95b',uuid=aeae0fe6-ffc2-48f7-8b59-c6485851be3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ca932f4-4d4e-4481-970f-161340d7bccc", "address": "fa:16:3e:e5:c0:c9", "network": {"id": "7e642d05-f3e4-4a5e-b251-eb51e2525ef9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870506038", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca932f4-4d", "ovs_interfaceid": "8ca932f4-4d4e-4481-970f-161340d7bccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Converting VIF {"id": "8ca932f4-4d4e-4481-970f-161340d7bccc", "address": "fa:16:3e:e5:c0:c9", "network": {"id": "7e642d05-f3e4-4a5e-b251-eb51e2525ef9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870506038", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca932f4-4d", "ovs_interfaceid": "8ca932f4-4d4e-4481-970f-161340d7bccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c0:c9,bridge_name='br-int',has_traffic_filtering=True,id=8ca932f4-4d4e-4481-970f-161340d7bccc,network=Network(7e642d05-f3e4-4a5e-b251-eb51e2525ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca932f4-4d') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG os_vif [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c0:c9,bridge_name='br-int',has_traffic_filtering=True,id=8ca932f4-4d4e-4481-970f-161340d7bccc,network=Network(7e642d05-f3e4-4a5e-b251-eb51e2525ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca932f4-4d') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ca932f4-4d, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f22d50d-567d-4e08-8cc5-21e7ee61f975) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:06 user nova-compute[74980]: INFO os_vif [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c0:c9,bridge_name='br-int',has_traffic_filtering=True,id=8ca932f4-4d4e-4481-970f-161340d7bccc,network=Network(7e642d05-f3e4-4a5e-b251-eb51e2525ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca932f4-4d')
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:21:06 user nova-compute[74980]:   <nova:package version="0.0.0"/>
Nov 02 17:21:06 user nova-compute[74980]:   <nova:name>tempest-device-tagging-server-1956055295</nova:name>
Nov 02 17:21:06 user nova-compute[74980]:   <nova:creationTime>2023-11-02 17:21:06</nova:creationTime>
Nov 02 17:21:06 user nova-compute[74980]:   <nova:flavor name="m1.tiny">
Nov 02 17:21:06 user nova-compute[74980]:     <nova:memory>512</nova:memory>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:disk>1</nova:disk>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:swap>0</nova:swap>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:vcpus>1</nova:vcpus>
Nov 02 17:21:06 user nova-compute[74980]:   </nova:flavor>
Nov 02 17:21:06 user nova-compute[74980]:   <nova:owner>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:user uuid="59c1bf383d2a48449244708dea3cd95b">tempest-TaggedAttachmentsTest-2126535582-project-member</nova:user>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:project uuid="061cfdc41fc64eea9bd281d8c51424c8">tempest-TaggedAttachmentsTest-2126535582</nova:project>
Nov 02 17:21:06 user nova-compute[74980]:   </nova:owner>
Nov 02 17:21:06 user nova-compute[74980]:   <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:21:06 user nova-compute[74980]:   <nova:ports>
Nov 02 17:21:06 user nova-compute[74980]:     <nova:port uuid="7434f94a-713e-4434-9262-8da6a26d4006">
Nov 02 17:21:06 user nova-compute[74980]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 17:21:06 user nova-compute[74980]:     </nova:port>
Nov 02 17:21:06 user nova-compute[74980]:   </nova:ports>
Nov 02 17:21:06 user nova-compute[74980]: </nova:instance>
Nov 02 17:21:06 user nova-compute[74980]:  {{(pid=74980) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG nova.objects.instance [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lazy-loading 'flavor' on Instance uuid 1154d1f9-80b8-405b-8fd8-c10bb39c507f {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5f6f2e9c-427c-4d35-99b4-24790a9ca90b tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.974s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.compute.manager [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received event network-vif-deleted-8ca932f4-4d4e-4481-970f-161340d7bccc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:07 user nova-compute[74980]: INFO nova.compute.manager [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Neutron deleted interface 8ca932f4-4d4e-4481-970f-161340d7bccc; detaching it from the instance and deleting it from the info cache
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.network.neutron [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Updating instance_info_cache with network_info: [{"id": "7434f94a-713e-4434-9262-8da6a26d4006", "address": "fa:16:3e:d3:89:3a", "network": {"id": "6f6330e7-ef7b-4457-a97b-798bb8365964", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-523904489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7434f94a-71", "ovs_interfaceid": "7434f94a-713e-4434-9262-8da6a26d4006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.objects.instance [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] Lazy-loading 'system_metadata' on Instance uuid aeae0fe6-ffc2-48f7-8b59-c6485851be3d {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquired lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.network.neutron [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.objects.instance [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] Lazy-loading 'flavor' on Instance uuid aeae0fe6-ffc2-48f7-8b59-c6485851be3d {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.objects.base [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] Object Instance<aeae0fe6-ffc2-48f7-8b59-c6485851be3d> lazy-loaded attributes: system_metadata,flavor {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1956055295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1956055295',id=7,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxrQckQxr69xMzJYNTLEjM/WTe1wsExTJezKCnbJ7jnYlT8mZTga0YewAJ2OnZA6lwf50l3CWjDefeId4ykNOk9L89xqNa/3p6b4bQjrJI1+UpsUWudVowdG28U6uyqAA==',key_name='tempest-keypair-347748516',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='061cfdc41fc64eea9bd281d8c51424c8',ramdisk_id='',reservation_id='r-qbp9xyqq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2126535582',owner_user_name='tempest-TaggedAttachmentsTest-2126535582-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59c1bf383d2a48449244708dea3cd95b',uuid=aeae0fe6-ffc2-48f7-8b59-c6485851be3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ca932f4-4d4e-4481-970f-161340d7bccc", "address": "fa:16:3e:e5:c0:c9", "network": {"id": "7e642d05-f3e4-4a5e-b251-eb51e2525ef9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870506038", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca932f4-4d", "ovs_interfaceid": "8ca932f4-4d4e-4481-970f-161340d7bccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.network.os_vif_util [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] Converting VIF {"id": "8ca932f4-4d4e-4481-970f-161340d7bccc", "address": "fa:16:3e:e5:c0:c9", "network": {"id": "7e642d05-f3e4-4a5e-b251-eb51e2525ef9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870506038", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca932f4-4d", "ovs_interfaceid": "8ca932f4-4d4e-4481-970f-161340d7bccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.network.os_vif_util [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c0:c9,bridge_name='br-int',has_traffic_filtering=True,id=8ca932f4-4d4e-4481-970f-161340d7bccc,network=Network(7e642d05-f3e4-4a5e-b251-eb51e2525ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca932f4-4d') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:c0:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap8ca932f4-4d"/></interface> {{(pid=74980) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e5:c0:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap8ca932f4-4d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 02 17:21:07 user nova-compute[74980]:   <name>instance-00000007</name>
Nov 02 17:21:07 user nova-compute[74980]:   <uuid>aeae0fe6-ffc2-48f7-8b59-c6485851be3d</uuid>
Nov 02 17:21:07 user nova-compute[74980]:   <metadata>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:21:07 user nova-compute[74980]:   <nova:package version="0.0.0"/>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:name>tempest-device-tagging-server-1956055295</nova:name>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:creationTime>2023-11-02 17:21:06</nova:creationTime>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:flavor name="m1.tiny">
Nov 02 17:21:07 user nova-compute[74980]:     <nova:memory>512</nova:memory>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:disk>1</nova:disk>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:swap>0</nova:swap>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:vcpus>1</nova:vcpus>
Nov 02 17:21:07 user nova-compute[74980]:   </nova:flavor>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:owner>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:user uuid="59c1bf383d2a48449244708dea3cd95b">tempest-TaggedAttachmentsTest-2126535582-project-member</nova:user>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:project uuid="061cfdc41fc64eea9bd281d8c51424c8">tempest-TaggedAttachmentsTest-2126535582</nova:project>
Nov 02 17:21:07 user nova-compute[74980]:   </nova:owner>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:ports>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:port uuid="7434f94a-713e-4434-9262-8da6a26d4006">
Nov 02 17:21:07 user nova-compute[74980]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 17:21:07 user nova-compute[74980]:     </nova:port>
Nov 02 17:21:07 user nova-compute[74980]:   </nova:ports>
Nov 02 17:21:07 user nova-compute[74980]: </nova:instance>
Nov 02 17:21:07 user nova-compute[74980]:   </metadata>
Nov 02 17:21:07 user nova-compute[74980]:   <memory unit='KiB'>524288</memory>
Nov 02 17:21:07 user nova-compute[74980]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 17:21:07 user nova-compute[74980]:   <vcpu placement='static'>1</vcpu>
Nov 02 17:21:07 user nova-compute[74980]:   <resource>
Nov 02 17:21:07 user nova-compute[74980]:     <partition>/machine</partition>
Nov 02 17:21:07 user nova-compute[74980]:   </resource>
Nov 02 17:21:07 user nova-compute[74980]:   <sysinfo type='smbios'>
Nov 02 17:21:07 user nova-compute[74980]:     <system>
Nov 02 17:21:07 user nova-compute[74980]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 17:21:07 user nova-compute[74980]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 17:21:07 user nova-compute[74980]:       <entry name='version'>0.0.0</entry>
Nov 02 17:21:07 user nova-compute[74980]:       <entry name='serial'>aeae0fe6-ffc2-48f7-8b59-c6485851be3d</entry>
Nov 02 17:21:07 user nova-compute[74980]:       <entry name='uuid'>aeae0fe6-ffc2-48f7-8b59-c6485851be3d</entry>
Nov 02 17:21:07 user nova-compute[74980]:       <entry name='family'>Virtual Machine</entry>
Nov 02 17:21:07 user nova-compute[74980]:     </system>
Nov 02 17:21:07 user nova-compute[74980]:   </sysinfo>
Nov 02 17:21:07 user nova-compute[74980]:   <os>
Nov 02 17:21:07 user nova-compute[74980]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 17:21:07 user nova-compute[74980]:     <boot dev='hd'/>
Nov 02 17:21:07 user nova-compute[74980]:     <smbios mode='sysinfo'/>
Nov 02 17:21:07 user nova-compute[74980]:   </os>
Nov 02 17:21:07 user nova-compute[74980]:   <features>
Nov 02 17:21:07 user nova-compute[74980]:     <acpi/>
Nov 02 17:21:07 user nova-compute[74980]:     <apic/>
Nov 02 17:21:07 user nova-compute[74980]:     <vmcoreinfo state='on'/>
Nov 02 17:21:07 user nova-compute[74980]:   </features>
Nov 02 17:21:07 user nova-compute[74980]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 17:21:07 user nova-compute[74980]:     <model fallback='forbid'>Nehalem</model>
Nov 02 17:21:07 user nova-compute[74980]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 17:21:07 user nova-compute[74980]:     <feature policy='require' name='vme'/>
Nov 02 17:21:07 user nova-compute[74980]:     <feature policy='require' name='x2apic'/>
Nov 02 17:21:07 user nova-compute[74980]:     <feature policy='require' name='hypervisor'/>
Nov 02 17:21:07 user nova-compute[74980]:   </cpu>
Nov 02 17:21:07 user nova-compute[74980]:   <clock offset='utc'>
Nov 02 17:21:07 user nova-compute[74980]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 17:21:07 user nova-compute[74980]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 17:21:07 user nova-compute[74980]:     <timer name='hpet' present='no'/>
Nov 02 17:21:07 user nova-compute[74980]:   </clock>
Nov 02 17:21:07 user nova-compute[74980]:   <on_poweroff>destroy</on_poweroff>
Nov 02 17:21:07 user nova-compute[74980]:   <on_reboot>restart</on_reboot>
Nov 02 17:21:07 user nova-compute[74980]:   <on_crash>destroy</on_crash>
Nov 02 17:21:07 user nova-compute[74980]:   <devices>
Nov 02 17:21:07 user nova-compute[74980]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 17:21:07 user nova-compute[74980]:     <disk type='file' device='disk'>
Nov 02 17:21:07 user nova-compute[74980]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 17:21:07 user nova-compute[74980]:       <source file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk' index='2'/>
Nov 02 17:21:07 user nova-compute[74980]:       <backingStore type='file' index='3'>
Nov 02 17:21:07 user nova-compute[74980]:         <format type='raw'/>
Nov 02 17:21:07 user nova-compute[74980]:         <source file='/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666'/>
Nov 02 17:21:07 user nova-compute[74980]:         <backingStore/>
Nov 02 17:21:07 user nova-compute[74980]:       </backingStore>
Nov 02 17:21:07 user nova-compute[74980]:       <target dev='vda' bus='virtio'/>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='virtio-disk0'/>
Nov 02 17:21:07 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </disk>
Nov 02 17:21:07 user nova-compute[74980]:     <disk type='file' device='cdrom'>
Nov 02 17:21:07 user nova-compute[74980]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 17:21:07 user nova-compute[74980]:       <source file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk.config' index='1'/>
Nov 02 17:21:07 user nova-compute[74980]:       <backingStore/>
Nov 02 17:21:07 user nova-compute[74980]:       <target dev='hda' bus='ide'/>
Nov 02 17:21:07 user nova-compute[74980]:       <readonly/>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='ide0-0-0'/>
Nov 02 17:21:07 user nova-compute[74980]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </disk>
Nov 02 17:21:07 user nova-compute[74980]:     <controller type='usb' index='0' model='none'>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='usb'/>
Nov 02 17:21:07 user nova-compute[74980]:     </controller>
Nov 02 17:21:07 user nova-compute[74980]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='pci.0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </controller>
Nov 02 17:21:07 user nova-compute[74980]:     <controller type='ide' index='0'>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='ide'/>
Nov 02 17:21:07 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 17:21:07 user nova-compute[74980]:     </controller>
Nov 02 17:21:07 user nova-compute[74980]:     <interface type='ethernet'>
Nov 02 17:21:07 user nova-compute[74980]:       <mac address='fa:16:3e:d3:89:3a'/>
Nov 02 17:21:07 user nova-compute[74980]:       <target dev='tap7434f94a-71'/>
Nov 02 17:21:07 user nova-compute[74980]:       <model type='virtio'/>
Nov 02 17:21:07 user nova-compute[74980]:       <mtu size='1442'/>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='net0'/>
Nov 02 17:21:07 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </interface>
Nov 02 17:21:07 user nova-compute[74980]:     <serial type='pty'>
Nov 02 17:21:07 user nova-compute[74980]:       <source path='/dev/pts/6'/>
Nov 02 17:21:07 user nova-compute[74980]:       <log file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/console.log' append='off'/>
Nov 02 17:21:07 user nova-compute[74980]:       <target type='isa-serial' port='0'>
Nov 02 17:21:07 user nova-compute[74980]:         <model name='isa-serial'/>
Nov 02 17:21:07 user nova-compute[74980]:       </target>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='serial0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </serial>
Nov 02 17:21:07 user nova-compute[74980]:     <console type='pty' tty='/dev/pts/6'>
Nov 02 17:21:07 user nova-compute[74980]:       <source path='/dev/pts/6'/>
Nov 02 17:21:07 user nova-compute[74980]:       <log file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/console.log' append='off'/>
Nov 02 17:21:07 user nova-compute[74980]:       <target type='serial' port='0'/>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='serial0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </console>
Nov 02 17:21:07 user nova-compute[74980]:     <input type='mouse' bus='ps2'>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='input0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </input>
Nov 02 17:21:07 user nova-compute[74980]:     <input type='keyboard' bus='ps2'>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='input1'/>
Nov 02 17:21:07 user nova-compute[74980]:     </input>
Nov 02 17:21:07 user nova-compute[74980]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 02 17:21:07 user nova-compute[74980]:       <listen type='address' address='0.0.0.0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </graphics>
Nov 02 17:21:07 user nova-compute[74980]:     <audio id='1' type='none'/>
Nov 02 17:21:07 user nova-compute[74980]:     <video>
Nov 02 17:21:07 user nova-compute[74980]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='video0'/>
Nov 02 17:21:07 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </video>
Nov 02 17:21:07 user nova-compute[74980]:     <memballoon model='virtio'>
Nov 02 17:21:07 user nova-compute[74980]:       <stats period='10'/>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='balloon0'/>
Nov 02 17:21:07 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </memballoon>
Nov 02 17:21:07 user nova-compute[74980]:     <rng model='virtio'>
Nov 02 17:21:07 user nova-compute[74980]:       <backend model='random'>/dev/urandom</backend>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='rng0'/>
Nov 02 17:21:07 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </rng>
Nov 02 17:21:07 user nova-compute[74980]:   </devices>
Nov 02 17:21:07 user nova-compute[74980]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 17:21:07 user nova-compute[74980]:     <label>libvirt-aeae0fe6-ffc2-48f7-8b59-c6485851be3d</label>
Nov 02 17:21:07 user nova-compute[74980]:     <imagelabel>libvirt-aeae0fe6-ffc2-48f7-8b59-c6485851be3d</imagelabel>
Nov 02 17:21:07 user nova-compute[74980]:   </seclabel>
Nov 02 17:21:07 user nova-compute[74980]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 17:21:07 user nova-compute[74980]:     <label>+64055:+108</label>
Nov 02 17:21:07 user nova-compute[74980]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 17:21:07 user nova-compute[74980]:   </seclabel>
Nov 02 17:21:07 user nova-compute[74980]: </domain>
Nov 02 17:21:07 user nova-compute[74980]:  {{(pid=74980) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:c0:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap8ca932f4-4d"/></interface> {{(pid=74980) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e5:c0:c9"/><model type="virtio"/><mtu size="1442"/><target dev="tap8ca932f4-4d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 02 17:21:07 user nova-compute[74980]:   <name>instance-00000007</name>
Nov 02 17:21:07 user nova-compute[74980]:   <uuid>aeae0fe6-ffc2-48f7-8b59-c6485851be3d</uuid>
Nov 02 17:21:07 user nova-compute[74980]:   <metadata>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:21:07 user nova-compute[74980]:   <nova:package version="0.0.0"/>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:name>tempest-device-tagging-server-1956055295</nova:name>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:creationTime>2023-11-02 17:21:06</nova:creationTime>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:flavor name="m1.tiny">
Nov 02 17:21:07 user nova-compute[74980]:     <nova:memory>512</nova:memory>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:disk>1</nova:disk>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:swap>0</nova:swap>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:vcpus>1</nova:vcpus>
Nov 02 17:21:07 user nova-compute[74980]:   </nova:flavor>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:owner>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:user uuid="59c1bf383d2a48449244708dea3cd95b">tempest-TaggedAttachmentsTest-2126535582-project-member</nova:user>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:project uuid="061cfdc41fc64eea9bd281d8c51424c8">tempest-TaggedAttachmentsTest-2126535582</nova:project>
Nov 02 17:21:07 user nova-compute[74980]:   </nova:owner>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:ports>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:port uuid="7434f94a-713e-4434-9262-8da6a26d4006">
Nov 02 17:21:07 user nova-compute[74980]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 17:21:07 user nova-compute[74980]:     </nova:port>
Nov 02 17:21:07 user nova-compute[74980]:   </nova:ports>
Nov 02 17:21:07 user nova-compute[74980]: </nova:instance>
Nov 02 17:21:07 user nova-compute[74980]:   </metadata>
Nov 02 17:21:07 user nova-compute[74980]:   <memory unit='KiB'>524288</memory>
Nov 02 17:21:07 user nova-compute[74980]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 17:21:07 user nova-compute[74980]:   <vcpu placement='static'>1</vcpu>
Nov 02 17:21:07 user nova-compute[74980]:   <resource>
Nov 02 17:21:07 user nova-compute[74980]:     <partition>/machine</partition>
Nov 02 17:21:07 user nova-compute[74980]:   </resource>
Nov 02 17:21:07 user nova-compute[74980]:   <sysinfo type='smbios'>
Nov 02 17:21:07 user nova-compute[74980]:     <system>
Nov 02 17:21:07 user nova-compute[74980]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 17:21:07 user nova-compute[74980]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 17:21:07 user nova-compute[74980]:       <entry name='version'>0.0.0</entry>
Nov 02 17:21:07 user nova-compute[74980]:       <entry name='serial'>aeae0fe6-ffc2-48f7-8b59-c6485851be3d</entry>
Nov 02 17:21:07 user nova-compute[74980]:       <entry name='uuid'>aeae0fe6-ffc2-48f7-8b59-c6485851be3d</entry>
Nov 02 17:21:07 user nova-compute[74980]:       <entry name='family'>Virtual Machine</entry>
Nov 02 17:21:07 user nova-compute[74980]:     </system>
Nov 02 17:21:07 user nova-compute[74980]:   </sysinfo>
Nov 02 17:21:07 user nova-compute[74980]:   <os>
Nov 02 17:21:07 user nova-compute[74980]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 17:21:07 user nova-compute[74980]:     <boot dev='hd'/>
Nov 02 17:21:07 user nova-compute[74980]:     <smbios mode='sysinfo'/>
Nov 02 17:21:07 user nova-compute[74980]:   </os>
Nov 02 17:21:07 user nova-compute[74980]:   <features>
Nov 02 17:21:07 user nova-compute[74980]:     <acpi/>
Nov 02 17:21:07 user nova-compute[74980]:     <apic/>
Nov 02 17:21:07 user nova-compute[74980]:     <vmcoreinfo state='on'/>
Nov 02 17:21:07 user nova-compute[74980]:   </features>
Nov 02 17:21:07 user nova-compute[74980]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 17:21:07 user nova-compute[74980]:     <model fallback='forbid'>Nehalem</model>
Nov 02 17:21:07 user nova-compute[74980]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 17:21:07 user nova-compute[74980]:     <feature policy='require' name='vme'/>
Nov 02 17:21:07 user nova-compute[74980]:     <feature policy='require' name='x2apic'/>
Nov 02 17:21:07 user nova-compute[74980]:     <feature policy='require' name='hypervisor'/>
Nov 02 17:21:07 user nova-compute[74980]:   </cpu>
Nov 02 17:21:07 user nova-compute[74980]:   <clock offset='utc'>
Nov 02 17:21:07 user nova-compute[74980]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 17:21:07 user nova-compute[74980]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 17:21:07 user nova-compute[74980]:     <timer name='hpet' present='no'/>
Nov 02 17:21:07 user nova-compute[74980]:   </clock>
Nov 02 17:21:07 user nova-compute[74980]:   <on_poweroff>destroy</on_poweroff>
Nov 02 17:21:07 user nova-compute[74980]:   <on_reboot>restart</on_reboot>
Nov 02 17:21:07 user nova-compute[74980]:   <on_crash>destroy</on_crash>
Nov 02 17:21:07 user nova-compute[74980]:   <devices>
Nov 02 17:21:07 user nova-compute[74980]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 17:21:07 user nova-compute[74980]:     <disk type='file' device='disk'>
Nov 02 17:21:07 user nova-compute[74980]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 17:21:07 user nova-compute[74980]:       <source file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk' index='2'/>
Nov 02 17:21:07 user nova-compute[74980]:       <backingStore type='file' index='3'>
Nov 02 17:21:07 user nova-compute[74980]:         <format type='raw'/>
Nov 02 17:21:07 user nova-compute[74980]:         <source file='/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666'/>
Nov 02 17:21:07 user nova-compute[74980]:         <backingStore/>
Nov 02 17:21:07 user nova-compute[74980]:       </backingStore>
Nov 02 17:21:07 user nova-compute[74980]:       <target dev='vda' bus='virtio'/>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='virtio-disk0'/>
Nov 02 17:21:07 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </disk>
Nov 02 17:21:07 user nova-compute[74980]:     <disk type='file' device='cdrom'>
Nov 02 17:21:07 user nova-compute[74980]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 17:21:07 user nova-compute[74980]:       <source file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/disk.config' index='1'/>
Nov 02 17:21:07 user nova-compute[74980]:       <backingStore/>
Nov 02 17:21:07 user nova-compute[74980]:       <target dev='hda' bus='ide'/>
Nov 02 17:21:07 user nova-compute[74980]:       <readonly/>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='ide0-0-0'/>
Nov 02 17:21:07 user nova-compute[74980]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </disk>
Nov 02 17:21:07 user nova-compute[74980]:     <controller type='usb' index='0' model='none'>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='usb'/>
Nov 02 17:21:07 user nova-compute[74980]:     </controller>
Nov 02 17:21:07 user nova-compute[74980]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='pci.0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </controller>
Nov 02 17:21:07 user nova-compute[74980]:     <controller type='ide' index='0'>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='ide'/>
Nov 02 17:21:07 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 17:21:07 user nova-compute[74980]:     </controller>
Nov 02 17:21:07 user nova-compute[74980]:     <interface type='ethernet'>
Nov 02 17:21:07 user nova-compute[74980]:       <mac address='fa:16:3e:d3:89:3a'/>
Nov 02 17:21:07 user nova-compute[74980]:       <target dev='tap7434f94a-71'/>
Nov 02 17:21:07 user nova-compute[74980]:       <model type='virtio'/>
Nov 02 17:21:07 user nova-compute[74980]:       <mtu size='1442'/>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='net0'/>
Nov 02 17:21:07 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </interface>
Nov 02 17:21:07 user nova-compute[74980]:     <serial type='pty'>
Nov 02 17:21:07 user nova-compute[74980]:       <source path='/dev/pts/6'/>
Nov 02 17:21:07 user nova-compute[74980]:       <log file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/console.log' append='off'/>
Nov 02 17:21:07 user nova-compute[74980]:       <target type='isa-serial' port='0'>
Nov 02 17:21:07 user nova-compute[74980]:         <model name='isa-serial'/>
Nov 02 17:21:07 user nova-compute[74980]:       </target>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='serial0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </serial>
Nov 02 17:21:07 user nova-compute[74980]:     <console type='pty' tty='/dev/pts/6'>
Nov 02 17:21:07 user nova-compute[74980]:       <source path='/dev/pts/6'/>
Nov 02 17:21:07 user nova-compute[74980]:       <log file='/opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d/console.log' append='off'/>
Nov 02 17:21:07 user nova-compute[74980]:       <target type='serial' port='0'/>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='serial0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </console>
Nov 02 17:21:07 user nova-compute[74980]:     <input type='mouse' bus='ps2'>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='input0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </input>
Nov 02 17:21:07 user nova-compute[74980]:     <input type='keyboard' bus='ps2'>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='input1'/>
Nov 02 17:21:07 user nova-compute[74980]:     </input>
Nov 02 17:21:07 user nova-compute[74980]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 02 17:21:07 user nova-compute[74980]:       <listen type='address' address='0.0.0.0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </graphics>
Nov 02 17:21:07 user nova-compute[74980]:     <audio id='1' type='none'/>
Nov 02 17:21:07 user nova-compute[74980]:     <video>
Nov 02 17:21:07 user nova-compute[74980]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='video0'/>
Nov 02 17:21:07 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </video>
Nov 02 17:21:07 user nova-compute[74980]:     <memballoon model='virtio'>
Nov 02 17:21:07 user nova-compute[74980]:       <stats period='10'/>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='balloon0'/>
Nov 02 17:21:07 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </memballoon>
Nov 02 17:21:07 user nova-compute[74980]:     <rng model='virtio'>
Nov 02 17:21:07 user nova-compute[74980]:       <backend model='random'>/dev/urandom</backend>
Nov 02 17:21:07 user nova-compute[74980]:       <alias name='rng0'/>
Nov 02 17:21:07 user nova-compute[74980]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 17:21:07 user nova-compute[74980]:     </rng>
Nov 02 17:21:07 user nova-compute[74980]:   </devices>
Nov 02 17:21:07 user nova-compute[74980]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 17:21:07 user nova-compute[74980]:     <label>libvirt-aeae0fe6-ffc2-48f7-8b59-c6485851be3d</label>
Nov 02 17:21:07 user nova-compute[74980]:     <imagelabel>libvirt-aeae0fe6-ffc2-48f7-8b59-c6485851be3d</imagelabel>
Nov 02 17:21:07 user nova-compute[74980]:   </seclabel>
Nov 02 17:21:07 user nova-compute[74980]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 17:21:07 user nova-compute[74980]:     <label>+64055:+108</label>
Nov 02 17:21:07 user nova-compute[74980]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 17:21:07 user nova-compute[74980]:   </seclabel>
Nov 02 17:21:07 user nova-compute[74980]: </domain>
Nov 02 17:21:07 user nova-compute[74980]:  {{(pid=74980) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 17:21:07 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Detaching interface fa:16:3e:e5:c0:c9 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap8ca932f4-4d' not found.
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1956055295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1956055295',id=7,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxrQckQxr69xMzJYNTLEjM/WTe1wsExTJezKCnbJ7jnYlT8mZTga0YewAJ2OnZA6lwf50l3CWjDefeId4ykNOk9L89xqNa/3p6b4bQjrJI1+UpsUWudVowdG28U6uyqAA==',key_name='tempest-keypair-347748516',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='061cfdc41fc64eea9bd281d8c51424c8',ramdisk_id='',reservation_id='r-qbp9xyqq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2126535582',owner_user_name='tempest-TaggedAttachmentsTest-2126535582-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59c1bf383d2a48449244708dea3cd95b',uuid=aeae0fe6-ffc2-48f7-8b59-c6485851be3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ca932f4-4d4e-4481-970f-161340d7bccc", "address": "fa:16:3e:e5:c0:c9", "network": {"id": "7e642d05-f3e4-4a5e-b251-eb51e2525ef9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870506038", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca932f4-4d", "ovs_interfaceid": "8ca932f4-4d4e-4481-970f-161340d7bccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.network.os_vif_util [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] Converting VIF {"id": "8ca932f4-4d4e-4481-970f-161340d7bccc", "address": "fa:16:3e:e5:c0:c9", "network": {"id": "7e642d05-f3e4-4a5e-b251-eb51e2525ef9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1870506038", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ca932f4-4d", "ovs_interfaceid": "8ca932f4-4d4e-4481-970f-161340d7bccc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.network.os_vif_util [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c0:c9,bridge_name='br-int',has_traffic_filtering=True,id=8ca932f4-4d4e-4481-970f-161340d7bccc,network=Network(7e642d05-f3e4-4a5e-b251-eb51e2525ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca932f4-4d') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG os_vif [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c0:c9,bridge_name='br-int',has_traffic_filtering=True,id=8ca932f4-4d4e-4481-970f-161340d7bccc,network=Network(7e642d05-f3e4-4a5e-b251-eb51e2525ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca932f4-4d') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ca932f4-4d, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:21:07 user nova-compute[74980]: INFO os_vif [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c0:c9,bridge_name='br-int',has_traffic_filtering=True,id=8ca932f4-4d4e-4481-970f-161340d7bccc,network=Network(7e642d05-f3e4-4a5e-b251-eb51e2525ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ca932f4-4d')
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [req-6fcbfd4d-071b-4de7-8000-32d4901281bd req-8c61477e-757a-4ea1-ab95-73469555bcce service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:21:07 user nova-compute[74980]:   <nova:package version="0.0.0"/>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:name>tempest-device-tagging-server-1956055295</nova:name>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:creationTime>2023-11-02 17:21:07</nova:creationTime>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:flavor name="m1.tiny">
Nov 02 17:21:07 user nova-compute[74980]:     <nova:memory>512</nova:memory>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:disk>1</nova:disk>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:swap>0</nova:swap>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:vcpus>1</nova:vcpus>
Nov 02 17:21:07 user nova-compute[74980]:   </nova:flavor>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:owner>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:user uuid="59c1bf383d2a48449244708dea3cd95b">tempest-TaggedAttachmentsTest-2126535582-project-member</nova:user>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:project uuid="061cfdc41fc64eea9bd281d8c51424c8">tempest-TaggedAttachmentsTest-2126535582</nova:project>
Nov 02 17:21:07 user nova-compute[74980]:   </nova:owner>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:21:07 user nova-compute[74980]:   <nova:ports>
Nov 02 17:21:07 user nova-compute[74980]:     <nova:port uuid="7434f94a-713e-4434-9262-8da6a26d4006">
Nov 02 17:21:07 user nova-compute[74980]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 17:21:07 user nova-compute[74980]:     </nova:port>
Nov 02 17:21:07 user nova-compute[74980]:   </nova:ports>
Nov 02 17:21:07 user nova-compute[74980]: </nova:instance>
Nov 02 17:21:07 user nova-compute[74980]:  {{(pid=74980) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG nova.network.neutron [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Updating instance_info_cache with network_info: [{"id": "7434f94a-713e-4434-9262-8da6a26d4006", "address": "fa:16:3e:d3:89:3a", "network": {"id": "6f6330e7-ef7b-4457-a97b-798bb8365964", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-523904489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7434f94a-71", "ovs_interfaceid": "7434f94a-713e-4434-9262-8da6a26d4006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Releasing lock "refresh_cache-aeae0fe6-ffc2-48f7-8b59-c6485851be3d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7e067a42-3386-4807-8481-3a34474ade16 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "interface-aeae0fe6-ffc2-48f7-8b59-c6485851be3d-8ca932f4-4d4e-4481-970f-161340d7bccc" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.699s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:09 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:21:09 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=7704MB free_disk=25.419925689697266GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 4e6bfb81-f01c-47e6-b771-7c2b34587623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance d7f2fa00-48af-4277-93b4-af930e4a650f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1154d1f9-80b8-405b-8fd8-c10bb39c507f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 82362140-8606-41dc-a574-86b0b89a7a35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 805deaa2-b2ca-4d1c-9580-317b0548282b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1620c8eb-067c-4156-b927-2f64eac9e340 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:21:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:21:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:21:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 02 17:21:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-1154d1f9-80b8-405b-8fd8-c10bb39c507f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:21:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-1154d1f9-80b8-405b-8fd8-c10bb39c507f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:21:10 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:21:10 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Updating instance_info_cache with network_info: [{"id": "b915b940-4c54-4954-9996-938c74f1d50f", "address": "fa:16:3e:5d:ba:b9", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb915b940-4c", "ovs_interfaceid": "b915b940-4c54-4954-9996-938c74f1d50f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-1154d1f9-80b8-405b-8fd8-c10bb39c507f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:21:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:21:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:21:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "22b8ca59-959d-4687-bb7d-4fc7909aa852" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:21:21 user nova-compute[74980]: INFO nova.compute.claims [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Claim successful on node user
Nov 02 17:21:21 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG nova.network.neutron [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:21:21 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:21:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG nova.policy [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c5c816110044002a6753a93e13459fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b7e1970d471d8a80d04497963276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:21:21 user nova-compute[74980]: INFO nova.virt.block_device [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Booting with volume cbbeebc5-6eb4-4321-a394-86cbcd00837e at /dev/vda
Nov 02 17:21:21 user nova-compute[74980]: DEBUG os_brick.utils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[49df741f-37a0-462a-8f97-b6dbea12a0b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c0f577-a7d8-4998-bd60-92e558dc6e4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fea566b-f744-411c-bc8d-97659ba6c62d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f59f203-b37c-4e98-b8b9-d12c753a54cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:21:21 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:21:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e21061a-23c3-441a-b437-26083575b24b]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG os_brick.utils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:21:21 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updating existing volume attachment record: 4bb329f7-6911-41ec-8952-af66abef5a3a {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:21:22 user nova-compute[74980]: DEBUG nova.network.neutron [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Successfully created port: 1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:21:22 user nova-compute[74980]: DEBUG nova.network.neutron [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Successfully updated port: 1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:21:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:21:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquired lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:21:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:21:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-0b4acac5-9331-49b3-b9d3-5024efc8d892 req-2d1ee062-88e4-4cfa-b9cd-f4e1ee79ea36 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received event network-changed-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-0b4acac5-9331-49b3-b9d3-5024efc8d892 req-2d1ee062-88e4-4cfa-b9cd-f4e1ee79ea36 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Refreshing instance network info cache due to event network-changed-1d0a548b-f00a-401b-9867-c1b9a4ee8d20. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:21:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0b4acac5-9331-49b3-b9d3-5024efc8d892 req-2d1ee062-88e4-4cfa-b9cd-f4e1ee79ea36 service nova] Acquiring lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:21:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:21:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updating instance_info_cache with network_info: [{"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Releasing lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:21:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Instance network_info: |[{"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:21:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0b4acac5-9331-49b3-b9d3-5024efc8d892 req-2d1ee062-88e4-4cfa-b9cd-f4e1ee79ea36 service nova] Acquired lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:21:23 user nova-compute[74980]: DEBUG nova.network.neutron [req-0b4acac5-9331-49b3-b9d3-5024efc8d892 req-2d1ee062-88e4-4cfa-b9cd-f4e1ee79ea36 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Refreshing network info cache for port 1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:21:23 user nova-compute[74980]: DEBUG nova.network.neutron [req-0b4acac5-9331-49b3-b9d3-5024efc8d892 req-2d1ee062-88e4-4cfa-b9cd-f4e1ee79ea36 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updated VIF entry in instance network info cache for port 1d0a548b-f00a-401b-9867-c1b9a4ee8d20. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:21:23 user nova-compute[74980]: DEBUG nova.network.neutron [req-0b4acac5-9331-49b3-b9d3-5024efc8d892 req-2d1ee062-88e4-4cfa-b9cd-f4e1ee79ea36 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updating instance_info_cache with network_info: [{"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0b4acac5-9331-49b3-b9d3-5024efc8d892 req-2d1ee062-88e4-4cfa-b9cd-f4e1ee79ea36 service nova] Releasing lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:21:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Acquiring lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Acquiring lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:25 user nova-compute[74980]: INFO nova.compute.manager [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Terminating instance
Nov 02 17:21:25 user nova-compute[74980]: DEBUG nova.compute.manager [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-5e595f57-04b8-42fe-86de-132a60fb832c req-e2109787-eea7-4007-acb8-64e039bf035e service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Received event network-vif-unplugged-7acd4ed3-a111-48a7-9ddd-4da7246f5d28 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5e595f57-04b8-42fe-86de-132a60fb832c req-e2109787-eea7-4007-acb8-64e039bf035e service nova] Acquiring lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5e595f57-04b8-42fe-86de-132a60fb832c req-e2109787-eea7-4007-acb8-64e039bf035e service nova] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5e595f57-04b8-42fe-86de-132a60fb832c req-e2109787-eea7-4007-acb8-64e039bf035e service nova] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-5e595f57-04b8-42fe-86de-132a60fb832c req-e2109787-eea7-4007-acb8-64e039bf035e service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] No waiting events found dispatching network-vif-unplugged-7acd4ed3-a111-48a7-9ddd-4da7246f5d28 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-5e595f57-04b8-42fe-86de-132a60fb832c req-e2109787-eea7-4007-acb8-64e039bf035e service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Received event network-vif-unplugged-7acd4ed3-a111-48a7-9ddd-4da7246f5d28 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:26 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Instance destroyed successfully.
Nov 02 17:21:26 user nova-compute[74980]: DEBUG nova.objects.instance [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lazy-loading 'resources' on Instance uuid 8f08eaa2-92d1-4081-9bc7-fe3e7123e831 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-662418021',display_name='tempest-VolumesAssistedSnapshotsTest-server-662418021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-662418021',id=8,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbE8VKIGhk/DyK8gWj0QKBe+A/9AGKeubbqpCpDhRNm7Ey7jkRnu4C6Nu95KNt9U+VPacgkVNPffU2phTUT/lDfi+Z3VSBWCKf8/vJtPA145q8NpyXGNVcOltHSfcIPKg==',key_name='tempest-keypair-72423944',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:17:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64f1fee6570a42bd9ec5f9899e7618f9',ramdisk_id='',reservation_id='r-fxkovy9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-293542621',owner_user_name='tempest-VolumesAssistedSnapshotsTest-293542621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fe318621b4549a880428866244a997f',uuid=8f08eaa2-92d1-4081-9bc7-fe3e7123e831,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "address": "fa:16:3e:a3:43:90", "network": {"id": "4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-496537762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64f1fee6570a42bd9ec5f9899e7618f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7acd4ed3-a1", "ovs_interfaceid": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Converting VIF {"id": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "address": "fa:16:3e:a3:43:90", "network": {"id": "4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-496537762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64f1fee6570a42bd9ec5f9899e7618f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7acd4ed3-a1", "ovs_interfaceid": "7acd4ed3-a111-48a7-9ddd-4da7246f5d28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:43:90,bridge_name='br-int',has_traffic_filtering=True,id=7acd4ed3-a111-48a7-9ddd-4da7246f5d28,network=Network(4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7acd4ed3-a1') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG os_vif [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:43:90,bridge_name='br-int',has_traffic_filtering=True,id=7acd4ed3-a111-48a7-9ddd-4da7246f5d28,network=Network(4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7acd4ed3-a1') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7acd4ed3-a1, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e701804-5f89-41dc-a3c5-632c831b97eb) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:26 user nova-compute[74980]: INFO os_vif [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:43:90,bridge_name='br-int',has_traffic_filtering=True,id=7acd4ed3-a111-48a7-9ddd-4da7246f5d28,network=Network(4bd4ed3b-f6a2-4d0f-978d-ba5fdfc1211a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7acd4ed3-a1')
Nov 02 17:21:26 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Deleting instance files /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831_del
Nov 02 17:21:26 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Deletion of /opt/stack/data/nova/instances/8f08eaa2-92d1-4081-9bc7-fe3e7123e831_del complete
Nov 02 17:21:26 user nova-compute[74980]: INFO nova.compute.manager [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 02 17:21:26 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:21:26 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:21:27 user nova-compute[74980]: DEBUG nova.compute.manager [req-8c765e31-56e3-4736-9ee2-42d2e0524a5d req-f6140fbb-5e66-435b-8a7b-3fbb839f5ade service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Received event network-changed-1ef68686-5086-4b8c-9bca-411d492a7102 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:27 user nova-compute[74980]: DEBUG nova.compute.manager [req-8c765e31-56e3-4736-9ee2-42d2e0524a5d req-f6140fbb-5e66-435b-8a7b-3fbb839f5ade service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Refreshing instance network info cache due to event network-changed-1ef68686-5086-4b8c-9bca-411d492a7102. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:21:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8c765e31-56e3-4736-9ee2-42d2e0524a5d req-f6140fbb-5e66-435b-8a7b-3fbb839f5ade service nova] Acquiring lock "refresh_cache-805deaa2-b2ca-4d1c-9580-317b0548282b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:21:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8c765e31-56e3-4736-9ee2-42d2e0524a5d req-f6140fbb-5e66-435b-8a7b-3fbb839f5ade service nova] Acquired lock "refresh_cache-805deaa2-b2ca-4d1c-9580-317b0548282b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:21:27 user nova-compute[74980]: DEBUG nova.network.neutron [req-8c765e31-56e3-4736-9ee2-42d2e0524a5d req-f6140fbb-5e66-435b-8a7b-3fbb839f5ade service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Refreshing network info cache for port 1ef68686-5086-4b8c-9bca-411d492a7102 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:21:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "805deaa2-b2ca-4d1c-9580-317b0548282b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "805deaa2-b2ca-4d1c-9580-317b0548282b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "805deaa2-b2ca-4d1c-9580-317b0548282b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "805deaa2-b2ca-4d1c-9580-317b0548282b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "805deaa2-b2ca-4d1c-9580-317b0548282b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:27 user nova-compute[74980]: INFO nova.compute.manager [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Terminating instance
Nov 02 17:21:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG nova.compute.manager [req-ce0aa8d5-97e1-4215-ad8a-93119cab7e26 req-e4d43995-040e-4fbc-a928-a93a2ec134d4 service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Received event network-vif-plugged-7acd4ed3-a111-48a7-9ddd-4da7246f5d28 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ce0aa8d5-97e1-4215-ad8a-93119cab7e26 req-e4d43995-040e-4fbc-a928-a93a2ec134d4 service nova] Acquiring lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ce0aa8d5-97e1-4215-ad8a-93119cab7e26 req-e4d43995-040e-4fbc-a928-a93a2ec134d4 service nova] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ce0aa8d5-97e1-4215-ad8a-93119cab7e26 req-e4d43995-040e-4fbc-a928-a93a2ec134d4 service nova] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG nova.compute.manager [req-ce0aa8d5-97e1-4215-ad8a-93119cab7e26 req-e4d43995-040e-4fbc-a928-a93a2ec134d4 service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] No waiting events found dispatching network-vif-plugged-7acd4ed3-a111-48a7-9ddd-4da7246f5d28 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:28 user nova-compute[74980]: WARNING nova.compute.manager [req-ce0aa8d5-97e1-4215-ad8a-93119cab7e26 req-e4d43995-040e-4fbc-a928-a93a2ec134d4 service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Received unexpected event network-vif-plugged-7acd4ed3-a111-48a7-9ddd-4da7246f5d28 for instance with vm_state active and task_state deleting.
Nov 02 17:21:28 user nova-compute[74980]: DEBUG nova.compute.manager [req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea req-02df7ec9-0d03-4213-ab20-0ff7bbb02413 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received event volume-reimaged-756ebe57-479f-485e-8091-9f3771aea8cf {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea req-02df7ec9-0d03-4213-ab20-0ff7bbb02413 service nova] Acquiring lock "82362140-8606-41dc-a574-86b0b89a7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea req-02df7ec9-0d03-4213-ab20-0ff7bbb02413 service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea req-02df7ec9-0d03-4213-ab20-0ff7bbb02413 service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG nova.compute.manager [req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea req-02df7ec9-0d03-4213-ab20-0ff7bbb02413 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Processing event volume-reimaged-756ebe57-479f-485e-8091-9f3771aea8cf {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG nova.compute.manager [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Instance event wait completed in 46 seconds for volume-reimaged {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:28 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Took 1.56 seconds to deallocate network for instance.
Nov 02 17:21:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:28 user nova-compute[74980]: INFO nova.virt.block_device [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Booting with volume 756ebe57-479f-485e-8091-9f3771aea8cf at /dev/vda
Nov 02 17:21:28 user nova-compute[74980]: DEBUG nova.network.neutron [req-8c765e31-56e3-4736-9ee2-42d2e0524a5d req-f6140fbb-5e66-435b-8a7b-3fbb839f5ade service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Updated VIF entry in instance network info cache for port 1ef68686-5086-4b8c-9bca-411d492a7102. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG nova.network.neutron [req-8c765e31-56e3-4736-9ee2-42d2e0524a5d req-f6140fbb-5e66-435b-8a7b-3fbb839f5ade service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Updating instance_info_cache with network_info: [{"id": "1ef68686-5086-4b8c-9bca-411d492a7102", "address": "fa:16:3e:1a:34:61", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef68686-50", "ovs_interfaceid": "1ef68686-5086-4b8c-9bca-411d492a7102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG os_brick.utils [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8ad779-a6db-4dc9-86fc-5ef7372da016]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[676d6956-112f-463f-bab6-54f513b94eda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:28 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Instance destroyed successfully.
Nov 02 17:21:28 user nova-compute[74980]: DEBUG nova.objects.instance [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'resources' on Instance uuid 805deaa2-b2ca-4d1c-9580-317b0548282b {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb623a1-5fc9-4a7e-85fd-3a30fa1171de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d69f62-b1c8-430c-888f-b15018f87b81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:19:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1693906051',display_name='tempest-AttachVolumeNegativeTest-server-1693906051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1693906051',id=13,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvRSnYz3tCCLQkcyrcK+R9mvY8XK19GscNsiSrR3fu7/WL3qnP/8rbrd3/C8Tsg4G1mslUeW+09VBrPp9fyY9sKKw3KgQadnCjWmLyqZIjC6BH11FB5dLaRNrTAcPMkKw==',key_name='tempest-keypair-1030283866',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:19:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b889d98476584bb1b18080bfa0664810',ramdisk_id='',reservation_id='r-ghngjw4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1956142060',owner_user_name='tempest-AttachVolumeNegativeTest-1956142060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:19:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a979e164900348beaab104704c92b722',uuid=805deaa2-b2ca-4d1c-9580-317b0548282b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ef68686-5086-4b8c-9bca-411d492a7102", "address": "fa:16:3e:1a:34:61", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef68686-50", "ovs_interfaceid": "1ef68686-5086-4b8c-9bca-411d492a7102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converting VIF {"id": "1ef68686-5086-4b8c-9bca-411d492a7102", "address": "fa:16:3e:1a:34:61", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef68686-50", "ovs_interfaceid": "1ef68686-5086-4b8c-9bca-411d492a7102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:34:61,bridge_name='br-int',has_traffic_filtering=True,id=1ef68686-5086-4b8c-9bca-411d492a7102,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef68686-50') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG os_vif [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:34:61,bridge_name='br-int',has_traffic_filtering=True,id=1ef68686-5086-4b8c-9bca-411d492a7102,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef68686-50') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8c765e31-56e3-4736-9ee2-42d2e0524a5d req-f6140fbb-5e66-435b-8a7b-3fbb839f5ade service nova] Releasing lock "refresh_cache-805deaa2-b2ca-4d1c-9580-317b0548282b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:21:28 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac2cb5c-d217-42bc-93ab-41af97975a06]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ef68686-50, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG os_brick.utils [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Updating existing volume attachment record: 5b0e1933-6186-4e3a-a4b8-4bc32e1440de {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33d86529-9f88-4d35-bd24-8b8d10b6adf6) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:28 user nova-compute[74980]: INFO os_vif [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:34:61,bridge_name='br-int',has_traffic_filtering=True,id=1ef68686-5086-4b8c-9bca-411d492a7102,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef68686-50')
Nov 02 17:21:28 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Deleting instance files /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b_del
Nov 02 17:21:28 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Deletion of /opt/stack/data/nova/instances/805deaa2-b2ca-4d1c-9580-317b0548282b_del complete
Nov 02 17:21:28 user nova-compute[74980]: INFO nova.compute.manager [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 02 17:21:28 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:21:28 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:21:29 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:21:29 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:21:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:29 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Deleted allocations for instance 8f08eaa2-92d1-4081-9bc7-fe3e7123e831
Nov 02 17:21:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-273247d4-d179-44c5-a297-ccbf5154ea9d tempest-VolumesAssistedSnapshotsTest-293542621 tempest-VolumesAssistedSnapshotsTest-293542621-project-member] Lock "8f08eaa2-92d1-4081-9bc7-fe3e7123e831" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.417s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:29 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:29 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Took 0.78 seconds to deallocate network for instance.
Nov 02 17:21:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:29 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:21:29 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:21:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:30 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Deleted allocations for instance 805deaa2-b2ca-4d1c-9580-317b0548282b
Nov 02 17:21:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9beffa40-3a6f-41fc-b31f-f81f5eff789a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "805deaa2-b2ca-4d1c-9580-317b0548282b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.188s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-68b9d23f-efd4-4d1f-9e50-d1417cb99cef req-9414f8a1-483c-42f7-9e6d-ee1b7805f89d service nova] [instance: 8f08eaa2-92d1-4081-9bc7-fe3e7123e831] Received event network-vif-deleted-7acd4ed3-a111-48a7-9ddd-4da7246f5d28 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-68b9d23f-efd4-4d1f-9e50-d1417cb99cef req-9414f8a1-483c-42f7-9e6d-ee1b7805f89d service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Received event network-vif-unplugged-1ef68686-5086-4b8c-9bca-411d492a7102 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-68b9d23f-efd4-4d1f-9e50-d1417cb99cef req-9414f8a1-483c-42f7-9e6d-ee1b7805f89d service nova] Acquiring lock "805deaa2-b2ca-4d1c-9580-317b0548282b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-68b9d23f-efd4-4d1f-9e50-d1417cb99cef req-9414f8a1-483c-42f7-9e6d-ee1b7805f89d service nova] Lock "805deaa2-b2ca-4d1c-9580-317b0548282b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-68b9d23f-efd4-4d1f-9e50-d1417cb99cef req-9414f8a1-483c-42f7-9e6d-ee1b7805f89d service nova] Lock "805deaa2-b2ca-4d1c-9580-317b0548282b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-68b9d23f-efd4-4d1f-9e50-d1417cb99cef req-9414f8a1-483c-42f7-9e6d-ee1b7805f89d service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] No waiting events found dispatching network-vif-unplugged-1ef68686-5086-4b8c-9bca-411d492a7102 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:30 user nova-compute[74980]: WARNING nova.compute.manager [req-68b9d23f-efd4-4d1f-9e50-d1417cb99cef req-9414f8a1-483c-42f7-9e6d-ee1b7805f89d service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Received unexpected event network-vif-unplugged-1ef68686-5086-4b8c-9bca-411d492a7102 for instance with vm_state deleted and task_state None.
Nov 02 17:21:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-68b9d23f-efd4-4d1f-9e50-d1417cb99cef req-9414f8a1-483c-42f7-9e6d-ee1b7805f89d service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Received event network-vif-plugged-1ef68686-5086-4b8c-9bca-411d492a7102 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-68b9d23f-efd4-4d1f-9e50-d1417cb99cef req-9414f8a1-483c-42f7-9e6d-ee1b7805f89d service nova] Acquiring lock "805deaa2-b2ca-4d1c-9580-317b0548282b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-68b9d23f-efd4-4d1f-9e50-d1417cb99cef req-9414f8a1-483c-42f7-9e6d-ee1b7805f89d service nova] Lock "805deaa2-b2ca-4d1c-9580-317b0548282b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-68b9d23f-efd4-4d1f-9e50-d1417cb99cef req-9414f8a1-483c-42f7-9e6d-ee1b7805f89d service nova] Lock "805deaa2-b2ca-4d1c-9580-317b0548282b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-68b9d23f-efd4-4d1f-9e50-d1417cb99cef req-9414f8a1-483c-42f7-9e6d-ee1b7805f89d service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] No waiting events found dispatching network-vif-plugged-1ef68686-5086-4b8c-9bca-411d492a7102 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:30 user nova-compute[74980]: WARNING nova.compute.manager [req-68b9d23f-efd4-4d1f-9e50-d1417cb99cef req-9414f8a1-483c-42f7-9e6d-ee1b7805f89d service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Received unexpected event network-vif-plugged-1ef68686-5086-4b8c-9bca-411d492a7102 for instance with vm_state deleted and task_state None.
Nov 02 17:21:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-68b9d23f-efd4-4d1f-9e50-d1417cb99cef req-9414f8a1-483c-42f7-9e6d-ee1b7805f89d service nova] [instance: 805deaa2-b2ca-4d1c-9580-317b0548282b] Received event network-vif-deleted-1ef68686-5086-4b8c-9bca-411d492a7102 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:36 user nova-compute[74980]: DEBUG nova.compute.manager [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:21:37 user nova-compute[74980]: INFO nova.compute.claims [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Claim successful on node user
Nov 02 17:21:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:37 user nova-compute[74980]: INFO nova.compute.manager [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Terminating instance
Nov 02 17:21:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG nova.compute.manager [req-0590b458-4b80-4099-bd1b-b68328df1406 req-d68f6f03-e8f8-454f-8fb5-faefc775a63a service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received event network-vif-unplugged-7434f94a-713e-4434-9262-8da6a26d4006 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0590b458-4b80-4099-bd1b-b68328df1406 req-d68f6f03-e8f8-454f-8fb5-faefc775a63a service nova] Acquiring lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0590b458-4b80-4099-bd1b-b68328df1406 req-d68f6f03-e8f8-454f-8fb5-faefc775a63a service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0590b458-4b80-4099-bd1b-b68328df1406 req-d68f6f03-e8f8-454f-8fb5-faefc775a63a service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG nova.compute.manager [req-0590b458-4b80-4099-bd1b-b68328df1406 req-d68f6f03-e8f8-454f-8fb5-faefc775a63a service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] No waiting events found dispatching network-vif-unplugged-7434f94a-713e-4434-9262-8da6a26d4006 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG nova.compute.manager [req-0590b458-4b80-4099-bd1b-b68328df1406 req-d68f6f03-e8f8-454f-8fb5-faefc775a63a service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received event network-vif-unplugged-7434f94a-713e-4434-9262-8da6a26d4006 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG nova.network.neutron [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:21:37 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:21:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG nova.policy [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdf10ea963dd41a0b41493d5c9dd8d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c80ea4c5594618a1eb984162ab9a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:21:37 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Creating image(s)
Nov 02 17:21:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "/opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "/opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "/opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:38 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Instance destroyed successfully.
Nov 02 17:21:38 user nova-compute[74980]: DEBUG nova.objects.instance [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lazy-loading 'resources' on Instance uuid aeae0fe6-ffc2-48f7-8b59-c6485851be3d {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1956055295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1956055295',id=7,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxrQckQxr69xMzJYNTLEjM/WTe1wsExTJezKCnbJ7jnYlT8mZTga0YewAJ2OnZA6lwf50l3CWjDefeId4ykNOk9L89xqNa/3p6b4bQjrJI1+UpsUWudVowdG28U6uyqAA==',key_name='tempest-keypair-347748516',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='061cfdc41fc64eea9bd281d8c51424c8',ramdisk_id='',reservation_id='r-qbp9xyqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2126535582',owner_user_name='tempest-TaggedAttachmentsTest-2126535582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59c1bf383d2a48449244708dea3cd95b',uuid=aeae0fe6-ffc2-48f7-8b59-c6485851be3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7434f94a-713e-4434-9262-8da6a26d4006", "address": "fa:16:3e:d3:89:3a", "network": {"id": "6f6330e7-ef7b-4457-a97b-798bb8365964", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-523904489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7434f94a-71", "ovs_interfaceid": "7434f94a-713e-4434-9262-8da6a26d4006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Converting VIF {"id": "7434f94a-713e-4434-9262-8da6a26d4006", "address": "fa:16:3e:d3:89:3a", "network": {"id": "6f6330e7-ef7b-4457-a97b-798bb8365964", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-523904489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "061cfdc41fc64eea9bd281d8c51424c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7434f94a-71", "ovs_interfaceid": "7434f94a-713e-4434-9262-8da6a26d4006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:89:3a,bridge_name='br-int',has_traffic_filtering=True,id=7434f94a-713e-4434-9262-8da6a26d4006,network=Network(6f6330e7-ef7b-4457-a97b-798bb8365964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7434f94a-71') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG os_vif [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:89:3a,bridge_name='br-int',has_traffic_filtering=True,id=7434f94a-713e-4434-9262-8da6a26d4006,network=Network(6f6330e7-ef7b-4457-a97b-798bb8365964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7434f94a-71') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7434f94a-71, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5e6118c-45c9-44cf-8505-744831b2954e) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:38 user nova-compute[74980]: INFO os_vif [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:89:3a,bridge_name='br-int',has_traffic_filtering=True,id=7434f94a-713e-4434-9262-8da6a26d4006,network=Network(6f6330e7-ef7b-4457-a97b-798bb8365964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7434f94a-71')
Nov 02 17:21:38 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Deleting instance files /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d_del
Nov 02 17:21:38 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Deletion of /opt/stack/data/nova/instances/aeae0fe6-ffc2-48f7-8b59-c6485851be3d_del complete
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.211s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:38 user nova-compute[74980]: INFO nova.compute.manager [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk 1073741824" returned: 0 in 0.058s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.191s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Checking if we can resize image /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG nova.network.neutron [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Successfully created port: 7dcf262e-6a64-49f5-a219-26c869fe1d6f {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Cannot resize image /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Ensure instance console log exists: /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:39 user nova-compute[74980]: DEBUG nova.compute.manager [req-6cae1608-8497-440f-91b2-066bce5804bc req-cb2894d8-ae9e-4fea-8963-6bcb58af4f38 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received event network-vif-plugged-7434f94a-713e-4434-9262-8da6a26d4006 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6cae1608-8497-440f-91b2-066bce5804bc req-cb2894d8-ae9e-4fea-8963-6bcb58af4f38 service nova] Acquiring lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6cae1608-8497-440f-91b2-066bce5804bc req-cb2894d8-ae9e-4fea-8963-6bcb58af4f38 service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6cae1608-8497-440f-91b2-066bce5804bc req-cb2894d8-ae9e-4fea-8963-6bcb58af4f38 service nova] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:39 user nova-compute[74980]: DEBUG nova.compute.manager [req-6cae1608-8497-440f-91b2-066bce5804bc req-cb2894d8-ae9e-4fea-8963-6bcb58af4f38 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] No waiting events found dispatching network-vif-plugged-7434f94a-713e-4434-9262-8da6a26d4006 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:39 user nova-compute[74980]: WARNING nova.compute.manager [req-6cae1608-8497-440f-91b2-066bce5804bc req-cb2894d8-ae9e-4fea-8963-6bcb58af4f38 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received unexpected event network-vif-plugged-7434f94a-713e-4434-9262-8da6a26d4006 for instance with vm_state active and task_state deleting.
Nov 02 17:21:39 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:39 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Took 1.51 seconds to deallocate network for instance.
Nov 02 17:21:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.network.neutron [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Successfully updated port: 7dcf262e-6a64-49f5-a219-26c869fe1d6f {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "refresh_cache-854dd67d-7e05-47ad-b60a-23b9673bb8cd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquired lock "refresh_cache-854dd67d-7e05-47ad-b60a-23b9673bb8cd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.network.neutron [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.network.neutron [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:40 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Deleted allocations for instance aeae0fe6-ffc2-48f7-8b59-c6485851be3d
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.network.neutron [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Updating instance_info_cache with network_info: [{"id": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "address": "fa:16:3e:3e:90:82", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dcf262e-6a", "ovs_interfaceid": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e972f555-7594-4495-a797-4509d24dc882 tempest-TaggedAttachmentsTest-2126535582 tempest-TaggedAttachmentsTest-2126535582-project-member] Lock "aeae0fe6-ffc2-48f7-8b59-c6485851be3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.191s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Releasing lock "refresh_cache-854dd67d-7e05-47ad-b60a-23b9673bb8cd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.compute.manager [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Instance network_info: |[{"id": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "address": "fa:16:3e:3e:90:82", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dcf262e-6a", "ovs_interfaceid": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Start _get_guest_xml network_info=[{"id": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "address": "fa:16:3e:3e:90:82", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dcf262e-6a", "ovs_interfaceid": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:21:40 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:21:40 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1161190547',display_name='tempest-VolumesAdminNegativeTest-server-1161190547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1161190547',id=16,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c80ea4c5594618a1eb984162ab9a88',ramdisk_id='',reservation_id='r-yt7yimg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1454371770',owner_user_name='tempest-VolumesAdminNegativeTest-1454371770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:21:38Z,user_data=None,user_id='fdf10ea963dd41a0b41493d5c9dd8d4a',uuid=854dd67d-7e05-47ad-b60a-23b9673bb8cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "address": "fa:16:3e:3e:90:82", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dcf262e-6a", "ovs_interfaceid": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Converting VIF {"id": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "address": "fa:16:3e:3e:90:82", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dcf262e-6a", "ovs_interfaceid": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:90:82,bridge_name='br-int',has_traffic_filtering=True,id=7dcf262e-6a64-49f5-a219-26c869fe1d6f,network=Network(d2d80d29-bc80-47d0-b989-112114a8523e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dcf262e-6a') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.objects.instance [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lazy-loading 'pci_devices' on Instance uuid 854dd67d-7e05-47ad-b60a-23b9673bb8cd {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:21:40 user nova-compute[74980]:   <uuid>854dd67d-7e05-47ad-b60a-23b9673bb8cd</uuid>
Nov 02 17:21:40 user nova-compute[74980]:   <name>instance-00000010</name>
Nov 02 17:21:40 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:21:40 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:21:40 user nova-compute[74980]:   <metadata>
Nov 02 17:21:40 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:21:40 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:21:40 user nova-compute[74980]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1161190547</nova:name>
Nov 02 17:21:40 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:21:40</nova:creationTime>
Nov 02 17:21:40 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:21:40 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:21:40 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:21:40 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:21:40 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:21:40 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:21:40 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:21:40 user nova-compute[74980]:       <nova:owner>
Nov 02 17:21:40 user nova-compute[74980]:         <nova:user uuid="fdf10ea963dd41a0b41493d5c9dd8d4a">tempest-VolumesAdminNegativeTest-1454371770-project-member</nova:user>
Nov 02 17:21:40 user nova-compute[74980]:         <nova:project uuid="77c80ea4c5594618a1eb984162ab9a88">tempest-VolumesAdminNegativeTest-1454371770</nova:project>
Nov 02 17:21:40 user nova-compute[74980]:       </nova:owner>
Nov 02 17:21:40 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:21:40 user nova-compute[74980]:       <nova:ports>
Nov 02 17:21:40 user nova-compute[74980]:         <nova:port uuid="7dcf262e-6a64-49f5-a219-26c869fe1d6f">
Nov 02 17:21:40 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 17:21:40 user nova-compute[74980]:         </nova:port>
Nov 02 17:21:40 user nova-compute[74980]:       </nova:ports>
Nov 02 17:21:40 user nova-compute[74980]:     </nova:instance>
Nov 02 17:21:40 user nova-compute[74980]:   </metadata>
Nov 02 17:21:40 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:21:40 user nova-compute[74980]:     <system>
Nov 02 17:21:40 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:21:40 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:21:40 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:21:40 user nova-compute[74980]:       <entry name="serial">854dd67d-7e05-47ad-b60a-23b9673bb8cd</entry>
Nov 02 17:21:40 user nova-compute[74980]:       <entry name="uuid">854dd67d-7e05-47ad-b60a-23b9673bb8cd</entry>
Nov 02 17:21:40 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:21:40 user nova-compute[74980]:     </system>
Nov 02 17:21:40 user nova-compute[74980]:   </sysinfo>
Nov 02 17:21:40 user nova-compute[74980]:   <os>
Nov 02 17:21:40 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:21:40 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:21:40 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:21:40 user nova-compute[74980]:   </os>
Nov 02 17:21:40 user nova-compute[74980]:   <features>
Nov 02 17:21:40 user nova-compute[74980]:     <acpi/>
Nov 02 17:21:40 user nova-compute[74980]:     <apic/>
Nov 02 17:21:40 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:21:40 user nova-compute[74980]:   </features>
Nov 02 17:21:40 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:21:40 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:21:40 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:21:40 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:21:40 user nova-compute[74980]:   </clock>
Nov 02 17:21:40 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:21:40 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:21:40 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:21:40 user nova-compute[74980]:   </cpu>
Nov 02 17:21:40 user nova-compute[74980]:   <devices>
Nov 02 17:21:40 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:21:40 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:21:40 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk"/>
Nov 02 17:21:40 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:21:40 user nova-compute[74980]:     </disk>
Nov 02 17:21:40 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:21:40 user nova-compute[74980]:       <mac address="fa:16:3e:3e:90:82"/>
Nov 02 17:21:40 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:21:40 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:21:40 user nova-compute[74980]:       <target dev="tap7dcf262e-6a"/>
Nov 02 17:21:40 user nova-compute[74980]:     </interface>
Nov 02 17:21:40 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:21:40 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/console.log" append="off"/>
Nov 02 17:21:40 user nova-compute[74980]:     </serial>
Nov 02 17:21:40 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:21:40 user nova-compute[74980]:     <video>
Nov 02 17:21:40 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:21:40 user nova-compute[74980]:     </video>
Nov 02 17:21:40 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:21:40 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:21:40 user nova-compute[74980]:     </rng>
Nov 02 17:21:40 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:21:40 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:21:40 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:21:40 user nova-compute[74980]:     </memballoon>
Nov 02 17:21:40 user nova-compute[74980]:   </devices>
Nov 02 17:21:40 user nova-compute[74980]: </domain>
Nov 02 17:21:40 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1161190547',display_name='tempest-VolumesAdminNegativeTest-server-1161190547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1161190547',id=16,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c80ea4c5594618a1eb984162ab9a88',ramdisk_id='',reservation_id='r-yt7yimg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1454371770',owner_user_name='tempest-VolumesAdminNegativeTest-1454371770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:21:38Z,user_data=None,user_id='fdf10ea963dd41a0b41493d5c9dd8d4a',uuid=854dd67d-7e05-47ad-b60a-23b9673bb8cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "address": "fa:16:3e:3e:90:82", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dcf262e-6a", "ovs_interfaceid": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Converting VIF {"id": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "address": "fa:16:3e:3e:90:82", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dcf262e-6a", "ovs_interfaceid": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:90:82,bridge_name='br-int',has_traffic_filtering=True,id=7dcf262e-6a64-49f5-a219-26c869fe1d6f,network=Network(d2d80d29-bc80-47d0-b989-112114a8523e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dcf262e-6a') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG os_vif [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:90:82,bridge_name='br-int',has_traffic_filtering=True,id=7dcf262e-6a64-49f5-a219-26c869fe1d6f,network=Network(d2d80d29-bc80-47d0-b989-112114a8523e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dcf262e-6a') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1f588bc-e610-5cc0-8190-9a7ec8aba210', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7dcf262e-6a, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7dcf262e-6a, col_values=(('qos', UUID('9fbe9499-380f-422e-abc9-8172e0af6eeb')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7dcf262e-6a, col_values=(('external_ids', {'iface-id': '7dcf262e-6a64-49f5-a219-26c869fe1d6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:90:82', 'vm-uuid': '854dd67d-7e05-47ad-b60a-23b9673bb8cd'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:40 user nova-compute[74980]: INFO os_vif [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:90:82,bridge_name='br-int',has_traffic_filtering=True,id=7dcf262e-6a64-49f5-a219-26c869fe1d6f,network=Network(d2d80d29-bc80-47d0-b989-112114a8523e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dcf262e-6a')
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:21:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] No VIF found with MAC fa:16:3e:3e:90:82, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:21:41 user nova-compute[74980]: DEBUG nova.compute.manager [req-0f04d459-f97c-4032-9b5c-39d10ba43610 req-5140c3b2-c654-4508-932e-7ef61913a8e5 service nova] [instance: aeae0fe6-ffc2-48f7-8b59-c6485851be3d] Received event network-vif-deleted-7434f94a-713e-4434-9262-8da6a26d4006 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:41 user nova-compute[74980]: DEBUG nova.compute.manager [req-0f04d459-f97c-4032-9b5c-39d10ba43610 req-5140c3b2-c654-4508-932e-7ef61913a8e5 service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Received event network-changed-7dcf262e-6a64-49f5-a219-26c869fe1d6f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:41 user nova-compute[74980]: DEBUG nova.compute.manager [req-0f04d459-f97c-4032-9b5c-39d10ba43610 req-5140c3b2-c654-4508-932e-7ef61913a8e5 service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Refreshing instance network info cache due to event network-changed-7dcf262e-6a64-49f5-a219-26c869fe1d6f. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:21:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f04d459-f97c-4032-9b5c-39d10ba43610 req-5140c3b2-c654-4508-932e-7ef61913a8e5 service nova] Acquiring lock "refresh_cache-854dd67d-7e05-47ad-b60a-23b9673bb8cd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:21:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f04d459-f97c-4032-9b5c-39d10ba43610 req-5140c3b2-c654-4508-932e-7ef61913a8e5 service nova] Acquired lock "refresh_cache-854dd67d-7e05-47ad-b60a-23b9673bb8cd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:21:41 user nova-compute[74980]: DEBUG nova.network.neutron [req-0f04d459-f97c-4032-9b5c-39d10ba43610 req-5140c3b2-c654-4508-932e-7ef61913a8e5 service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Refreshing network info cache for port 7dcf262e-6a64-49f5-a219-26c869fe1d6f {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:21:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-673897ce-bf75-48e0-b7db-ab27aceadb5b req-87f372cf-dab2-42ee-ab3b-bdc688eb48c8 service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Received event network-vif-plugged-7dcf262e-6a64-49f5-a219-26c869fe1d6f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-673897ce-bf75-48e0-b7db-ab27aceadb5b req-87f372cf-dab2-42ee-ab3b-bdc688eb48c8 service nova] Acquiring lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-673897ce-bf75-48e0-b7db-ab27aceadb5b req-87f372cf-dab2-42ee-ab3b-bdc688eb48c8 service nova] Lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-673897ce-bf75-48e0-b7db-ab27aceadb5b req-87f372cf-dab2-42ee-ab3b-bdc688eb48c8 service nova] Lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-673897ce-bf75-48e0-b7db-ab27aceadb5b req-87f372cf-dab2-42ee-ab3b-bdc688eb48c8 service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] No waiting events found dispatching network-vif-plugged-7dcf262e-6a64-49f5-a219-26c869fe1d6f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:42 user nova-compute[74980]: WARNING nova.compute.manager [req-673897ce-bf75-48e0-b7db-ab27aceadb5b req-87f372cf-dab2-42ee-ab3b-bdc688eb48c8 service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Received unexpected event network-vif-plugged-7dcf262e-6a64-49f5-a219-26c869fe1d6f for instance with vm_state building and task_state spawning.
Nov 02 17:21:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:42 user nova-compute[74980]: DEBUG nova.network.neutron [req-0f04d459-f97c-4032-9b5c-39d10ba43610 req-5140c3b2-c654-4508-932e-7ef61913a8e5 service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Updated VIF entry in instance network info cache for port 7dcf262e-6a64-49f5-a219-26c869fe1d6f. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:21:42 user nova-compute[74980]: DEBUG nova.network.neutron [req-0f04d459-f97c-4032-9b5c-39d10ba43610 req-5140c3b2-c654-4508-932e-7ef61913a8e5 service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Updating instance_info_cache with network_info: [{"id": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "address": "fa:16:3e:3e:90:82", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dcf262e-6a", "ovs_interfaceid": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f04d459-f97c-4032-9b5c-39d10ba43610 req-5140c3b2-c654-4508-932e-7ef61913a8e5 service nova] Releasing lock "refresh_cache-854dd67d-7e05-47ad-b60a-23b9673bb8cd" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-a705c025-7d14-4d45-921a-77077c808667 req-27ee1adb-6c19-4ac9-b0a6-24122458e6e3 service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Received event network-vif-plugged-7dcf262e-6a64-49f5-a219-26c869fe1d6f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a705c025-7d14-4d45-921a-77077c808667 req-27ee1adb-6c19-4ac9-b0a6-24122458e6e3 service nova] Acquiring lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a705c025-7d14-4d45-921a-77077c808667 req-27ee1adb-6c19-4ac9-b0a6-24122458e6e3 service nova] Lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a705c025-7d14-4d45-921a-77077c808667 req-27ee1adb-6c19-4ac9-b0a6-24122458e6e3 service nova] Lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-a705c025-7d14-4d45-921a-77077c808667 req-27ee1adb-6c19-4ac9-b0a6-24122458e6e3 service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] No waiting events found dispatching network-vif-plugged-7dcf262e-6a64-49f5-a219-26c869fe1d6f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:44 user nova-compute[74980]: WARNING nova.compute.manager [req-a705c025-7d14-4d45-921a-77077c808667 req-27ee1adb-6c19-4ac9-b0a6-24122458e6e3 service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Received unexpected event network-vif-plugged-7dcf262e-6a64-49f5-a219-26c869fe1d6f for instance with vm_state building and task_state spawning.
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.compute.manager [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:21:44 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Instance spawned successfully.
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:44 user nova-compute[74980]: INFO nova.compute.manager [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Took 6.57 seconds to spawn the instance on the hypervisor.
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.compute.manager [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.compute.manager [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:21:44 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Creating image(s)
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Ensure instance console log exists: /opt/stack/data/nova/instances/22b8ca59-959d-4687-bb7d-4fc7909aa852/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Start _get_guest_xml network_info=[{"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFxWpjSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '22b8ca59-959d-4687-bb7d-4fc7909aa852', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbbeebc5-6eb4-4321-a394-86cbcd00837e', 'serial': 'cbbeebc5-6eb4-4321-a394-86cbcd00837e'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '4bb329f7-6911-41ec-8952-af66abef5a3a', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:21:44 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:21:44 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFxWpjSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:21:44 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:21:44 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:21:44 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:44 user nova-compute[74980]: INFO nova.compute.manager [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Took 7.67 seconds to build instance.
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1b3309-e8d6-4a82-b82e-d853d6bcc4f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:21:44 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-62b0eec2-567b-46e1-b27b-d5469ac08e19 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.801s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06b1031-a06f-4d3e-9acc-fb4c63a195cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e] added
Nov 02 17:21:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5243c4-07fb-4ca0-8d96-6c2aa0dcbdfa]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e75e5a-9ef5-4c55-9981-22b256935802]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFxWpjSZ {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFxWpjSZ" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5598f0e-b644-40cc-9ad7-660ce1e54234]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lFxWpjSZ'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9deb5868-fc33-47fd-a160-fb138427829d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9d6d73-d88f-4bae-8ecb-ee746e0e841c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:44 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:21:44 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:44 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:21:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:44 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:21:44 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:44 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:21:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[61edb3e5-d8da-4855-b41f-fd90340a0703]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260]
Nov 02 17:21:44 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260] successful.
Nov 02 17:21:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4430f71-cec0-476f-9e32-80e2cf1a6e24]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d35f7a1-de13-44c5-a34a-99ad3bc81658]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:21:44 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:44 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:21:44 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:44 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:21:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:21:44 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:44 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:21:44 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:44 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:21:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:21:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d25c27d-d34a-4101-910a-7c54a7e1f411]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:45 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:21:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFxWpjSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:21:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26630663736626635', 'path': '/dev/sdd'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630663736626635', 'path': '/dev/sdd'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:21:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1948769732',display_name='tempest-TestShelveInstance-server-1948769732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1948769732',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBv3hFR2ExwN4lcjeGa2BdBDTiPIvIMfgWaKwc9SINl9eWcOYXiCvZXCh1PVrKZ4XQ7kVoydP62j/N7Nn/Kp/S+xJZS5UnPB8y1PQFmO4tQR+kVUHM2f0tUgKhLjr+OWsw==',key_name='tempest-TestShelveInstance-713239200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3cf3b7e1970d471d8a80d04497963276',ramdisk_id='',reservation_id='r-00qsqblb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1367401440',owner_user_name='tempest-TestShelveInstance-1367401440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:21:22Z,user_data=None,user_id='9c5c816110044002a6753a93e13459fc',uuid=22b8ca59-959d-4687-bb7d-4fc7909aa852,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Converting VIF {"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:1c:d0,bridge_name='br-int',has_traffic_filtering=True,id=1d0a548b-f00a-401b-9867-c1b9a4ee8d20,network=Network(6009ce0d-3076-4e9a-85f6-3ca97fcd5457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0a548b-f0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG nova.objects.instance [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lazy-loading 'pci_devices' on Instance uuid 22b8ca59-959d-4687-bb7d-4fc7909aa852 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:21:46 user nova-compute[74980]:   <uuid>22b8ca59-959d-4687-bb7d-4fc7909aa852</uuid>
Nov 02 17:21:46 user nova-compute[74980]:   <name>instance-0000000f</name>
Nov 02 17:21:46 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:21:46 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:21:46 user nova-compute[74980]:   <metadata>
Nov 02 17:21:46 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:21:46 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:21:46 user nova-compute[74980]:       <nova:name>tempest-TestShelveInstance-server-1948769732</nova:name>
Nov 02 17:21:46 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:21:44</nova:creationTime>
Nov 02 17:21:46 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:21:46 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:21:46 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:21:46 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:21:46 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:21:46 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:21:46 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:21:46 user nova-compute[74980]:       <nova:owner>
Nov 02 17:21:46 user nova-compute[74980]:         <nova:user uuid="9c5c816110044002a6753a93e13459fc">tempest-TestShelveInstance-1367401440-project-member</nova:user>
Nov 02 17:21:46 user nova-compute[74980]:         <nova:project uuid="3cf3b7e1970d471d8a80d04497963276">tempest-TestShelveInstance-1367401440</nova:project>
Nov 02 17:21:46 user nova-compute[74980]:       </nova:owner>
Nov 02 17:21:46 user nova-compute[74980]:       <nova:ports>
Nov 02 17:21:46 user nova-compute[74980]:         <nova:port uuid="1d0a548b-f00a-401b-9867-c1b9a4ee8d20">
Nov 02 17:21:46 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 17:21:46 user nova-compute[74980]:         </nova:port>
Nov 02 17:21:46 user nova-compute[74980]:       </nova:ports>
Nov 02 17:21:46 user nova-compute[74980]:     </nova:instance>
Nov 02 17:21:46 user nova-compute[74980]:   </metadata>
Nov 02 17:21:46 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:21:46 user nova-compute[74980]:     <system>
Nov 02 17:21:46 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:21:46 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:21:46 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:21:46 user nova-compute[74980]:       <entry name="serial">22b8ca59-959d-4687-bb7d-4fc7909aa852</entry>
Nov 02 17:21:46 user nova-compute[74980]:       <entry name="uuid">22b8ca59-959d-4687-bb7d-4fc7909aa852</entry>
Nov 02 17:21:46 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:21:46 user nova-compute[74980]:     </system>
Nov 02 17:21:46 user nova-compute[74980]:   </sysinfo>
Nov 02 17:21:46 user nova-compute[74980]:   <os>
Nov 02 17:21:46 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:21:46 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:21:46 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:21:46 user nova-compute[74980]:   </os>
Nov 02 17:21:46 user nova-compute[74980]:   <features>
Nov 02 17:21:46 user nova-compute[74980]:     <acpi/>
Nov 02 17:21:46 user nova-compute[74980]:     <apic/>
Nov 02 17:21:46 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:21:46 user nova-compute[74980]:   </features>
Nov 02 17:21:46 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:21:46 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:21:46 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:21:46 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:21:46 user nova-compute[74980]:   </clock>
Nov 02 17:21:46 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:21:46 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:21:46 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:21:46 user nova-compute[74980]:   </cpu>
Nov 02 17:21:46 user nova-compute[74980]:   <devices>
Nov 02 17:21:46 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:21:46 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:21:46 user nova-compute[74980]:       <source dev="/dev/sdd"/>
Nov 02 17:21:46 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:21:46 user nova-compute[74980]:       <serial>cbbeebc5-6eb4-4321-a394-86cbcd00837e</serial>
Nov 02 17:21:46 user nova-compute[74980]:     </disk>
Nov 02 17:21:46 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:21:46 user nova-compute[74980]:       <mac address="fa:16:3e:d8:1c:d0"/>
Nov 02 17:21:46 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:21:46 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:21:46 user nova-compute[74980]:       <target dev="tap1d0a548b-f0"/>
Nov 02 17:21:46 user nova-compute[74980]:     </interface>
Nov 02 17:21:46 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:21:46 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/22b8ca59-959d-4687-bb7d-4fc7909aa852/console.log" append="off"/>
Nov 02 17:21:46 user nova-compute[74980]:     </serial>
Nov 02 17:21:46 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:21:46 user nova-compute[74980]:     <video>
Nov 02 17:21:46 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:21:46 user nova-compute[74980]:     </video>
Nov 02 17:21:46 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:21:46 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:21:46 user nova-compute[74980]:     </rng>
Nov 02 17:21:46 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:21:46 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:21:46 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:21:46 user nova-compute[74980]:     </memballoon>
Nov 02 17:21:46 user nova-compute[74980]:   </devices>
Nov 02 17:21:46 user nova-compute[74980]: </domain>
Nov 02 17:21:46 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:21:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1948769732',display_name='tempest-TestShelveInstance-server-1948769732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1948769732',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBv3hFR2ExwN4lcjeGa2BdBDTiPIvIMfgWaKwc9SINl9eWcOYXiCvZXCh1PVrKZ4XQ7kVoydP62j/N7Nn/Kp/S+xJZS5UnPB8y1PQFmO4tQR+kVUHM2f0tUgKhLjr+OWsw==',key_name='tempest-TestShelveInstance-713239200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3cf3b7e1970d471d8a80d04497963276',ramdisk_id='',reservation_id='r-00qsqblb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1367401440',owner_user_name='tempest-TestShelveInstance-1367401440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:21:22Z,user_data=None,user_id='9c5c816110044002a6753a93e13459fc',uuid=22b8ca59-959d-4687-bb7d-4fc7909aa852,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Converting VIF {"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:1c:d0,bridge_name='br-int',has_traffic_filtering=True,id=1d0a548b-f00a-401b-9867-c1b9a4ee8d20,network=Network(6009ce0d-3076-4e9a-85f6-3ca97fcd5457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0a548b-f0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG os_vif [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:1c:d0,bridge_name='br-int',has_traffic_filtering=True,id=1d0a548b-f00a-401b-9867-c1b9a4ee8d20,network=Network(6009ce0d-3076-4e9a-85f6-3ca97fcd5457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0a548b-f0') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '867833ea-2c98-5193-b92f-50a3e385f071', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d0a548b-f0, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d0a548b-f0, col_values=(('qos', UUID('a4ff7b71-5387-4e9b-9e3c-820415ee4e71')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d0a548b-f0, col_values=(('external_ids', {'iface-id': '1d0a548b-f00a-401b-9867-c1b9a4ee8d20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:1c:d0', 'vm-uuid': '22b8ca59-959d-4687-bb7d-4fc7909aa852'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:46 user nova-compute[74980]: INFO os_vif [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:1c:d0,bridge_name='br-int',has_traffic_filtering=True,id=1d0a548b-f00a-401b-9867-c1b9a4ee8d20,network=Network(6009ce0d-3076-4e9a-85f6-3ca97fcd5457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0a548b-f0')
Nov 02 17:21:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:21:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] No VIF found with MAC fa:16:3e:d8:1c:d0, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:21:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-9486078f-316b-41d3-b10c-4d55ef70641c req-1d6a1f44-eeb0-4d50-873c-ed0a2251449e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-changed-65610a01-9aaa-4755-ba01-ee4e72320408 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-9486078f-316b-41d3-b10c-4d55ef70641c req-1d6a1f44-eeb0-4d50-873c-ed0a2251449e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing instance network info cache due to event network-changed-65610a01-9aaa-4755-ba01-ee4e72320408. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:21:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9486078f-316b-41d3-b10c-4d55ef70641c req-1d6a1f44-eeb0-4d50-873c-ed0a2251449e service nova] Acquiring lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:21:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9486078f-316b-41d3-b10c-4d55ef70641c req-1d6a1f44-eeb0-4d50-873c-ed0a2251449e service nova] Acquired lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:21:47 user nova-compute[74980]: DEBUG nova.network.neutron [req-9486078f-316b-41d3-b10c-4d55ef70641c req-1d6a1f44-eeb0-4d50-873c-ed0a2251449e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Refreshing network info cache for port 65610a01-9aaa-4755-ba01-ee4e72320408 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:21:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:48 user nova-compute[74980]: DEBUG nova.network.neutron [req-9486078f-316b-41d3-b10c-4d55ef70641c req-1d6a1f44-eeb0-4d50-873c-ed0a2251449e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updated VIF entry in instance network info cache for port 65610a01-9aaa-4755-ba01-ee4e72320408. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:21:48 user nova-compute[74980]: DEBUG nova.network.neutron [req-9486078f-316b-41d3-b10c-4d55ef70641c req-1d6a1f44-eeb0-4d50-873c-ed0a2251449e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating instance_info_cache with network_info: [{"id": "65610a01-9aaa-4755-ba01-ee4e72320408", "address": "fa:16:3e:2b:15:2f", "network": {"id": "e9224f9b-af21-4b41-a592-576ca0bb5ca6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925418223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65610a01-9a", "ovs_interfaceid": "65610a01-9aaa-4755-ba01-ee4e72320408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "address": "fa:16:3e:5a:18:ac", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774d9b42-ed", "ovs_interfaceid": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "address": "fa:16:3e:e4:49:2a", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b25c905-b2", "ovs_interfaceid": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b98210b-a018-4279-8528-69992920e5cc", "address": "fa:16:3e:4a:c0:98", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b98210b-a0", "ovs_interfaceid": "4b98210b-a018-4279-8528-69992920e5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9486078f-316b-41d3-b10c-4d55ef70641c req-1d6a1f44-eeb0-4d50-873c-ed0a2251449e service nova] Releasing lock "refresh_cache-3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:21:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "e9d8737b-e341-4c00-bb8c-6e1847d24418" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "e9d8737b-e341-4c00-bb8c-6e1847d24418" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:49 user nova-compute[74980]: INFO nova.compute.manager [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Unshelving
Nov 02 17:21:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:49 user nova-compute[74980]: INFO nova.virt.block_device [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Booting with volume a16f135a-e063-45ce-9150-324a8e7c977b at /dev/vdc
Nov 02 17:21:49 user nova-compute[74980]: DEBUG os_brick.utils [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9984a1f-e0f9-4620-a64f-9c8ddd6ca5a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49b4271-97f9-4afa-9952-a70bfdcad403]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[09de648e-aeca-4435-a420-ba8c2f8ad7f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc499f7-28ae-43cf-8f23-464508920620]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:21:49 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca4ba5a-7619-44f6-90bc-014cd4d3425b]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG os_brick.utils [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Updating existing volume attachment record: 5c7999e7-e1b2-41e7-aa00-bd519daf24ae {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-22e98690-343d-4a39-84ec-1ee529db0697 req-7b544e13-9349-41a6-a6d1-9fe919bc02f9 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received event network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-22e98690-343d-4a39-84ec-1ee529db0697 req-7b544e13-9349-41a6-a6d1-9fe919bc02f9 service nova] Acquiring lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-22e98690-343d-4a39-84ec-1ee529db0697 req-7b544e13-9349-41a6-a6d1-9fe919bc02f9 service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-22e98690-343d-4a39-84ec-1ee529db0697 req-7b544e13-9349-41a6-a6d1-9fe919bc02f9 service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-22e98690-343d-4a39-84ec-1ee529db0697 req-7b544e13-9349-41a6-a6d1-9fe919bc02f9 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] No waiting events found dispatching network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:49 user nova-compute[74980]: WARNING nova.compute.manager [req-22e98690-343d-4a39-84ec-1ee529db0697 req-7b544e13-9349-41a6-a6d1-9fe919bc02f9 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received unexpected event network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 for instance with vm_state building and task_state spawning.
Nov 02 17:21:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-22e98690-343d-4a39-84ec-1ee529db0697 req-7b544e13-9349-41a6-a6d1-9fe919bc02f9 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received event network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-22e98690-343d-4a39-84ec-1ee529db0697 req-7b544e13-9349-41a6-a6d1-9fe919bc02f9 service nova] Acquiring lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-22e98690-343d-4a39-84ec-1ee529db0697 req-7b544e13-9349-41a6-a6d1-9fe919bc02f9 service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-22e98690-343d-4a39-84ec-1ee529db0697 req-7b544e13-9349-41a6-a6d1-9fe919bc02f9 service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-22e98690-343d-4a39-84ec-1ee529db0697 req-7b544e13-9349-41a6-a6d1-9fe919bc02f9 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] No waiting events found dispatching network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:49 user nova-compute[74980]: WARNING nova.compute.manager [req-22e98690-343d-4a39-84ec-1ee529db0697 req-7b544e13-9349-41a6-a6d1-9fe919bc02f9 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received unexpected event network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 for instance with vm_state building and task_state spawning.
Nov 02 17:21:50 user nova-compute[74980]: DEBUG nova.compute.manager [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:21:50 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Instance spawned successfully.
Nov 02 17:21:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:50 user nova-compute[74980]: INFO nova.compute.manager [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 02 17:21:50 user nova-compute[74980]: DEBUG nova.compute.manager [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:50 user nova-compute[74980]: INFO nova.compute.manager [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Terminating instance
Nov 02 17:21:50 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:21:50 user nova-compute[74980]: INFO nova.compute.manager [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Took 29.29 seconds to build instance.
Nov 02 17:21:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-13aaed60-7058-4e02-bbaa-a52db0965dd4 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.396s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-8f57915d-a17b-4baf-a96f-5e9d4e852b42 req-5696e47d-3adc-4669-b324-afdc5bdb3ce5 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-unplugged-65610a01-9aaa-4755-ba01-ee4e72320408 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8f57915d-a17b-4baf-a96f-5e9d4e852b42 req-5696e47d-3adc-4669-b324-afdc5bdb3ce5 service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8f57915d-a17b-4baf-a96f-5e9d4e852b42 req-5696e47d-3adc-4669-b324-afdc5bdb3ce5 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8f57915d-a17b-4baf-a96f-5e9d4e852b42 req-5696e47d-3adc-4669-b324-afdc5bdb3ce5 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-8f57915d-a17b-4baf-a96f-5e9d4e852b42 req-5696e47d-3adc-4669-b324-afdc5bdb3ce5 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-unplugged-65610a01-9aaa-4755-ba01-ee4e72320408 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-8f57915d-a17b-4baf-a96f-5e9d4e852b42 req-5696e47d-3adc-4669-b324-afdc5bdb3ce5 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-unplugged-65610a01-9aaa-4755-ba01-ee4e72320408 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:21:51 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Creating image(s)
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Ensure instance console log exists: /opt/stack/data/nova/instances/82362140-8606-41dc-a574-86b0b89a7a35/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Start _get_guest_xml network_info=[{"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuIqYUnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82362140-8606-41dc-a574-86b0b89a7a35', 'attached_at': '', 'detached_at': '', 'volume_id': '756ebe57-479f-485e-8091-9f3771aea8cf', 'serial': '756ebe57-479f-485e-8091-9f3771aea8cf'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '5b0e1933-6186-4e3a-a4b8-4bc32e1440de', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:21:51 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 17:21:51 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.objects.instance [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lazy-loading 'vcpu_model' on Instance uuid 82362140-8606-41dc-a574-86b0b89a7a35 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuIqYUnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:21:51 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 17:21:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:21:51 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 17:21:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:21:51 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:21:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c99a28e-df8a-4a18-b95b-316c0d351243]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:21:51 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-2ec82e38-eed0-4625-9b97-64e1148fad66 req-b400d6f8-bfe1-42a6-8ce8-68bb8db740c8 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-unplugged-8b69b12c-b024-44d8-81ff-7c6c9f869743 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2ec82e38-eed0-4625-9b97-64e1148fad66 req-b400d6f8-bfe1-42a6-8ce8-68bb8db740c8 service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2ec82e38-eed0-4625-9b97-64e1148fad66 req-b400d6f8-bfe1-42a6-8ce8-68bb8db740c8 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2ec82e38-eed0-4625-9b97-64e1148fad66 req-b400d6f8-bfe1-42a6-8ce8-68bb8db740c8 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-2ec82e38-eed0-4625-9b97-64e1148fad66 req-b400d6f8-bfe1-42a6-8ce8-68bb8db740c8 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-unplugged-8b69b12c-b024-44d8-81ff-7c6c9f869743 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-2ec82e38-eed0-4625-9b97-64e1148fad66 req-b400d6f8-bfe1-42a6-8ce8-68bb8db740c8 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-unplugged-8b69b12c-b024-44d8-81ff-7c6c9f869743 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2546dd-c1cc-46b9-baa1-373498a2b4e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf] added
Nov 02 17:21:52 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.064s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb7f84f-1fe4-4f25-aaa4-e79ce35028ca]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.073s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cc30c6-8a19-438d-be73-2b61975335b9]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NuIqYUnX {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NuIqYUnX" returned: 0 in 0.143s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d36a48-613e-4344-b6e8-efbe622be1a4]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NuIqYUnX'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[112be8f1-b4ed-4b51-9f90-8741c5a7149f]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55f7755-8197-4785-926d-ef1e7cb88367]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:21:52 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:52 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:21:52 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:52 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:21:52 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:21:52 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:52 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:21:52 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:52 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:21:52 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --login" returned: 0 in 0.366s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74e5344-93e6-4a76-aa1a-1529fbc33c31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260]
Nov 02 17:21:52 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260] successful.
Nov 02 17:21:52 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.051s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1393ce-239a-472a-91fe-d757a3e67b2a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[10db36c7-9f0f-4304-9dc0-a9e242339fe1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:21:53 user nova-compute[74980]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:21:53 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:53 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:21:53 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:53 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:21:53 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:21:53 user nova-compute[74980]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:21:53 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:53 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:21:53 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:53 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:21:53 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.061s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[378d75a1-2ed8-4b23-b203-8f1499292624]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuIqYUnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:21:53 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Instance destroyed successfully.
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.objects.instance [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lazy-loading 'resources' on Instance uuid 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:20:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65610a01-9aaa-4755-ba01-ee4e72320408", "address": "fa:16:3e:2b:15:2f", "network": {"id": "e9224f9b-af21-4b41-a592-576ca0bb5ca6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925418223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65610a01-9a", "ovs_interfaceid": "65610a01-9aaa-4755-ba01-ee4e72320408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "65610a01-9aaa-4755-ba01-ee4e72320408", "address": "fa:16:3e:2b:15:2f", "network": {"id": "e9224f9b-af21-4b41-a592-576ca0bb5ca6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925418223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65610a01-9a", "ovs_interfaceid": "65610a01-9aaa-4755-ba01-ee4e72320408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=65610a01-9aaa-4755-ba01-ee4e72320408,network=Network(e9224f9b-af21-4b41-a592-576ca0bb5ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65610a01-9a') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=65610a01-9aaa-4755-ba01-ee4e72320408,network=Network(e9224f9b-af21-4b41-a592-576ca0bb5ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65610a01-9a') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65610a01-9a, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-65610a01-9aaa-4755-ba01-ee4e72320408 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-65610a01-9aaa-4755-ba01-ee4e72320408 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:53 user nova-compute[74980]: WARNING nova.compute.manager [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-65610a01-9aaa-4755-ba01-ee4e72320408 for instance with vm_state active and task_state deleting.
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-unplugged-97328bbf-6210-4167-98ef-df662837d418 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-unplugged-97328bbf-6210-4167-98ef-df662837d418 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-unplugged-97328bbf-6210-4167-98ef-df662837d418 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-97328bbf-6210-4167-98ef-df662837d418 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-97328bbf-6210-4167-98ef-df662837d418 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:53 user nova-compute[74980]: WARNING nova.compute.manager [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-97328bbf-6210-4167-98ef-df662837d418 for instance with vm_state active and task_state deleting.
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-unplugged-43469d86-f716-49ce-bb76-f9cc4016366b {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-unplugged-43469d86-f716-49ce-bb76-f9cc4016366b {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-unplugged-43469d86-f716-49ce-bb76-f9cc4016366b for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-43469d86-f716-49ce-bb76-f9cc4016366b {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-43469d86-f716-49ce-bb76-f9cc4016366b {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:53 user nova-compute[74980]: WARNING nova.compute.manager [req-21104ce5-b4ac-468d-8c58-03532f3eb453 req-acd57e46-a1d4-4366-8137-3562694eae0c service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-43469d86-f716-49ce-bb76-f9cc4016366b for instance with vm_state active and task_state deleting.
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=229c7557-78c6-44b2-9f0b-54194e552e13) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: INFO os_vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:15:2f,bridge_name='br-int',has_traffic_filtering=True,id=65610a01-9aaa-4755-ba01-ee4e72320408,network=Network(e9224f9b-af21-4b41-a592-576ca0bb5ca6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65610a01-9a')
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:20:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f7:d8,bridge_name='br-int',has_traffic_filtering=True,id=97328bbf-6210-4167-98ef-df662837d418,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap97328bbf-62') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f7:d8,bridge_name='br-int',has_traffic_filtering=True,id=97328bbf-6210-4167-98ef-df662837d418,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap97328bbf-62') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97328bbf-62, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b595a5fb-e913-4529-a4ec-469f6f05b1a2) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: INFO os_vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f7:d8,bridge_name='br-int',has_traffic_filtering=True,id=97328bbf-6210-4167-98ef-df662837d418,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap97328bbf-62')
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:20:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:69:94,bridge_name='br-int',has_traffic_filtering=True,id=43469d86-f716-49ce-bb76-f9cc4016366b,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap43469d86-f7') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:69:94,bridge_name='br-int',has_traffic_filtering=True,id=43469d86-f716-49ce-bb76-f9cc4016366b,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap43469d86-f7') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43469d86-f7, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=203a977d-bea6-4650-b793-3eb611bd0776) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: INFO os_vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:69:94,bridge_name='br-int',has_traffic_filtering=True,id=43469d86-f716-49ce-bb76-f9cc4016366b,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap43469d86-f7')
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:20:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "address": "fa:16:3e:5a:18:ac", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774d9b42-ed", "ovs_interfaceid": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "address": "fa:16:3e:5a:18:ac", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774d9b42-ed", "ovs_interfaceid": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:18:ac,bridge_name='br-int',has_traffic_filtering=True,id=774d9b42-edc6-4b48-92cc-ab4aed571c55,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap774d9b42-ed') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:18:ac,bridge_name='br-int',has_traffic_filtering=True,id=774d9b42-edc6-4b48-92cc-ab4aed571c55,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap774d9b42-ed') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap774d9b42-ed, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47ad4a6e-f23b-4427-9580-5573779247de) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: INFO os_vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:18:ac,bridge_name='br-int',has_traffic_filtering=True,id=774d9b42-edc6-4b48-92cc-ab4aed571c55,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap774d9b42-ed')
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:20:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "address": "fa:16:3e:e4:49:2a", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b25c905-b2", "ovs_interfaceid": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "address": "fa:16:3e:e4:49:2a", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b25c905-b2", "ovs_interfaceid": "2b25c905-b2e0-4108-8cfc-f98176dbcb80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:49:2a,bridge_name='br-int',has_traffic_filtering=True,id=2b25c905-b2e0-4108-8cfc-f98176dbcb80,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b25c905-b2') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:49:2a,bridge_name='br-int',has_traffic_filtering=True,id=2b25c905-b2e0-4108-8cfc-f98176dbcb80,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b25c905-b2') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b25c905-b2, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2e460be-caf9-4540-8c9e-8de372c3532a) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: INFO os_vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:49:2a,bridge_name='br-int',has_traffic_filtering=True,id=2b25c905-b2e0-4108-8cfc-f98176dbcb80,network=Network(8416dfc7-2923-4c03-afed-c32e70cf1e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b25c905-b2')
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:20:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b98210b-a018-4279-8528-69992920e5cc", "address": "fa:16:3e:4a:c0:98", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b98210b-a0", "ovs_interfaceid": "4b98210b-a018-4279-8528-69992920e5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "4b98210b-a018-4279-8528-69992920e5cc", "address": "fa:16:3e:4a:c0:98", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b98210b-a0", "ovs_interfaceid": "4b98210b-a018-4279-8528-69992920e5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c0:98,bridge_name='br-int',has_traffic_filtering=True,id=4b98210b-a018-4279-8528-69992920e5cc,network=Network(388d3a91-478d-4088-8785-5d6ae280cf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b98210b-a0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c0:98,bridge_name='br-int',has_traffic_filtering=True,id=4b98210b-a018-4279-8528-69992920e5cc,network=Network(388d3a91-478d-4088-8785-5d6ae280cf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b98210b-a0') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b98210b-a0, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41f89570-206a-4eec-a813-2d6b0544e171) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: INFO os_vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c0:98,bridge_name='br-int',has_traffic_filtering=True,id=4b98210b-a018-4279-8528-69992920e5cc,network=Network(388d3a91-478d-4088-8785-5d6ae280cf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b98210b-a0')
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T17:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936774023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936774023',id=11,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhXmaaB//aqvaoObqic8ybSibjXQiT6fKGwogeORc16ZYekH1Ml7c0XBtXNe2XEQ5jhMq+5YMg6i6lzjxTZJUrLX9QC8lNkPKbmDr6Hh19VIEKWvAtorFoV3gb6Oy5Fg==',key_name='tempest-keypair-995240771',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5bd832a86ce41938aedfddef7ac7fd5',ramdisk_id='',reservation_id='r-8evuhskc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1889592963',owner_user_name='tempest-TaggedBootDevicesTest_v242-1889592963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:20:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e420faa880a6456bbd1d7d63d8af2883',uuid=3587ff70-6c7d-4753-91f7-d7ee1dc8bdac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converting VIF {"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:96:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b69b12c-b024-44d8-81ff-7c6c9f869743,network=Network(388d3a91-478d-4088-8785-5d6ae280cf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b69b12c-b0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:96:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b69b12c-b024-44d8-81ff-7c6c9f869743,network=Network(388d3a91-478d-4088-8785-5d6ae280cf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b69b12c-b0') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b69b12c-b0, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=787cfbd6-be01-415e-bc16-336868e4f20c) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:53 user nova-compute[74980]: INFO os_vif [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:96:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b69b12c-b024-44d8-81ff-7c6c9f869743,network=Network(388d3a91-478d-4088-8785-5d6ae280cf2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b69b12c-b0')
Nov 02 17:21:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvElQCor', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:21:53 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:21:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-a9000702-b9de-4dab-9043-5709f3fe1fed req-a775ce5d-231d-47c4-9eda-a8edf4dd0839 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-8b69b12c-b024-44d8-81ff-7c6c9f869743 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a9000702-b9de-4dab-9043-5709f3fe1fed req-a775ce5d-231d-47c4-9eda-a8edf4dd0839 service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a9000702-b9de-4dab-9043-5709f3fe1fed req-a775ce5d-231d-47c4-9eda-a8edf4dd0839 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a9000702-b9de-4dab-9043-5709f3fe1fed req-a775ce5d-231d-47c4-9eda-a8edf4dd0839 service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-a9000702-b9de-4dab-9043-5709f3fe1fed req-a775ce5d-231d-47c4-9eda-a8edf4dd0839 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-8b69b12c-b024-44d8-81ff-7c6c9f869743 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:54 user nova-compute[74980]: WARNING nova.compute.manager [req-a9000702-b9de-4dab-9043-5709f3fe1fed req-a775ce5d-231d-47c4-9eda-a8edf4dd0839 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-8b69b12c-b024-44d8-81ff-7c6c9f869743 for instance with vm_state active and task_state deleting.
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.117s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] <== connect_volume: return (2120ms) {'type': 'block', 'scsi_wwn': '23933653934303436', 'path': '/dev/sde'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933653934303436', 'path': '/dev/sde'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.203s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T17:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2076827604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-346112830',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTpqQoNo0W/Ba15IuwqtzMdO/Ma8YaqmK05K42Vul1aCdWd3AbpNWmrW5hXKt7oCzZVApl7jhtUwG4COeOBNbHItGsTrb/+JmrW4jXwqzDTsf4vNkzsXUpAI4g1UfSHEw==',key_name='tempest-keypair-703339062',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:18:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='086eda6bb22c44eea8cdcdf2138d6c8a',ramdisk_id='',reservation_id='r-y52rxoqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2119202372',owner_user_name='tempest-ServerActionsV293TestJSON-2119202372-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='349fb060d5d9496d89a25ce6c777c4b4',uuid=82362140-8606-41dc-a574-86b0b89a7a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Converting VIF {"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:63:d1,bridge_name='br-int',has_traffic_filtering=True,id=3d7df4f6-fa0e-4b6e-b96d-08126d2765f8,network=Network(66fd33fd-9ae9-4d77-8000-8d54202a5c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d7df4f6-fa') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:21:54 user nova-compute[74980]:   <uuid>82362140-8606-41dc-a574-86b0b89a7a35</uuid>
Nov 02 17:21:54 user nova-compute[74980]:   <name>instance-00000009</name>
Nov 02 17:21:54 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:21:54 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:21:54 user nova-compute[74980]:   <metadata>
Nov 02 17:21:54 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:21:54 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:21:54 user nova-compute[74980]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2076827604</nova:name>
Nov 02 17:21:54 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:21:51</nova:creationTime>
Nov 02 17:21:54 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:21:54 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:21:54 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:21:54 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:21:54 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:21:54 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:21:54 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:21:54 user nova-compute[74980]:       <nova:owner>
Nov 02 17:21:54 user nova-compute[74980]:         <nova:user uuid="349fb060d5d9496d89a25ce6c777c4b4">tempest-ServerActionsV293TestJSON-2119202372-project-member</nova:user>
Nov 02 17:21:54 user nova-compute[74980]:         <nova:project uuid="086eda6bb22c44eea8cdcdf2138d6c8a">tempest-ServerActionsV293TestJSON-2119202372</nova:project>
Nov 02 17:21:54 user nova-compute[74980]:       </nova:owner>
Nov 02 17:21:54 user nova-compute[74980]:       <nova:ports>
Nov 02 17:21:54 user nova-compute[74980]:         <nova:port uuid="3d7df4f6-fa0e-4b6e-b96d-08126d2765f8">
Nov 02 17:21:54 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 17:21:54 user nova-compute[74980]:         </nova:port>
Nov 02 17:21:54 user nova-compute[74980]:       </nova:ports>
Nov 02 17:21:54 user nova-compute[74980]:     </nova:instance>
Nov 02 17:21:54 user nova-compute[74980]:   </metadata>
Nov 02 17:21:54 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:21:54 user nova-compute[74980]:     <system>
Nov 02 17:21:54 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:21:54 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:21:54 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:21:54 user nova-compute[74980]:       <entry name="serial">82362140-8606-41dc-a574-86b0b89a7a35</entry>
Nov 02 17:21:54 user nova-compute[74980]:       <entry name="uuid">82362140-8606-41dc-a574-86b0b89a7a35</entry>
Nov 02 17:21:54 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:21:54 user nova-compute[74980]:     </system>
Nov 02 17:21:54 user nova-compute[74980]:   </sysinfo>
Nov 02 17:21:54 user nova-compute[74980]:   <os>
Nov 02 17:21:54 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:21:54 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:21:54 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:21:54 user nova-compute[74980]:   </os>
Nov 02 17:21:54 user nova-compute[74980]:   <features>
Nov 02 17:21:54 user nova-compute[74980]:     <acpi/>
Nov 02 17:21:54 user nova-compute[74980]:     <apic/>
Nov 02 17:21:54 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:21:54 user nova-compute[74980]:   </features>
Nov 02 17:21:54 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:21:54 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:21:54 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:21:54 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:21:54 user nova-compute[74980]:   </clock>
Nov 02 17:21:54 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:21:54 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:21:54 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:21:54 user nova-compute[74980]:   </cpu>
Nov 02 17:21:54 user nova-compute[74980]:   <devices>
Nov 02 17:21:54 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:21:54 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:21:54 user nova-compute[74980]:       <source dev="/dev/sde"/>
Nov 02 17:21:54 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:21:54 user nova-compute[74980]:       <serial>756ebe57-479f-485e-8091-9f3771aea8cf</serial>
Nov 02 17:21:54 user nova-compute[74980]:     </disk>
Nov 02 17:21:54 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:21:54 user nova-compute[74980]:       <mac address="fa:16:3e:e1:63:d1"/>
Nov 02 17:21:54 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:21:54 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:21:54 user nova-compute[74980]:       <target dev="tap3d7df4f6-fa"/>
Nov 02 17:21:54 user nova-compute[74980]:     </interface>
Nov 02 17:21:54 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:21:54 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/82362140-8606-41dc-a574-86b0b89a7a35/console.log" append="off"/>
Nov 02 17:21:54 user nova-compute[74980]:     </serial>
Nov 02 17:21:54 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:21:54 user nova-compute[74980]:     <video>
Nov 02 17:21:54 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:21:54 user nova-compute[74980]:     </video>
Nov 02 17:21:54 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:21:54 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:21:54 user nova-compute[74980]:     </rng>
Nov 02 17:21:54 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:21:54 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:21:54 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:21:54 user nova-compute[74980]:     </memballoon>
Nov 02 17:21:54 user nova-compute[74980]:   </devices>
Nov 02 17:21:54 user nova-compute[74980]: </domain>
Nov 02 17:21:54 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T17:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2076827604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-346112830',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTpqQoNo0W/Ba15IuwqtzMdO/Ma8YaqmK05K42Vul1aCdWd3AbpNWmrW5hXKt7oCzZVApl7jhtUwG4COeOBNbHItGsTrb/+JmrW4jXwqzDTsf4vNkzsXUpAI4g1UfSHEw==',key_name='tempest-keypair-703339062',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:18:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='086eda6bb22c44eea8cdcdf2138d6c8a',ramdisk_id='',reservation_id='r-y52rxoqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2119202372',owner_user_name='tempest-ServerActionsV293TestJSON-2119202372-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='349fb060d5d9496d89a25ce6c777c4b4',uuid=82362140-8606-41dc-a574-86b0b89a7a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Converting VIF {"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:63:d1,bridge_name='br-int',has_traffic_filtering=True,id=3d7df4f6-fa0e-4b6e-b96d-08126d2765f8,network=Network(66fd33fd-9ae9-4d77-8000-8d54202a5c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d7df4f6-fa') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_vif [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:63:d1,bridge_name='br-int',has_traffic_filtering=True,id=3d7df4f6-fa0e-4b6e-b96d-08126d2765f8,network=Network(66fd33fd-9ae9-4d77-8000-8d54202a5c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d7df4f6-fa') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0b1bf3-b9b1-490b-9368-6097118e45ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:21:54 user nova-compute[74980]: No targets found.
Nov 02 17:21:54 user nova-compute[74980]: iSNS:
Nov 02 17:21:54 user nova-compute[74980]: No targets found.
Nov 02 17:21:54 user nova-compute[74980]: STATIC:
Nov 02 17:21:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63
Nov 02 17:21:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e
Nov 02 17:21:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b
Nov 02 17:21:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe
Nov 02 17:21:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf
Nov 02 17:21:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098
Nov 02 17:21:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:54 user nova-compute[74980]: FIRMWARE:
Nov 02 17:21:54 user nova-compute[74980]: No targets found.
Nov 02 17:21:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:21:54 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:21:54 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a677324-7137-57a5-88e0-d797ce6c81d5', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d7df4f6-fa, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d7df4f6-fa, col_values=(('qos', UUID('8dc86a4a-c970-4b86-9a52-d7cac03f8361')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d7df4f6-fa, col_values=(('external_ids', {'iface-id': '3d7df4f6-fa0e-4b6e-b96d-08126d2765f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:63:d1', 'vm-uuid': '82362140-8606-41dc-a574-86b0b89a7a35'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47676b5-f160-4e94-bced-b11a1a561c00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:54 user nova-compute[74980]: INFO os_vif [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:63:d1,bridge_name='br-int',has_traffic_filtering=True,id=3d7df4f6-fa0e-4b6e-b96d-08126d2765f8,network=Network(66fd33fd-9ae9-4d77-8000-8d54202a5c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d7df4f6-fa')
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b5bc43-a03d-4036-be90-8665efad8faf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:21:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:21:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59947372e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63'): ({'sdg'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Removing single pathed devices sdg {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa22b7b-67d4-4f17-91ce-774ae4aff079]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] No VIF found with MAC fa:16:3e:e1:63:d1, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dafbf8-abe2-45a3-958c-f2ac79cdc79f]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Flushing IO for device /dev/sdg {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[03077758-ab9e-459f-a57e-80ba9f1e1523]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.062s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[297bda66-d3f6-47ce-8b78-7212fdd2a095]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] SCSI volumes sdg have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aff0901-5086-4da8-a6be-187da1a4e487]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea7a074-fa96-4546-8c8b-2b7fc129c78d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63, portal: 172.16.0.220,3260]
Nov 02 17:21:54 user nova-compute[74980]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63, portal: 172.16.0.220,3260] successful.
Nov 02 17:21:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20786b37-ba1d-4adc-a8c1-a25648258b63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e1b2a2-dee4-426b-b348-069aef2fcedf]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] <== disconnect_volume: return (644ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rTKQvLxS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:21:54 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[82277ab4-829b-42e1-ba8a-01568ee535c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:21:54 user nova-compute[74980]: No targets found.
Nov 02 17:21:54 user nova-compute[74980]: iSNS:
Nov 02 17:21:54 user nova-compute[74980]: No targets found.
Nov 02 17:21:54 user nova-compute[74980]: STATIC:
Nov 02 17:21:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e
Nov 02 17:21:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b
Nov 02 17:21:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe
Nov 02 17:21:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf
Nov 02 17:21:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098
Nov 02 17:21:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:54 user nova-compute[74980]: FIRMWARE:
Nov 02 17:21:54 user nova-compute[74980]: No targets found.
Nov 02 17:21:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:21:54 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:21:54 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5031936-fe94-4f7d-8c21-edd71a40de55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2187ecff-9699-4861-823d-3985b07f2c28]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:21:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:54 user nova-compute[74980]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe (non-flash)
Nov 02 17:21:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5994759f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe'): ({'sdh'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Removing single pathed devices sdh {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47b43d1-41f7-440c-9641-07c711eca2db]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ce5d21-6a3c-4531-a8da-df840648a317]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Flushing IO for device /dev/sdh {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b42709-85bc-472b-a8c4-3734f117cef3]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.058s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[819146e0-d7ff-4dee-843d-62bee0ac836b]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] SCSI volumes sdh have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4821f2e-57e8-460e-8ced-0a9a91f24b86]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea2b0b3-3747-4e4f-aef6-6de868810b7e]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe, portal: 172.16.0.220,3260]
Nov 02 17:21:54 user nova-compute[74980]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe, portal: 172.16.0.220,3260] successful.
Nov 02 17:21:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd5d6d7-4e08-4099-8ff9-1eef798c4bfe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ec0570-3868-4938-9b0c-631661441357]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] <== disconnect_volume: return (395ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkzKloIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:21:54 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[95958d99-1d22-48b7-9504-15ef6b303aa3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:21:54 user nova-compute[74980]: No targets found.
Nov 02 17:21:54 user nova-compute[74980]: iSNS:
Nov 02 17:21:54 user nova-compute[74980]: No targets found.
Nov 02 17:21:54 user nova-compute[74980]: STATIC:
Nov 02 17:21:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e
Nov 02 17:21:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b
Nov 02 17:21:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf
Nov 02 17:21:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098
Nov 02 17:21:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:21:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:21:54 user nova-compute[74980]: FIRMWARE:
Nov 02 17:21:54 user nova-compute[74980]: No targets found.
Nov 02 17:21:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:21:54 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:21:54 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c15a09-a19b-4c97-8d4a-8ab32f46097a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55d568b-5167-444d-8bd8-f5525001ba52]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:21:55 user nova-compute[74980]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:21:55 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:55 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:55 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:21:55 user nova-compute[74980]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:21:55 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:21:55 user nova-compute[74980]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 (non-flash)
Nov 02 17:21:55 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5994759f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7fb893-a3f7-4f38-8edf-8517ebee61fe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b8198b-ccc6-4280-b98e-8cf41cc18c95]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a5c88e-a566-4380-a2ab-7fe899b51282]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccfcc79-a805-4c4c-86b0-85cf9e95ae23]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1571b587-81a9-4a2a-99a1-1d98e8429176]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[761fe2fb-4a8a-4145-95a1-acf9150dd22c]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098, portal: 172.16.0.220,3260]
Nov 02 17:21:55 user nova-compute[74980]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098, portal: 172.16.0.220,3260] successful.
Nov 02 17:21:55 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e605ef5b-8746-4a57-87d2-ddfd8a8f0098 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b5d293-a0e6-49d3-bd55-41cb8950b465]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] <== disconnect_volume: return (343ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:21:55 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Deleting instance files /opt/stack/data/nova/instances/3587ff70-6c7d-4753-91f7-d7ee1dc8bdac_del
Nov 02 17:21:55 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Deletion of /opt/stack/data/nova/instances/3587ff70-6c7d-4753-91f7-d7ee1dc8bdac_del complete
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-unplugged-774d9b42-edc6-4b48-92cc-ab4aed571c55 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-unplugged-774d9b42-edc6-4b48-92cc-ab4aed571c55 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-unplugged-774d9b42-edc6-4b48-92cc-ab4aed571c55 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-774d9b42-edc6-4b48-92cc-ab4aed571c55 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-774d9b42-edc6-4b48-92cc-ab4aed571c55 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:55 user nova-compute[74980]: WARNING nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-774d9b42-edc6-4b48-92cc-ab4aed571c55 for instance with vm_state active and task_state deleting.
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-unplugged-2b25c905-b2e0-4108-8cfc-f98176dbcb80 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-unplugged-2b25c905-b2e0-4108-8cfc-f98176dbcb80 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-unplugged-2b25c905-b2e0-4108-8cfc-f98176dbcb80 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-2b25c905-b2e0-4108-8cfc-f98176dbcb80 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-2b25c905-b2e0-4108-8cfc-f98176dbcb80 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:55 user nova-compute[74980]: WARNING nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-2b25c905-b2e0-4108-8cfc-f98176dbcb80 for instance with vm_state active and task_state deleting.
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-unplugged-4b98210b-a018-4279-8528-69992920e5cc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-unplugged-4b98210b-a018-4279-8528-69992920e5cc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-unplugged-4b98210b-a018-4279-8528-69992920e5cc for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-plugged-4b98210b-a018-4279-8528-69992920e5cc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Acquiring lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] No waiting events found dispatching network-vif-plugged-4b98210b-a018-4279-8528-69992920e5cc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:55 user nova-compute[74980]: WARNING nova.compute.manager [req-f3a416a6-ff37-45e7-82de-367d3d39e9e3 req-82d0a920-95f8-4a23-8006-35c43057279d service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received unexpected event network-vif-plugged-4b98210b-a018-4279-8528-69992920e5cc for instance with vm_state active and task_state deleting.
Nov 02 17:21:55 user nova-compute[74980]: INFO nova.compute.manager [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Took 4.94 seconds to destroy the instance on the hypervisor.
Nov 02 17:21:55 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-4127619d-c00c-4b38-a514-be05a7795e4b req-f9471265-7ef2-43b8-a064-df9b8a861d7f service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received event network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4127619d-c00c-4b38-a514-be05a7795e4b req-f9471265-7ef2-43b8-a064-df9b8a861d7f service nova] Acquiring lock "82362140-8606-41dc-a574-86b0b89a7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4127619d-c00c-4b38-a514-be05a7795e4b req-f9471265-7ef2-43b8-a064-df9b8a861d7f service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4127619d-c00c-4b38-a514-be05a7795e4b req-f9471265-7ef2-43b8-a064-df9b8a861d7f service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-4127619d-c00c-4b38-a514-be05a7795e4b req-f9471265-7ef2-43b8-a064-df9b8a861d7f service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] No waiting events found dispatching network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:57 user nova-compute[74980]: WARNING nova.compute.manager [req-4127619d-c00c-4b38-a514-be05a7795e4b req-f9471265-7ef2-43b8-a064-df9b8a861d7f service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received unexpected event network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 for instance with vm_state active and task_state rebuild_spawning.
Nov 02 17:21:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-4127619d-c00c-4b38-a514-be05a7795e4b req-f9471265-7ef2-43b8-a064-df9b8a861d7f service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received event network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4127619d-c00c-4b38-a514-be05a7795e4b req-f9471265-7ef2-43b8-a064-df9b8a861d7f service nova] Acquiring lock "82362140-8606-41dc-a574-86b0b89a7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4127619d-c00c-4b38-a514-be05a7795e4b req-f9471265-7ef2-43b8-a064-df9b8a861d7f service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4127619d-c00c-4b38-a514-be05a7795e4b req-f9471265-7ef2-43b8-a064-df9b8a861d7f service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-4127619d-c00c-4b38-a514-be05a7795e4b req-f9471265-7ef2-43b8-a064-df9b8a861d7f service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] No waiting events found dispatching network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:21:57 user nova-compute[74980]: WARNING nova.compute.manager [req-4127619d-c00c-4b38-a514-be05a7795e4b req-f9471265-7ef2-43b8-a064-df9b8a861d7f service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received unexpected event network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 for instance with vm_state active and task_state rebuild_spawning.
Nov 02 17:21:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-14784f94-5d2a-4263-b515-e78042d543be req-9762e1ca-966b-478d-b659-7aec9f63bfb2 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-deleted-2b25c905-b2e0-4108-8cfc-f98176dbcb80 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:57 user nova-compute[74980]: INFO nova.compute.manager [req-14784f94-5d2a-4263-b515-e78042d543be req-9762e1ca-966b-478d-b659-7aec9f63bfb2 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Neutron deleted interface 2b25c905-b2e0-4108-8cfc-f98176dbcb80; detaching it from the instance and deleting it from the info cache
Nov 02 17:21:57 user nova-compute[74980]: DEBUG nova.network.neutron [req-14784f94-5d2a-4263-b515-e78042d543be req-9762e1ca-966b-478d-b659-7aec9f63bfb2 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating instance_info_cache with network_info: [{"id": "65610a01-9aaa-4755-ba01-ee4e72320408", "address": "fa:16:3e:2b:15:2f", "network": {"id": "e9224f9b-af21-4b41-a592-576ca0bb5ca6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925418223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65610a01-9a", "ovs_interfaceid": "65610a01-9aaa-4755-ba01-ee4e72320408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "address": "fa:16:3e:5a:18:ac", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774d9b42-ed", "ovs_interfaceid": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b98210b-a018-4279-8528-69992920e5cc", "address": "fa:16:3e:4a:c0:98", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b98210b-a0", "ovs_interfaceid": "4b98210b-a018-4279-8528-69992920e5cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-14784f94-5d2a-4263-b515-e78042d543be req-9762e1ca-966b-478d-b659-7aec9f63bfb2 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Detach interface failed, port_id=2b25c905-b2e0-4108-8cfc-f98176dbcb80, reason: Instance 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac could not be found. {{(pid=74980) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 17:21:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:21:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:21:58 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Instance spawned successfully.
Nov 02 17:21:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:21:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:21:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:21:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:21:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:21:58 user nova-compute[74980]: DEBUG nova.objects.instance [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74980) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 02 17:21:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-aeacf108-60cf-4c2b-bd1a-7ff623b3a0ea tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.107s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:21:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:21:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:21:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-8471e239-8df8-429f-aab9-6153633f7f33 req-55c816c2-7f63-46dc-b065-6e70a0e70a8e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-deleted-4b98210b-a018-4279-8528-69992920e5cc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:59 user nova-compute[74980]: INFO nova.compute.manager [req-8471e239-8df8-429f-aab9-6153633f7f33 req-55c816c2-7f63-46dc-b065-6e70a0e70a8e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Neutron deleted interface 4b98210b-a018-4279-8528-69992920e5cc; detaching it from the instance and deleting it from the info cache
Nov 02 17:21:59 user nova-compute[74980]: DEBUG nova.network.neutron [req-8471e239-8df8-429f-aab9-6153633f7f33 req-55c816c2-7f63-46dc-b065-6e70a0e70a8e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating instance_info_cache with network_info: [{"id": "65610a01-9aaa-4755-ba01-ee4e72320408", "address": "fa:16:3e:2b:15:2f", "network": {"id": "e9224f9b-af21-4b41-a592-576ca0bb5ca6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925418223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65610a01-9a", "ovs_interfaceid": "65610a01-9aaa-4755-ba01-ee4e72320408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "address": "fa:16:3e:5a:18:ac", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774d9b42-ed", "ovs_interfaceid": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-8471e239-8df8-429f-aab9-6153633f7f33 req-55c816c2-7f63-46dc-b065-6e70a0e70a8e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Detach interface failed, port_id=4b98210b-a018-4279-8528-69992920e5cc, reason: Instance 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac could not be found. {{(pid=74980) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 17:21:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-8471e239-8df8-429f-aab9-6153633f7f33 req-55c816c2-7f63-46dc-b065-6e70a0e70a8e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-deleted-65610a01-9aaa-4755-ba01-ee4e72320408 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:59 user nova-compute[74980]: INFO nova.compute.manager [req-8471e239-8df8-429f-aab9-6153633f7f33 req-55c816c2-7f63-46dc-b065-6e70a0e70a8e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Neutron deleted interface 65610a01-9aaa-4755-ba01-ee4e72320408; detaching it from the instance and deleting it from the info cache
Nov 02 17:21:59 user nova-compute[74980]: DEBUG nova.network.neutron [req-8471e239-8df8-429f-aab9-6153633f7f33 req-55c816c2-7f63-46dc-b065-6e70a0e70a8e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating instance_info_cache with network_info: [{"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "address": "fa:16:3e:5a:18:ac", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap774d9b42-ed", "ovs_interfaceid": "774d9b42-edc6-4b48-92cc-ab4aed571c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-8471e239-8df8-429f-aab9-6153633f7f33 req-55c816c2-7f63-46dc-b065-6e70a0e70a8e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Detach interface failed, port_id=65610a01-9aaa-4755-ba01-ee4e72320408, reason: Instance 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac could not be found. {{(pid=74980) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 17:21:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-8471e239-8df8-429f-aab9-6153633f7f33 req-55c816c2-7f63-46dc-b065-6e70a0e70a8e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-deleted-774d9b42-edc6-4b48-92cc-ab4aed571c55 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:21:59 user nova-compute[74980]: INFO nova.compute.manager [req-8471e239-8df8-429f-aab9-6153633f7f33 req-55c816c2-7f63-46dc-b065-6e70a0e70a8e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Neutron deleted interface 774d9b42-edc6-4b48-92cc-ab4aed571c55; detaching it from the instance and deleting it from the info cache
Nov 02 17:21:59 user nova-compute[74980]: DEBUG nova.network.neutron [req-8471e239-8df8-429f-aab9-6153633f7f33 req-55c816c2-7f63-46dc-b065-6e70a0e70a8e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating instance_info_cache with network_info: [{"id": "97328bbf-6210-4167-98ef-df662837d418", "address": "fa:16:3e:a6:f7:d8", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97328bbf-62", "ovs_interfaceid": "97328bbf-6210-4167-98ef-df662837d418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43469d86-f716-49ce-bb76-f9cc4016366b", "address": "fa:16:3e:b5:69:94", "network": {"id": "8416dfc7-2923-4c03-afed-c32e70cf1e5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1983511042", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43469d86-f7", "ovs_interfaceid": "43469d86-f716-49ce-bb76-f9cc4016366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "address": "fa:16:3e:c3:96:0f", "network": {"id": "388d3a91-478d-4088-8785-5d6ae280cf2d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1642419649", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5bd832a86ce41938aedfddef7ac7fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b69b12c-b0", "ovs_interfaceid": "8b69b12c-b024-44d8-81ff-7c6c9f869743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-8471e239-8df8-429f-aab9-6153633f7f33 req-55c816c2-7f63-46dc-b065-6e70a0e70a8e service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Detach interface failed, port_id=774d9b42-edc6-4b48-92cc-ab4aed571c55, reason: Instance 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac could not be found. {{(pid=74980) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 17:21:59 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:21:59 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Took 4.48 seconds to deallocate network for instance.
Nov 02 17:22:00 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:22:01 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:22:01 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:22:01 user nova-compute[74980]: DEBUG nova.compute.manager [req-60b19a7c-9240-4196-8b28-2aed13d395d2 req-4759bced-ccd5-4e83-9c0a-8e6e43d81501 service nova] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Received event network-vif-deleted-8b69b12c-b024-44d8-81ff-7c6c9f869743 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:22:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:02 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:22:02 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:22:02 user nova-compute[74980]: INFO nova.compute.manager [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] [instance: 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac] Took 3.07 seconds to detach 3 volumes for instance.
Nov 02 17:22:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:22:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:22:03 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:22:03 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:22:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.volume.cinder [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Update attachment failed for attachment 5c7999e7-e1b2-41e7-aa00-bd519daf24ae. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5685c84f-2e1e-4a52-a479-2c47d4f318a5) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5685c84f-2e1e-4a52-a479-2c47d4f318a5)
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5685c84f-2e1e-4a52-a479-2c47d4f318a5)
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Traceback (most recent call last):
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     driver_block_device.attach_block_devices(
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     _log_and_attach(device)
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     bdm.attach(*attach_args, **attach_kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     ret_val = method(obj, context, *args, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     self._do_attach(context, instance, volume, volume_api,
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     self._volume_attach(context, volume, connector, instance,
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     connection_info = volume_api.attachment_update(
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     res = method(self, ctx, *args, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     with excutils.save_and_reraise_exception():
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     self.force_reraise()
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     raise self.value
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     return method.func(obj, *args, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     resp = self._update('/attachments/%s' % id, body)
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     return self.request(url, method, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418]     raise exceptions.from_response(resp, body)
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5685c84f-2e1e-4a52-a479-2c47d4f318a5)
Nov 02 17:22:03 user nova-compute[74980]: ERROR nova.compute.manager [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] 
Nov 02 17:22:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "e9d8737b-e341-4c00-bb8c-6e1847d24418" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.191s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:22:03 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Deleted allocations for instance 3587ff70-6c7d-4753-91f7-d7ee1dc8bdac
Nov 02 17:22:03 user nova-compute[74980]: INFO nova.compute.manager [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: e9d8737b-e341-4c00-bb8c-6e1847d24418] Successfully reverted task state from spawning on failure for instance.
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server [None req-0f5b61b2-d3ea-4ecc-b058-152640d25c84 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5685c84f-2e1e-4a52-a479-2c47d4f318a5)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5685c84f-2e1e-4a52-a479-2c47d4f318a5)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server 
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server 
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7083, in unshelve_instance
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     do_unshelve_instance()
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7080, in do_unshelve_instance
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     self._unshelve_instance(
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7112, in _unshelve_instance
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     block_device_info = self._prep_block_device(context, instance, bdms)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5685c84f-2e1e-4a52-a479-2c47d4f318a5)
Nov 02 17:22:03 user nova-compute[74980]: ERROR oslo_messaging.rpc.server 
Nov 02 17:22:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1433fbc6-9159-445e-965e-6b7cf7154d88 tempest-TaggedBootDevicesTest_v242-1889592963 tempest-TaggedBootDevicesTest_v242-1889592963-project-member] Lock "3587ff70-6c7d-4753-91f7-d7ee1dc8bdac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.197s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:22:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:04 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:22:04 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:22:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:22:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:22:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:22:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:22:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:22:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:22:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:22:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:07 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:22:07 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:22:07 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=7831MB free_disk=25.47439956665039GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:22:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:22:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:22:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 4e6bfb81-f01c-47e6-b771-7c2b34587623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:22:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance d7f2fa00-48af-4277-93b4-af930e4a650f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:22:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:22:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1154d1f9-80b8-405b-8fd8-c10bb39c507f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:22:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 82362140-8606-41dc-a574-86b0b89a7a35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:22:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1620c8eb-067c-4156-b927-2f64eac9e340 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:22:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 22b8ca59-959d-4687-bb7d-4fc7909aa852 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:22:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 854dd67d-7e05-47ad-b60a-23b9673bb8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:22:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:22:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:22:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:22:08 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:22:08 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:22:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:22:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:22:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:09 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:22:09 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:22:09 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Didn't find any instances for network info cache update. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 17:22:09 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:22:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "d7f2fa00-48af-4277-93b4-af930e4a650f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:22:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:22:19 user nova-compute[74980]: INFO nova.compute.manager [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Detaching volume e3c99903-2f39-4a4b-8558-4c83878f1d5b
Nov 02 17:22:19 user nova-compute[74980]: INFO nova.virt.block_device [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Attempting to driver detach volume e3c99903-2f39-4a4b-8558-4c83878f1d5b from mountpoint /dev/vdb
Nov 02 17:22:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Attempting to detach device vdb from instance d7f2fa00-48af-4277-93b4-af930e4a650f from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:22:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:22:19 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:22:19 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:22:19 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:22:19 user nova-compute[74980]:   <serial>e3c99903-2f39-4a4b-8558-4c83878f1d5b</serial>
Nov 02 17:22:19 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:22:19 user nova-compute[74980]: </disk>
Nov 02 17:22:19 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:22:19 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Successfully detached device vdb from instance d7f2fa00-48af-4277-93b4-af930e4a650f from the persistent domain config.
Nov 02 17:22:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7f2fa00-48af-4277-93b4-af930e4a650f from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:22:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:22:19 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:22:19 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:22:19 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:22:19 user nova-compute[74980]:   <serial>e3c99903-2f39-4a4b-8558-4c83878f1d5b</serial>
Nov 02 17:22:19 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:22:19 user nova-compute[74980]: </disk>
Nov 02 17:22:19 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:22:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7f2fa00-48af-4277-93b4-af930e4a650f {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:22:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:40 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d7f2fa00-48af-4277-93b4-af930e4a650f is timed out.
Nov 02 17:22:40 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Successfully detached device vdb from instance d7f2fa00-48af-4277-93b4-af930e4a650f from the live domain config.
Nov 02 17:22:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KLhqCiMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:22:40 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.055s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad8cc81-9427-42db-a91a-bc6060c243fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:22:40 user nova-compute[74980]: No targets found.
Nov 02 17:22:40 user nova-compute[74980]: iSNS:
Nov 02 17:22:40 user nova-compute[74980]: No targets found.
Nov 02 17:22:40 user nova-compute[74980]: STATIC:
Nov 02 17:22:40 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e
Nov 02 17:22:40 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:22:40 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:22:40 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b
Nov 02 17:22:40 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:22:40 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:22:40 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf
Nov 02 17:22:40 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:22:40 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:22:40 user nova-compute[74980]: FIRMWARE:
Nov 02 17:22:40 user nova-compute[74980]: No targets found.
Nov 02 17:22:40 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:22:40 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:22:40 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06b40c7-ed3e-4657-a3a5-b1cf9b0eb72a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf6eb22-b1fa-467f-9b92-855cd054b64d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:22:40 user nova-compute[74980]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:22:40 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:22:40 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:22:40 user nova-compute[74980]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:22:40 user nova-compute[74980]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b (non-flash)
Nov 02 17:22:40 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b4710a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b'): ({'sdc'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Removing single pathed devices sdc {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ca13c1-cd53-406a-8564-1bf7304c7846]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae56d64-0d4e-431f-8044-0d9c064b8a3d]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Flushing IO for device /dev/sdc {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[399430f1-22e3-4663-a888-9c672de1bdc6]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64fcac7-5ea6-4cd2-9a7c-0c418fbf1867]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e985ab41-e9cf-425a-b438-3266876a3037]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[add90bcf-eac4-4789-ae41-542e3958835f]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b, portal: 172.16.0.220,3260]
Nov 02 17:22:40 user nova-compute[74980]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b, portal: 172.16.0.220,3260] successful.
Nov 02 17:22:40 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c99903-2f39-4a4b-8558-4c83878f1d5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68d68df-8d97-4f6c-9bf0-2a2eaca87667]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] <== disconnect_volume: return (424ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:22:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:22:41 user nova-compute[74980]: DEBUG nova.objects.instance [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'flavor' on Instance uuid d7f2fa00-48af-4277-93b4-af930e4a650f {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:22:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-badd7fe1-c6fc-4052-bda1-c75d5acfc0ea tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.064s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:22:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-1c2cf448-c74a-4a1e-9f23-6bc3404a7157 req-7ba97249-462b-4a59-a0db-de1791f39c2d service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received event network-changed-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:22:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-1c2cf448-c74a-4a1e-9f23-6bc3404a7157 req-7ba97249-462b-4a59-a0db-de1791f39c2d service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Refreshing instance network info cache due to event network-changed-a6485d81-59e2-4d5e-a060-fec023852f67. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:22:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1c2cf448-c74a-4a1e-9f23-6bc3404a7157 req-7ba97249-462b-4a59-a0db-de1791f39c2d service nova] Acquiring lock "refresh_cache-1620c8eb-067c-4156-b927-2f64eac9e340" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:22:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1c2cf448-c74a-4a1e-9f23-6bc3404a7157 req-7ba97249-462b-4a59-a0db-de1791f39c2d service nova] Acquired lock "refresh_cache-1620c8eb-067c-4156-b927-2f64eac9e340" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:22:51 user nova-compute[74980]: DEBUG nova.network.neutron [req-1c2cf448-c74a-4a1e-9f23-6bc3404a7157 req-7ba97249-462b-4a59-a0db-de1791f39c2d service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Refreshing network info cache for port a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "1620c8eb-067c-4156-b927-2f64eac9e340" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "1620c8eb-067c-4156-b927-2f64eac9e340" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG nova.objects.instance [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lazy-loading 'flavor' on Instance uuid 1620c8eb-067c-4156-b927-2f64eac9e340 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "1620c8eb-067c-4156-b927-2f64eac9e340" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "1620c8eb-067c-4156-b927-2f64eac9e340" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "1620c8eb-067c-4156-b927-2f64eac9e340" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:22:52 user nova-compute[74980]: INFO nova.compute.manager [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Attaching volume df8cce4d-4862-4318-ac83-25951d18b8f7 to /dev/vdb
Nov 02 17:22:52 user nova-compute[74980]: DEBUG os_brick.utils [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[540087a2-1baa-474b-8bac-27a7f0ceef08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b037320f-daa8-4af6-a891-de0b9ca00749]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6031812-3aff-449b-b94f-9c24a02f8068]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c756240-cf5c-48e0-b884-880ce1604f0c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG nova.network.neutron [req-1c2cf448-c74a-4a1e-9f23-6bc3404a7157 req-7ba97249-462b-4a59-a0db-de1791f39c2d service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Updated VIF entry in instance network info cache for port a6485d81-59e2-4d5e-a060-fec023852f67. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG nova.network.neutron [req-1c2cf448-c74a-4a1e-9f23-6bc3404a7157 req-7ba97249-462b-4a59-a0db-de1791f39c2d service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Updating instance_info_cache with network_info: [{"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1c2cf448-c74a-4a1e-9f23-6bc3404a7157 req-7ba97249-462b-4a59-a0db-de1791f39c2d service nova] Releasing lock "refresh_cache-1620c8eb-067c-4156-b927-2f64eac9e340" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:22:52 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:22:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1d708a-c61d-4fc4-bd09-91129065b558]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG os_brick.utils [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:22:52 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Updating existing volume attachment record: 39e25442-a950-47b8-a8fc-1529097d7780 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:22:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:22:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:22:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:00 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:23:01 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:23:01 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 17:23:01 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] There are 0 instances to clean {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 17:23:02 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:23:02 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:23:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquiring lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:02 user nova-compute[74980]: DEBUG nova.compute.manager [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:23:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:23:02 user nova-compute[74980]: INFO nova.compute.claims [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Claim successful on node user
Nov 02 17:23:03 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG nova.network.neutron [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:23:03 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:23:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:23:03 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Creating image(s)
Nov 02 17:23:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "/opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "/opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.192s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG nova.policy [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddc7302bfeed466e8140faf81456bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b5c618c10c4d94b1fc6e930e2aa22d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.243s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk 1073741824" returned: 0 in 0.119s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.368s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.198s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Cannot resize image /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Ensure instance console log exists: /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:23:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "82362140-8606-41dc-a574-86b0b89a7a35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "82362140-8606-41dc-a574-86b0b89a7a35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "82362140-8606-41dc-a574-86b0b89a7a35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:05 user nova-compute[74980]: INFO nova.compute.manager [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Terminating instance
Nov 02 17:23:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG nova.network.neutron [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Successfully created port: e48d9f29-5466-428b-b554-01882ec6484a {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-36f23882-4978-406a-b902-821304c4dab1 req-254dbb2d-532e-493c-aa63-bd57f93da888 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received event network-vif-unplugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-36f23882-4978-406a-b902-821304c4dab1 req-254dbb2d-532e-493c-aa63-bd57f93da888 service nova] Acquiring lock "82362140-8606-41dc-a574-86b0b89a7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-36f23882-4978-406a-b902-821304c4dab1 req-254dbb2d-532e-493c-aa63-bd57f93da888 service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-36f23882-4978-406a-b902-821304c4dab1 req-254dbb2d-532e-493c-aa63-bd57f93da888 service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-36f23882-4978-406a-b902-821304c4dab1 req-254dbb2d-532e-493c-aa63-bd57f93da888 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] No waiting events found dispatching network-vif-unplugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-36f23882-4978-406a-b902-821304c4dab1 req-254dbb2d-532e-493c-aa63-bd57f93da888 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received event network-vif-unplugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:05 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Instance destroyed successfully.
Nov 02 17:23:05 user nova-compute[74980]: DEBUG nova.objects.instance [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lazy-loading 'resources' on Instance uuid 82362140-8606-41dc-a574-86b0b89a7a35 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T17:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2076827604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-346112830',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTpqQoNo0W/Ba15IuwqtzMdO/Ma8YaqmK05K42Vul1aCdWd3AbpNWmrW5hXKt7oCzZVApl7jhtUwG4COeOBNbHItGsTrb/+JmrW4jXwqzDTsf4vNkzsXUpAI4g1UfSHEw==',key_name='tempest-keypair-703339062',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:21:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='086eda6bb22c44eea8cdcdf2138d6c8a',ramdisk_id='',reservation_id='r-y52rxoqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2119202372',owner_user_name='tempest-ServerActionsV293TestJSON-2119202372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:21:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='349fb060d5d9496d89a25ce6c777c4b4',uuid=82362140-8606-41dc-a574-86b0b89a7a35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Converting VIF {"id": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "address": "fa:16:3e:e1:63:d1", "network": {"id": "66fd33fd-9ae9-4d77-8000-8d54202a5c59", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1116397587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "086eda6bb22c44eea8cdcdf2138d6c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7df4f6-fa", "ovs_interfaceid": "3d7df4f6-fa0e-4b6e-b96d-08126d2765f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:63:d1,bridge_name='br-int',has_traffic_filtering=True,id=3d7df4f6-fa0e-4b6e-b96d-08126d2765f8,network=Network(66fd33fd-9ae9-4d77-8000-8d54202a5c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d7df4f6-fa') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_vif [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:63:d1,bridge_name='br-int',has_traffic_filtering=True,id=3d7df4f6-fa0e-4b6e-b96d-08126d2765f8,network=Network(66fd33fd-9ae9-4d77-8000-8d54202a5c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d7df4f6-fa') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d7df4f6-fa, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8dc86a4a-c970-4b86-9a52-d7cac03f8361) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:06 user nova-compute[74980]: INFO os_vif [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:63:d1,bridge_name='br-int',has_traffic_filtering=True,id=3d7df4f6-fa0e-4b6e-b96d-08126d2765f8,network=Network(66fd33fd-9ae9-4d77-8000-8d54202a5c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d7df4f6-fa')
Nov 02 17:23:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuIqYUnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:23:06 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c75a46-8aa2-460a-9e41-e60144492af8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:23:06 user nova-compute[74980]: No targets found.
Nov 02 17:23:06 user nova-compute[74980]: iSNS:
Nov 02 17:23:06 user nova-compute[74980]: No targets found.
Nov 02 17:23:06 user nova-compute[74980]: STATIC:
Nov 02 17:23:06 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e
Nov 02 17:23:06 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:23:06 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:23:06 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf
Nov 02 17:23:06 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:23:06 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:23:06 user nova-compute[74980]: FIRMWARE:
Nov 02 17:23:06 user nova-compute[74980]: No targets found.
Nov 02 17:23:06 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:23:06 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:23:06 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4cfcf2-b4b5-4ef7-bf0d-dadefe0e5ba1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5b62c3-8c92-4eb3-af0b-4c0d7263321d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:23:06 user nova-compute[74980]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:23:06 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:23:06 user nova-compute[74980]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf (non-flash)
Nov 02 17:23:06 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59947af760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf'): ({'sde'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Removing single pathed devices sde {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfe1c4d-f018-4f8d-af89-d38285208445]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f828df20-df62-46c4-95ff-483a2ac2569b]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Flushing IO for device /dev/sde {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e5b330-d01c-40fa-8498-52b295682067]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.072s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dd7903-8e5f-46fd-bdd1-b8969c1c91e9]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] SCSI volumes sde have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9458097-dc60-4296-8afb-aa85640bb70b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[06603af2-306f-4883-bd11-cc09246ae212]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260]
Nov 02 17:23:06 user nova-compute[74980]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf, portal: 172.16.0.220,3260] successful.
Nov 02 17:23:06 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:756ebe57-479f-485e-8091-9f3771aea8cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8cac4b-b49c-41bb-a14d-80e56eb8ba8c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.463s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] <== disconnect_volume: return (464ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:23:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Deleting instance files /opt/stack/data/nova/instances/82362140-8606-41dc-a574-86b0b89a7a35_del
Nov 02 17:23:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Deletion of /opt/stack/data/nova/instances/82362140-8606-41dc-a574-86b0b89a7a35_del complete
Nov 02 17:23:06 user nova-compute[74980]: DEBUG nova.network.neutron [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Successfully updated port: e48d9f29-5466-428b-b554-01882ec6484a {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquiring lock "refresh_cache-f0eb2644-f721-4a49-834d-16c43ad6d5c2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquired lock "refresh_cache-f0eb2644-f721-4a49-834d-16c43ad6d5c2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG nova.network.neutron [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:23:06 user nova-compute[74980]: INFO nova.compute.manager [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Took 1.54 seconds to destroy the instance on the hypervisor.
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG nova.network.neutron [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-c5a7b1d1-315b-46f1-bbc5-f8a96a90ed51 req-a63283f0-8bae-49a9-876f-608f37e5894f service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Received event network-changed-e48d9f29-5466-428b-b554-01882ec6484a {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-c5a7b1d1-315b-46f1-bbc5-f8a96a90ed51 req-a63283f0-8bae-49a9-876f-608f37e5894f service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Refreshing instance network info cache due to event network-changed-e48d9f29-5466-428b-b554-01882ec6484a. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c5a7b1d1-315b-46f1-bbc5-f8a96a90ed51 req-a63283f0-8bae-49a9-876f-608f37e5894f service nova] Acquiring lock "refresh_cache-f0eb2644-f721-4a49-834d-16c43ad6d5c2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.compute.manager [req-6a09fa1e-3ff9-48eb-9e03-2a7ef27c857e req-4e58f4f5-b253-4c4b-a70f-162470efe4e2 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received event network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6a09fa1e-3ff9-48eb-9e03-2a7ef27c857e req-4e58f4f5-b253-4c4b-a70f-162470efe4e2 service nova] Acquiring lock "82362140-8606-41dc-a574-86b0b89a7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6a09fa1e-3ff9-48eb-9e03-2a7ef27c857e req-4e58f4f5-b253-4c4b-a70f-162470efe4e2 service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6a09fa1e-3ff9-48eb-9e03-2a7ef27c857e req-4e58f4f5-b253-4c4b-a70f-162470efe4e2 service nova] Lock "82362140-8606-41dc-a574-86b0b89a7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.compute.manager [req-6a09fa1e-3ff9-48eb-9e03-2a7ef27c857e req-4e58f4f5-b253-4c4b-a70f-162470efe4e2 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] No waiting events found dispatching network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:07 user nova-compute[74980]: WARNING nova.compute.manager [req-6a09fa1e-3ff9-48eb-9e03-2a7ef27c857e req-4e58f4f5-b253-4c4b-a70f-162470efe4e2 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received unexpected event network-vif-plugged-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 for instance with vm_state active and task_state deleting.
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.network.neutron [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Updating instance_info_cache with network_info: [{"id": "e48d9f29-5466-428b-b554-01882ec6484a", "address": "fa:16:3e:18:4e:03", "network": {"id": "9298cdb9-70a6-400f-8e51-cc4d62b1e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1547217393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18b5c618c10c4d94b1fc6e930e2aa22d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48d9f29-54", "ovs_interfaceid": "e48d9f29-5466-428b-b554-01882ec6484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Releasing lock "refresh_cache-f0eb2644-f721-4a49-834d-16c43ad6d5c2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.compute.manager [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Instance network_info: |[{"id": "e48d9f29-5466-428b-b554-01882ec6484a", "address": "fa:16:3e:18:4e:03", "network": {"id": "9298cdb9-70a6-400f-8e51-cc4d62b1e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1547217393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18b5c618c10c4d94b1fc6e930e2aa22d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48d9f29-54", "ovs_interfaceid": "e48d9f29-5466-428b-b554-01882ec6484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c5a7b1d1-315b-46f1-bbc5-f8a96a90ed51 req-a63283f0-8bae-49a9-876f-608f37e5894f service nova] Acquired lock "refresh_cache-f0eb2644-f721-4a49-834d-16c43ad6d5c2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.network.neutron [req-c5a7b1d1-315b-46f1-bbc5-f8a96a90ed51 req-a63283f0-8bae-49a9-876f-608f37e5894f service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Refreshing network info cache for port e48d9f29-5466-428b-b554-01882ec6484a {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Start _get_guest_xml network_info=[{"id": "e48d9f29-5466-428b-b554-01882ec6484a", "address": "fa:16:3e:18:4e:03", "network": {"id": "9298cdb9-70a6-400f-8e51-cc4d62b1e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1547217393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18b5c618c10c4d94b1fc6e930e2aa22d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48d9f29-54", "ovs_interfaceid": "e48d9f29-5466-428b-b554-01882ec6484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:07 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:23:07 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1772040712',display_name='tempest-TestVolumeSwap-server-1772040712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1772040712',id=17,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQd7w5t+3YkB2W+JRtTysaaf21uU48mHQvxEZN0JzXn2p8A9XxaEnx+YmeuuFOi7YlXhZc9ylcFWJqE5NdjnARgRwJqye2wgVhcvH5iFiACgprMuZ67q+yIRiVTIYfIOw==',key_name='tempest-keypair-450498757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18b5c618c10c4d94b1fc6e930e2aa22d',ramdisk_id='',reservation_id='r-tbcw1gxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1151215288',owner_user_name='tempest-TestVolumeSwap-1151215288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7302bfeed466e8140faf81456bb38',uuid=f0eb2644-f721-4a49-834d-16c43ad6d5c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e48d9f29-5466-428b-b554-01882ec6484a", "address": "fa:16:3e:18:4e:03", "network": {"id": "9298cdb9-70a6-400f-8e51-cc4d62b1e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1547217393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18b5c618c10c4d94b1fc6e930e2aa22d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48d9f29-54", "ovs_interfaceid": "e48d9f29-5466-428b-b554-01882ec6484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Converting VIF {"id": "e48d9f29-5466-428b-b554-01882ec6484a", "address": "fa:16:3e:18:4e:03", "network": {"id": "9298cdb9-70a6-400f-8e51-cc4d62b1e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1547217393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18b5c618c10c4d94b1fc6e930e2aa22d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48d9f29-54", "ovs_interfaceid": "e48d9f29-5466-428b-b554-01882ec6484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:4e:03,bridge_name='br-int',has_traffic_filtering=True,id=e48d9f29-5466-428b-b554-01882ec6484a,network=Network(9298cdb9-70a6-400f-8e51-cc4d62b1e98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48d9f29-54') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:23:07 user nova-compute[74980]: DEBUG nova.objects.instance [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lazy-loading 'pci_devices' on Instance uuid f0eb2644-f721-4a49-834d-16c43ad6d5c2 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:23:08 user nova-compute[74980]:   <uuid>f0eb2644-f721-4a49-834d-16c43ad6d5c2</uuid>
Nov 02 17:23:08 user nova-compute[74980]:   <name>instance-00000011</name>
Nov 02 17:23:08 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:23:08 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:23:08 user nova-compute[74980]:   <metadata>
Nov 02 17:23:08 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:23:08 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:23:08 user nova-compute[74980]:       <nova:name>tempest-TestVolumeSwap-server-1772040712</nova:name>
Nov 02 17:23:08 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:23:07</nova:creationTime>
Nov 02 17:23:08 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:23:08 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:23:08 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:23:08 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:23:08 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:23:08 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:23:08 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:23:08 user nova-compute[74980]:       <nova:owner>
Nov 02 17:23:08 user nova-compute[74980]:         <nova:user uuid="ddc7302bfeed466e8140faf81456bb38">tempest-TestVolumeSwap-1151215288-project-member</nova:user>
Nov 02 17:23:08 user nova-compute[74980]:         <nova:project uuid="18b5c618c10c4d94b1fc6e930e2aa22d">tempest-TestVolumeSwap-1151215288</nova:project>
Nov 02 17:23:08 user nova-compute[74980]:       </nova:owner>
Nov 02 17:23:08 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:23:08 user nova-compute[74980]:       <nova:ports>
Nov 02 17:23:08 user nova-compute[74980]:         <nova:port uuid="e48d9f29-5466-428b-b554-01882ec6484a">
Nov 02 17:23:08 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 17:23:08 user nova-compute[74980]:         </nova:port>
Nov 02 17:23:08 user nova-compute[74980]:       </nova:ports>
Nov 02 17:23:08 user nova-compute[74980]:     </nova:instance>
Nov 02 17:23:08 user nova-compute[74980]:   </metadata>
Nov 02 17:23:08 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:23:08 user nova-compute[74980]:     <system>
Nov 02 17:23:08 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:23:08 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:23:08 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:23:08 user nova-compute[74980]:       <entry name="serial">f0eb2644-f721-4a49-834d-16c43ad6d5c2</entry>
Nov 02 17:23:08 user nova-compute[74980]:       <entry name="uuid">f0eb2644-f721-4a49-834d-16c43ad6d5c2</entry>
Nov 02 17:23:08 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:23:08 user nova-compute[74980]:     </system>
Nov 02 17:23:08 user nova-compute[74980]:   </sysinfo>
Nov 02 17:23:08 user nova-compute[74980]:   <os>
Nov 02 17:23:08 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:23:08 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:23:08 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:23:08 user nova-compute[74980]:   </os>
Nov 02 17:23:08 user nova-compute[74980]:   <features>
Nov 02 17:23:08 user nova-compute[74980]:     <acpi/>
Nov 02 17:23:08 user nova-compute[74980]:     <apic/>
Nov 02 17:23:08 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:23:08 user nova-compute[74980]:   </features>
Nov 02 17:23:08 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:23:08 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:23:08 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:23:08 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:23:08 user nova-compute[74980]:   </clock>
Nov 02 17:23:08 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:23:08 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:23:08 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:23:08 user nova-compute[74980]:   </cpu>
Nov 02 17:23:08 user nova-compute[74980]:   <devices>
Nov 02 17:23:08 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:23:08 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:23:08 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk"/>
Nov 02 17:23:08 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:23:08 user nova-compute[74980]:     </disk>
Nov 02 17:23:08 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:23:08 user nova-compute[74980]:       <mac address="fa:16:3e:18:4e:03"/>
Nov 02 17:23:08 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:23:08 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:23:08 user nova-compute[74980]:       <target dev="tape48d9f29-54"/>
Nov 02 17:23:08 user nova-compute[74980]:     </interface>
Nov 02 17:23:08 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:23:08 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/console.log" append="off"/>
Nov 02 17:23:08 user nova-compute[74980]:     </serial>
Nov 02 17:23:08 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:23:08 user nova-compute[74980]:     <video>
Nov 02 17:23:08 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:23:08 user nova-compute[74980]:     </video>
Nov 02 17:23:08 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:23:08 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:23:08 user nova-compute[74980]:     </rng>
Nov 02 17:23:08 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:23:08 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:23:08 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:23:08 user nova-compute[74980]:     </memballoon>
Nov 02 17:23:08 user nova-compute[74980]:   </devices>
Nov 02 17:23:08 user nova-compute[74980]: </domain>
Nov 02 17:23:08 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1772040712',display_name='tempest-TestVolumeSwap-server-1772040712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1772040712',id=17,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQd7w5t+3YkB2W+JRtTysaaf21uU48mHQvxEZN0JzXn2p8A9XxaEnx+YmeuuFOi7YlXhZc9ylcFWJqE5NdjnARgRwJqye2wgVhcvH5iFiACgprMuZ67q+yIRiVTIYfIOw==',key_name='tempest-keypair-450498757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18b5c618c10c4d94b1fc6e930e2aa22d',ramdisk_id='',reservation_id='r-tbcw1gxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1151215288',owner_user_name='tempest-TestVolumeSwap-1151215288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7302bfeed466e8140faf81456bb38',uuid=f0eb2644-f721-4a49-834d-16c43ad6d5c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e48d9f29-5466-428b-b554-01882ec6484a", "address": "fa:16:3e:18:4e:03", "network": {"id": "9298cdb9-70a6-400f-8e51-cc4d62b1e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1547217393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18b5c618c10c4d94b1fc6e930e2aa22d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48d9f29-54", "ovs_interfaceid": "e48d9f29-5466-428b-b554-01882ec6484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Converting VIF {"id": "e48d9f29-5466-428b-b554-01882ec6484a", "address": "fa:16:3e:18:4e:03", "network": {"id": "9298cdb9-70a6-400f-8e51-cc4d62b1e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1547217393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18b5c618c10c4d94b1fc6e930e2aa22d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48d9f29-54", "ovs_interfaceid": "e48d9f29-5466-428b-b554-01882ec6484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:4e:03,bridge_name='br-int',has_traffic_filtering=True,id=e48d9f29-5466-428b-b554-01882ec6484a,network=Network(9298cdb9-70a6-400f-8e51-cc4d62b1e98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48d9f29-54') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG os_vif [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:4e:03,bridge_name='br-int',has_traffic_filtering=True,id=e48d9f29-5466-428b-b554-01882ec6484a,network=Network(9298cdb9-70a6-400f-8e51-cc4d62b1e98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48d9f29-54') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a792460c-3828-5591-90b6-7baed37e9ce6', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape48d9f29-54, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape48d9f29-54, col_values=(('qos', UUID('3dbac2e6-8275-411a-bdec-3ada5dd24279')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape48d9f29-54, col_values=(('external_ids', {'iface-id': 'e48d9f29-5466-428b-b554-01882ec6484a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:4e:03', 'vm-uuid': 'f0eb2644-f721-4a49-834d-16c43ad6d5c2'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:08 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:23:08 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=7693MB free_disk=25.45661163330078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:08 user nova-compute[74980]: INFO os_vif [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:4e:03,bridge_name='br-int',has_traffic_filtering=True,id=e48d9f29-5466-428b-b554-01882ec6484a,network=Network(9298cdb9-70a6-400f-8e51-cc4d62b1e98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48d9f29-54')
Nov 02 17:23:08 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Took 1.68 seconds to deallocate network for instance.
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] No VIF found with MAC fa:16:3e:18:4e:03, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 4e6bfb81-f01c-47e6-b771-7c2b34587623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance d7f2fa00-48af-4277-93b4-af930e4a650f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1154d1f9-80b8-405b-8fd8-c10bb39c507f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 82362140-8606-41dc-a574-86b0b89a7a35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1620c8eb-067c-4156-b927-2f64eac9e340 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 22b8ca59-959d-4687-bb7d-4fc7909aa852 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 854dd67d-7e05-47ad-b60a-23b9673bb8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.network.neutron [req-c5a7b1d1-315b-46f1-bbc5-f8a96a90ed51 req-a63283f0-8bae-49a9-876f-608f37e5894f service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Updated VIF entry in instance network info cache for port e48d9f29-5466-428b-b554-01882ec6484a. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.network.neutron [req-c5a7b1d1-315b-46f1-bbc5-f8a96a90ed51 req-a63283f0-8bae-49a9-876f-608f37e5894f service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Updating instance_info_cache with network_info: [{"id": "e48d9f29-5466-428b-b554-01882ec6484a", "address": "fa:16:3e:18:4e:03", "network": {"id": "9298cdb9-70a6-400f-8e51-cc4d62b1e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1547217393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18b5c618c10c4d94b1fc6e930e2aa22d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48d9f29-54", "ovs_interfaceid": "e48d9f29-5466-428b-b554-01882ec6484a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c5a7b1d1-315b-46f1-bbc5-f8a96a90ed51 req-a63283f0-8bae-49a9-876f-608f37e5894f service nova] Releasing lock "refresh_cache-f0eb2644-f721-4a49-834d-16c43ad6d5c2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance f0eb2644-f721-4a49-834d-16c43ad6d5c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.compute.manager [req-a992c8de-6fda-454b-ba56-99e219af5fe9 req-c0055c6a-3d5c-4e75-93da-cec9494b9356 service nova] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Received event network-vif-deleted-3d7df4f6-fa0e-4b6e-b96d-08126d2765f8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing inventories for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating ProviderTree inventory for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating inventory in ProviderTree for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 17:23:08 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing aggregate associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, aggregates: None {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing trait associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:09 user nova-compute[74980]: INFO nova.compute.manager [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Took 1.03 seconds to detach 1 volumes for instance.
Nov 02 17:23:09 user nova-compute[74980]: DEBUG nova.compute.manager [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] [instance: 82362140-8606-41dc-a574-86b0b89a7a35] Deleting volume: 756ebe57-479f-485e-8091-9f3771aea8cf {{(pid=74980) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.169s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74980) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "d7f2fa00-48af-4277-93b4-af930e4a650f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "d7f2fa00-48af-4277-93b4-af930e4a650f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:09 user nova-compute[74980]: INFO nova.compute.manager [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Terminating instance
Nov 02 17:23:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:09 user nova-compute[74980]: DEBUG nova.compute.manager [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.572s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:10 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Deleted allocations for instance 82362140-8606-41dc-a574-86b0b89a7a35
Nov 02 17:23:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-74e2155d-cc99-4833-b65c-e66604d4144b tempest-ServerActionsV293TestJSON-2119202372 tempest-ServerActionsV293TestJSON-2119202372-project-member] Lock "82362140-8606-41dc-a574-86b0b89a7a35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.245s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Skipping network cache update for instance because it is being deleted. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Skipping network cache update for instance because it is Building. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-4e6bfb81-f01c-47e6-b771-7c2b34587623" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-4e6bfb81-f01c-47e6-b771-7c2b34587623" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 4e6bfb81-f01c-47e6-b771-7c2b34587623 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:23:10 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Instance destroyed successfully.
Nov 02 17:23:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'resources' on Instance uuid d7f2fa00-48af-4277-93b4-af930e4a650f {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1569365018',display_name='tempest-AttachVolumeNegativeTest-server-1569365018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1569365018',id=2,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeHZCFkMjNxG1SEDleej369iWuE5S5LAfSIjQLR+6TwnYXqrydwMDTevfz2BB5plMzN4xj1y19/NHZy4KBw3A1bwVnVwuRec3lJVXQHZlBZsrxAlt8g5aErwdHJZdLI3g==',key_name='tempest-keypair-1637593074',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:17:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b889d98476584bb1b18080bfa0664810',ramdisk_id='',reservation_id='r-q4dmt0ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1956142060',owner_user_name='tempest-AttachVolumeNegativeTest-1956142060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:17:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a979e164900348beaab104704c92b722',uuid=d7f2fa00-48af-4277-93b4-af930e4a650f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "address": "fa:16:3e:28:61:3f", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1b9b79-04", "ovs_interfaceid": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converting VIF {"id": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "address": "fa:16:3e:28:61:3f", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1b9b79-04", "ovs_interfaceid": "ea1b9b79-0495-451f-a67d-e997c88e4b60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:61:3f,bridge_name='br-int',has_traffic_filtering=True,id=ea1b9b79-0495-451f-a67d-e997c88e4b60,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1b9b79-04') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG os_vif [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:61:3f,bridge_name='br-int',has_traffic_filtering=True,id=ea1b9b79-0495-451f-a67d-e997c88e4b60,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1b9b79-04') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea1b9b79-04, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7348ab2e-7ba0-444a-89ab-69723ecf7787) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:10 user nova-compute[74980]: INFO os_vif [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:61:3f,bridge_name='br-int',has_traffic_filtering=True,id=ea1b9b79-0495-451f-a67d-e997c88e4b60,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1b9b79-04')
Nov 02 17:23:10 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Deleting instance files /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f_del
Nov 02 17:23:10 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Deletion of /opt/stack/data/nova/instances/d7f2fa00-48af-4277-93b4-af930e4a650f_del complete
Nov 02 17:23:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:10 user nova-compute[74980]: INFO nova.compute.manager [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 02 17:23:10 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:23:10 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:23:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-a43271e9-1f9b-4269-b5d3-e4da27870bac req-43e4c361-a1cf-434c-8738-3ef2d72965cd service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Received event network-vif-plugged-e48d9f29-5466-428b-b554-01882ec6484a {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a43271e9-1f9b-4269-b5d3-e4da27870bac req-43e4c361-a1cf-434c-8738-3ef2d72965cd service nova] Acquiring lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a43271e9-1f9b-4269-b5d3-e4da27870bac req-43e4c361-a1cf-434c-8738-3ef2d72965cd service nova] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a43271e9-1f9b-4269-b5d3-e4da27870bac req-43e4c361-a1cf-434c-8738-3ef2d72965cd service nova] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-a43271e9-1f9b-4269-b5d3-e4da27870bac req-43e4c361-a1cf-434c-8738-3ef2d72965cd service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] No waiting events found dispatching network-vif-plugged-e48d9f29-5466-428b-b554-01882ec6484a {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:11 user nova-compute[74980]: WARNING nova.compute.manager [req-a43271e9-1f9b-4269-b5d3-e4da27870bac req-43e4c361-a1cf-434c-8738-3ef2d72965cd service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Received unexpected event network-vif-plugged-e48d9f29-5466-428b-b554-01882ec6484a for instance with vm_state building and task_state spawning.
Nov 02 17:23:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-a43271e9-1f9b-4269-b5d3-e4da27870bac req-43e4c361-a1cf-434c-8738-3ef2d72965cd service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Received event network-vif-plugged-e48d9f29-5466-428b-b554-01882ec6484a {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a43271e9-1f9b-4269-b5d3-e4da27870bac req-43e4c361-a1cf-434c-8738-3ef2d72965cd service nova] Acquiring lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a43271e9-1f9b-4269-b5d3-e4da27870bac req-43e4c361-a1cf-434c-8738-3ef2d72965cd service nova] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a43271e9-1f9b-4269-b5d3-e4da27870bac req-43e4c361-a1cf-434c-8738-3ef2d72965cd service nova] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-a43271e9-1f9b-4269-b5d3-e4da27870bac req-43e4c361-a1cf-434c-8738-3ef2d72965cd service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] No waiting events found dispatching network-vif-plugged-e48d9f29-5466-428b-b554-01882ec6484a {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:11 user nova-compute[74980]: WARNING nova.compute.manager [req-a43271e9-1f9b-4269-b5d3-e4da27870bac req-43e4c361-a1cf-434c-8738-3ef2d72965cd service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Received unexpected event network-vif-plugged-e48d9f29-5466-428b-b554-01882ec6484a for instance with vm_state building and task_state spawning.
Nov 02 17:23:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Updating instance_info_cache with network_info: [{"id": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "address": "fa:16:3e:95:9a:bc", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6189316b-4d", "ovs_interfaceid": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:23:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-4e6bfb81-f01c-47e6-b771-7c2b34587623" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:23:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:23:11 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:23:11 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:23:12 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:23:12 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Took 1.21 seconds to deallocate network for instance.
Nov 02 17:23:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:12 user nova-compute[74980]: DEBUG nova.compute.manager [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:23:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:23:12 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Instance spawned successfully.
Nov 02 17:23:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:23:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:12 user nova-compute[74980]: INFO nova.compute.manager [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Took 8.90 seconds to spawn the instance on the hypervisor.
Nov 02 17:23:12 user nova-compute[74980]: DEBUG nova.compute.manager [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:23:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:12 user nova-compute[74980]: INFO nova.compute.manager [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Took 9.84 seconds to build instance.
Nov 02 17:23:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dc5bfbe6-e706-4b59-9625-f62bf7683460 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.971s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:12 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:23:12 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:23:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:12 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Deleted allocations for instance d7f2fa00-48af-4277-93b4-af930e4a650f
Nov 02 17:23:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5edef0d2-82cd-4a14-8528-edae24e75ac2 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.999s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-aada4ebb-0fe1-4a8c-9f9a-a4a0ab462811 req-192ec418-abf4-45eb-ae96-7e72caecb32e service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Received event network-vif-unplugged-ea1b9b79-0495-451f-a67d-e997c88e4b60 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-aada4ebb-0fe1-4a8c-9f9a-a4a0ab462811 req-192ec418-abf4-45eb-ae96-7e72caecb32e service nova] Acquiring lock "d7f2fa00-48af-4277-93b4-af930e4a650f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-aada4ebb-0fe1-4a8c-9f9a-a4a0ab462811 req-192ec418-abf4-45eb-ae96-7e72caecb32e service nova] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-aada4ebb-0fe1-4a8c-9f9a-a4a0ab462811 req-192ec418-abf4-45eb-ae96-7e72caecb32e service nova] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-aada4ebb-0fe1-4a8c-9f9a-a4a0ab462811 req-192ec418-abf4-45eb-ae96-7e72caecb32e service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] No waiting events found dispatching network-vif-unplugged-ea1b9b79-0495-451f-a67d-e997c88e4b60 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:13 user nova-compute[74980]: WARNING nova.compute.manager [req-aada4ebb-0fe1-4a8c-9f9a-a4a0ab462811 req-192ec418-abf4-45eb-ae96-7e72caecb32e service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Received unexpected event network-vif-unplugged-ea1b9b79-0495-451f-a67d-e997c88e4b60 for instance with vm_state deleted and task_state None.
Nov 02 17:23:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-aada4ebb-0fe1-4a8c-9f9a-a4a0ab462811 req-192ec418-abf4-45eb-ae96-7e72caecb32e service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Received event network-vif-plugged-ea1b9b79-0495-451f-a67d-e997c88e4b60 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-aada4ebb-0fe1-4a8c-9f9a-a4a0ab462811 req-192ec418-abf4-45eb-ae96-7e72caecb32e service nova] Acquiring lock "d7f2fa00-48af-4277-93b4-af930e4a650f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-aada4ebb-0fe1-4a8c-9f9a-a4a0ab462811 req-192ec418-abf4-45eb-ae96-7e72caecb32e service nova] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-aada4ebb-0fe1-4a8c-9f9a-a4a0ab462811 req-192ec418-abf4-45eb-ae96-7e72caecb32e service nova] Lock "d7f2fa00-48af-4277-93b4-af930e4a650f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-aada4ebb-0fe1-4a8c-9f9a-a4a0ab462811 req-192ec418-abf4-45eb-ae96-7e72caecb32e service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] No waiting events found dispatching network-vif-plugged-ea1b9b79-0495-451f-a67d-e997c88e4b60 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:13 user nova-compute[74980]: WARNING nova.compute.manager [req-aada4ebb-0fe1-4a8c-9f9a-a4a0ab462811 req-192ec418-abf4-45eb-ae96-7e72caecb32e service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Received unexpected event network-vif-plugged-ea1b9b79-0495-451f-a67d-e997c88e4b60 for instance with vm_state deleted and task_state None.
Nov 02 17:23:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-aada4ebb-0fe1-4a8c-9f9a-a4a0ab462811 req-192ec418-abf4-45eb-ae96-7e72caecb32e service nova] [instance: d7f2fa00-48af-4277-93b4-af930e4a650f] Received event network-vif-deleted-ea1b9b79-0495-451f-a67d-e997c88e4b60 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-f9ffcec6-c9de-475a-930e-f4ccdc902dbc req-759b5b4c-00d7-41ca-9abe-dc941c6782e2 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received event network-changed-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-f9ffcec6-c9de-475a-930e-f4ccdc902dbc req-759b5b4c-00d7-41ca-9abe-dc941c6782e2 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Refreshing instance network info cache due to event network-changed-1d0a548b-f00a-401b-9867-c1b9a4ee8d20. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:23:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f9ffcec6-c9de-475a-930e-f4ccdc902dbc req-759b5b4c-00d7-41ca-9abe-dc941c6782e2 service nova] Acquiring lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:23:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f9ffcec6-c9de-475a-930e-f4ccdc902dbc req-759b5b4c-00d7-41ca-9abe-dc941c6782e2 service nova] Acquired lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:23:13 user nova-compute[74980]: DEBUG nova.network.neutron [req-f9ffcec6-c9de-475a-930e-f4ccdc902dbc req-759b5b4c-00d7-41ca-9abe-dc941c6782e2 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Refreshing network info cache for port 1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:23:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "22b8ca59-959d-4687-bb7d-4fc7909aa852" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:14 user nova-compute[74980]: INFO nova.compute.manager [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Shelve offloading
Nov 02 17:23:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:14 user nova-compute[74980]: DEBUG nova.network.neutron [req-f9ffcec6-c9de-475a-930e-f4ccdc902dbc req-759b5b4c-00d7-41ca-9abe-dc941c6782e2 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updated VIF entry in instance network info cache for port 1d0a548b-f00a-401b-9867-c1b9a4ee8d20. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:23:14 user nova-compute[74980]: DEBUG nova.network.neutron [req-f9ffcec6-c9de-475a-930e-f4ccdc902dbc req-759b5b4c-00d7-41ca-9abe-dc941c6782e2 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updating instance_info_cache with network_info: [{"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:23:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f9ffcec6-c9de-475a-930e-f4ccdc902dbc req-759b5b4c-00d7-41ca-9abe-dc941c6782e2 service nova] Releasing lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:23:15 user nova-compute[74980]: DEBUG nova.compute.manager [req-1fe14ece-0028-4e7b-aa58-96f3486bb962 req-4d352b7f-6bf7-4f17-a196-20059ce83713 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received event network-vif-unplugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1fe14ece-0028-4e7b-aa58-96f3486bb962 req-4d352b7f-6bf7-4f17-a196-20059ce83713 service nova] Acquiring lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1fe14ece-0028-4e7b-aa58-96f3486bb962 req-4d352b7f-6bf7-4f17-a196-20059ce83713 service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1fe14ece-0028-4e7b-aa58-96f3486bb962 req-4d352b7f-6bf7-4f17-a196-20059ce83713 service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:15 user nova-compute[74980]: DEBUG nova.compute.manager [req-1fe14ece-0028-4e7b-aa58-96f3486bb962 req-4d352b7f-6bf7-4f17-a196-20059ce83713 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] No waiting events found dispatching network-vif-unplugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:15 user nova-compute[74980]: WARNING nova.compute.manager [req-1fe14ece-0028-4e7b-aa58-96f3486bb962 req-4d352b7f-6bf7-4f17-a196-20059ce83713 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received unexpected event network-vif-unplugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 for instance with vm_state active and task_state shelving.
Nov 02 17:23:15 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Instance destroyed successfully.
Nov 02 17:23:15 user nova-compute[74980]: DEBUG nova.compute.manager [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:23:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:23:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquired lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:23:15 user nova-compute[74980]: DEBUG nova.network.neutron [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:23:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG nova.network.neutron [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updating instance_info_cache with network_info: [{"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Releasing lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:16 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Instance destroyed successfully.
Nov 02 17:23:16 user nova-compute[74980]: DEBUG nova.objects.instance [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lazy-loading 'resources' on Instance uuid 22b8ca59-959d-4687-bb7d-4fc7909aa852 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:21:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1948769732',display_name='tempest-TestShelveInstance-server-1948769732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1948769732',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBv3hFR2ExwN4lcjeGa2BdBDTiPIvIMfgWaKwc9SINl9eWcOYXiCvZXCh1PVrKZ4XQ7kVoydP62j/N7Nn/Kp/S+xJZS5UnPB8y1PQFmO4tQR+kVUHM2f0tUgKhLjr+OWsw==',key_name='tempest-TestShelveInstance-713239200',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:21:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3cf3b7e1970d471d8a80d04497963276',ramdisk_id='',reservation_id='r-00qsqblb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1367401440',owner_user_name='tempest-TestShelveInstance-1367401440-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:21:50Z,user_data=None,user_id='9c5c816110044002a6753a93e13459fc',uuid=22b8ca59-959d-4687-bb7d-4fc7909aa852,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Converting VIF {"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:1c:d0,bridge_name='br-int',has_traffic_filtering=True,id=1d0a548b-f00a-401b-9867-c1b9a4ee8d20,network=Network(6009ce0d-3076-4e9a-85f6-3ca97fcd5457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0a548b-f0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG os_vif [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:1c:d0,bridge_name='br-int',has_traffic_filtering=True,id=1d0a548b-f00a-401b-9867-c1b9a4ee8d20,network=Network(6009ce0d-3076-4e9a-85f6-3ca97fcd5457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0a548b-f0') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d0a548b-f0, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4ff7b71-5387-4e9b-9e3c-820415ee4e71) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:16 user nova-compute[74980]: INFO os_vif [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:1c:d0,bridge_name='br-int',has_traffic_filtering=True,id=1d0a548b-f00a-401b-9867-c1b9a4ee8d20,network=Network(6009ce0d-3076-4e9a-85f6-3ca97fcd5457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0a548b-f0')
Nov 02 17:23:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFxWpjSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:23:16 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:23:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-754afb0c-de12-4049-96cd-13596dc5098c req-7cd32712-b867-4117-ad34-f7454eca21b0 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received event network-changed-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-754afb0c-de12-4049-96cd-13596dc5098c req-7cd32712-b867-4117-ad34-f7454eca21b0 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Refreshing instance network info cache due to event network-changed-1d0a548b-f00a-401b-9867-c1b9a4ee8d20. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-754afb0c-de12-4049-96cd-13596dc5098c req-7cd32712-b867-4117-ad34-f7454eca21b0 service nova] Acquiring lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-754afb0c-de12-4049-96cd-13596dc5098c req-7cd32712-b867-4117-ad34-f7454eca21b0 service nova] Acquired lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG nova.network.neutron [req-754afb0c-de12-4049-96cd-13596dc5098c req-7cd32712-b867-4117-ad34-f7454eca21b0 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Refreshing network info cache for port 1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67f991f-6ca7-47b8-bf11-90598114e94b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:23:16 user nova-compute[74980]: No targets found.
Nov 02 17:23:16 user nova-compute[74980]: iSNS:
Nov 02 17:23:16 user nova-compute[74980]: No targets found.
Nov 02 17:23:16 user nova-compute[74980]: STATIC:
Nov 02 17:23:16 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e
Nov 02 17:23:16 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:23:16 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:23:16 user nova-compute[74980]: FIRMWARE:
Nov 02 17:23:16 user nova-compute[74980]: No targets found.
Nov 02 17:23:16 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:23:16 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:23:16 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[36557b15-69d2-4360-a765-72fa5f8b7f20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02da068-817d-48f1-839e-7b4a6318d1bf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:23:16 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:23:16 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b4408d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e'): ({'sdd'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Removing single pathed devices sdd {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:23:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b530033e-a3bd-4226-88af-f0024e24916e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9f0f78-3b57-4c46-8b89-41665526c0e3]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Flushing IO for device /dev/sdd {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92525ea-bd37-47ab-b80b-c248bbdc1d49]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[701ccd3f-848b-45a4-87b1-269eb3577823]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] SCSI volumes sdd have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30ec7e8-40cc-4581-9c22-831a32de38c9]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7637c8-690a-461e-81ea-aacf1c76dd23]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260]
Nov 02 17:23:17 user nova-compute[74980]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260] successful.
Nov 02 17:23:17 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-3159ae21-ae27-4fa0-9f13-4320ad6e931a req-00f209b3-899c-4665-a26f-0ff4ffde29a5 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received event network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3159ae21-ae27-4fa0-9f13-4320ad6e931a req-00f209b3-899c-4665-a26f-0ff4ffde29a5 service nova] Acquiring lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3159ae21-ae27-4fa0-9f13-4320ad6e931a req-00f209b3-899c-4665-a26f-0ff4ffde29a5 service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3159ae21-ae27-4fa0-9f13-4320ad6e931a req-00f209b3-899c-4665-a26f-0ff4ffde29a5 service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-3159ae21-ae27-4fa0-9f13-4320ad6e931a req-00f209b3-899c-4665-a26f-0ff4ffde29a5 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] No waiting events found dispatching network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:17 user nova-compute[74980]: WARNING nova.compute.manager [req-3159ae21-ae27-4fa0-9f13-4320ad6e931a req-00f209b3-899c-4665-a26f-0ff4ffde29a5 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received unexpected event network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 for instance with vm_state active and task_state shelving.
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17488bd-6c6d-4e22-bca5-f53b2eaf0a3b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] <== disconnect_volume: return (362ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:23:17 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Deleting instance files /opt/stack/data/nova/instances/22b8ca59-959d-4687-bb7d-4fc7909aa852_del
Nov 02 17:23:17 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Deletion of /opt/stack/data/nova/instances/22b8ca59-959d-4687-bb7d-4fc7909aa852_del complete
Nov 02 17:23:17 user nova-compute[74980]: DEBUG nova.network.neutron [req-754afb0c-de12-4049-96cd-13596dc5098c req-7cd32712-b867-4117-ad34-f7454eca21b0 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updated VIF entry in instance network info cache for port 1d0a548b-f00a-401b-9867-c1b9a4ee8d20. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG nova.network.neutron [req-754afb0c-de12-4049-96cd-13596dc5098c req-7cd32712-b867-4117-ad34-f7454eca21b0 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updating instance_info_cache with network_info: [{"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": null, "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:23:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-754afb0c-de12-4049-96cd-13596dc5098c req-7cd32712-b867-4117-ad34-f7454eca21b0 service nova] Releasing lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:23:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:23:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:23:21 user nova-compute[74980]: INFO nova.compute.claims [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Claim successful on node user
Nov 02 17:23:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.756s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:23:22 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:23:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG nova.policy [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee158ffa58d34048962d6b6b788a1fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc86ed5ca134f9190da6755ca033390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:23:22 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Creating image(s)
Nov 02 17:23:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "/opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "/opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "/opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.213s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.207s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk 1073741824" returned: 0 in 0.050s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.239s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Successfully created port: c9faccea-2597-44e1-9c1e-fb360771d4f2 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Cannot resize image /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Ensure instance console log exists: /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.010s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Successfully updated port: c9faccea-2597-44e1-9c1e-fb360771d4f2 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "refresh_cache-92537376-b06d-4d0f-8ed4-1bc120d080fa" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquired lock "refresh_cache-92537376-b06d-4d0f-8ed4-1bc120d080fa" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-524955de-4f74-41ab-b04f-07d72da9a8a3 req-2f5589da-34b1-4399-9b7a-6f08d3a957cd service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Received event network-changed-c9faccea-2597-44e1-9c1e-fb360771d4f2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-524955de-4f74-41ab-b04f-07d72da9a8a3 req-2f5589da-34b1-4399-9b7a-6f08d3a957cd service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Refreshing instance network info cache due to event network-changed-c9faccea-2597-44e1-9c1e-fb360771d4f2. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-524955de-4f74-41ab-b04f-07d72da9a8a3 req-2f5589da-34b1-4399-9b7a-6f08d3a957cd service nova] Acquiring lock "refresh_cache-92537376-b06d-4d0f-8ed4-1bc120d080fa" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Updating instance_info_cache with network_info: [{"id": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "address": "fa:16:3e:fb:1d:72", "network": {"id": "01828aab-5bfd-42d5-a90c-b21706d46887", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1553292420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc86ed5ca134f9190da6755ca033390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9faccea-25", "ovs_interfaceid": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Releasing lock "refresh_cache-92537376-b06d-4d0f-8ed4-1bc120d080fa" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Instance network_info: |[{"id": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "address": "fa:16:3e:fb:1d:72", "network": {"id": "01828aab-5bfd-42d5-a90c-b21706d46887", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1553292420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc86ed5ca134f9190da6755ca033390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9faccea-25", "ovs_interfaceid": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-524955de-4f74-41ab-b04f-07d72da9a8a3 req-2f5589da-34b1-4399-9b7a-6f08d3a957cd service nova] Acquired lock "refresh_cache-92537376-b06d-4d0f-8ed4-1bc120d080fa" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.network.neutron [req-524955de-4f74-41ab-b04f-07d72da9a8a3 req-2f5589da-34b1-4399-9b7a-6f08d3a957cd service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Refreshing network info cache for port c9faccea-2597-44e1-9c1e-fb360771d4f2 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Start _get_guest_xml network_info=[{"id": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "address": "fa:16:3e:fb:1d:72", "network": {"id": "01828aab-5bfd-42d5-a90c-b21706d46887", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1553292420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc86ed5ca134f9190da6755ca033390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9faccea-25", "ovs_interfaceid": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:23:24 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:23:24 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-282379696',display_name='tempest-TestServerVolumeAttachmentScenario-server-282379696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-282379696',id=18,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNo8yZv4iN4Q4ci8XtFwAzUXsA0aYX267UX7ji2N1VKKJ7SGWxH+ZVOSjeRr9xYc2y7srN+RPpwd5zkbNqxvs7VsdbBYnX3rBwnfRAxCsFv0bK2bMx4syE/XHALOERIuQQ==',key_name='tempest-keypair-1723110345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc86ed5ca134f9190da6755ca033390',ramdisk_id='',reservation_id='r-p1w7qfan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-540307316',owner_user_name='tempest-TestServerVolumeAttachmentScenario-540307316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:23:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee158ffa58d34048962d6b6b788a1fe3',uuid=92537376-b06d-4d0f-8ed4-1bc120d080fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "address": "fa:16:3e:fb:1d:72", "network": {"id": "01828aab-5bfd-42d5-a90c-b21706d46887", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1553292420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc86ed5ca134f9190da6755ca033390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9faccea-25", "ovs_interfaceid": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Converting VIF {"id": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "address": "fa:16:3e:fb:1d:72", "network": {"id": "01828aab-5bfd-42d5-a90c-b21706d46887", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1553292420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc86ed5ca134f9190da6755ca033390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9faccea-25", "ovs_interfaceid": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:1d:72,bridge_name='br-int',has_traffic_filtering=True,id=c9faccea-2597-44e1-9c1e-fb360771d4f2,network=Network(01828aab-5bfd-42d5-a90c-b21706d46887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9faccea-25') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.objects.instance [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lazy-loading 'pci_devices' on Instance uuid 92537376-b06d-4d0f-8ed4-1bc120d080fa {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:23:24 user nova-compute[74980]:   <uuid>92537376-b06d-4d0f-8ed4-1bc120d080fa</uuid>
Nov 02 17:23:24 user nova-compute[74980]:   <name>instance-00000012</name>
Nov 02 17:23:24 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:23:24 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:23:24 user nova-compute[74980]:   <metadata>
Nov 02 17:23:24 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:23:24 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:23:24 user nova-compute[74980]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-282379696</nova:name>
Nov 02 17:23:24 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:23:24</nova:creationTime>
Nov 02 17:23:24 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:23:24 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:23:24 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:23:24 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:23:24 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:23:24 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:23:24 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:23:24 user nova-compute[74980]:       <nova:owner>
Nov 02 17:23:24 user nova-compute[74980]:         <nova:user uuid="ee158ffa58d34048962d6b6b788a1fe3">tempest-TestServerVolumeAttachmentScenario-540307316-project-member</nova:user>
Nov 02 17:23:24 user nova-compute[74980]:         <nova:project uuid="7bc86ed5ca134f9190da6755ca033390">tempest-TestServerVolumeAttachmentScenario-540307316</nova:project>
Nov 02 17:23:24 user nova-compute[74980]:       </nova:owner>
Nov 02 17:23:24 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:23:24 user nova-compute[74980]:       <nova:ports>
Nov 02 17:23:24 user nova-compute[74980]:         <nova:port uuid="c9faccea-2597-44e1-9c1e-fb360771d4f2">
Nov 02 17:23:24 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 17:23:24 user nova-compute[74980]:         </nova:port>
Nov 02 17:23:24 user nova-compute[74980]:       </nova:ports>
Nov 02 17:23:24 user nova-compute[74980]:     </nova:instance>
Nov 02 17:23:24 user nova-compute[74980]:   </metadata>
Nov 02 17:23:24 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:23:24 user nova-compute[74980]:     <system>
Nov 02 17:23:24 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:23:24 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:23:24 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:23:24 user nova-compute[74980]:       <entry name="serial">92537376-b06d-4d0f-8ed4-1bc120d080fa</entry>
Nov 02 17:23:24 user nova-compute[74980]:       <entry name="uuid">92537376-b06d-4d0f-8ed4-1bc120d080fa</entry>
Nov 02 17:23:24 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:23:24 user nova-compute[74980]:     </system>
Nov 02 17:23:24 user nova-compute[74980]:   </sysinfo>
Nov 02 17:23:24 user nova-compute[74980]:   <os>
Nov 02 17:23:24 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:23:24 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:23:24 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:23:24 user nova-compute[74980]:   </os>
Nov 02 17:23:24 user nova-compute[74980]:   <features>
Nov 02 17:23:24 user nova-compute[74980]:     <acpi/>
Nov 02 17:23:24 user nova-compute[74980]:     <apic/>
Nov 02 17:23:24 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:23:24 user nova-compute[74980]:   </features>
Nov 02 17:23:24 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:23:24 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:23:24 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:23:24 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:23:24 user nova-compute[74980]:   </clock>
Nov 02 17:23:24 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:23:24 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:23:24 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:23:24 user nova-compute[74980]:   </cpu>
Nov 02 17:23:24 user nova-compute[74980]:   <devices>
Nov 02 17:23:24 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:23:24 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:23:24 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk"/>
Nov 02 17:23:24 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:23:24 user nova-compute[74980]:     </disk>
Nov 02 17:23:24 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:23:24 user nova-compute[74980]:       <mac address="fa:16:3e:fb:1d:72"/>
Nov 02 17:23:24 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:23:24 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:23:24 user nova-compute[74980]:       <target dev="tapc9faccea-25"/>
Nov 02 17:23:24 user nova-compute[74980]:     </interface>
Nov 02 17:23:24 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:23:24 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/console.log" append="off"/>
Nov 02 17:23:24 user nova-compute[74980]:     </serial>
Nov 02 17:23:24 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:23:24 user nova-compute[74980]:     <video>
Nov 02 17:23:24 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:23:24 user nova-compute[74980]:     </video>
Nov 02 17:23:24 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:23:24 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:23:24 user nova-compute[74980]:     </rng>
Nov 02 17:23:24 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:23:24 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:23:24 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:23:24 user nova-compute[74980]:     </memballoon>
Nov 02 17:23:24 user nova-compute[74980]:   </devices>
Nov 02 17:23:24 user nova-compute[74980]: </domain>
Nov 02 17:23:24 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-282379696',display_name='tempest-TestServerVolumeAttachmentScenario-server-282379696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-282379696',id=18,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNo8yZv4iN4Q4ci8XtFwAzUXsA0aYX267UX7ji2N1VKKJ7SGWxH+ZVOSjeRr9xYc2y7srN+RPpwd5zkbNqxvs7VsdbBYnX3rBwnfRAxCsFv0bK2bMx4syE/XHALOERIuQQ==',key_name='tempest-keypair-1723110345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc86ed5ca134f9190da6755ca033390',ramdisk_id='',reservation_id='r-p1w7qfan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-540307316',owner_user_name='tempest-TestServerVolumeAttachmentScenario-540307316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:23:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee158ffa58d34048962d6b6b788a1fe3',uuid=92537376-b06d-4d0f-8ed4-1bc120d080fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "address": "fa:16:3e:fb:1d:72", "network": {"id": "01828aab-5bfd-42d5-a90c-b21706d46887", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1553292420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc86ed5ca134f9190da6755ca033390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9faccea-25", "ovs_interfaceid": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Converting VIF {"id": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "address": "fa:16:3e:fb:1d:72", "network": {"id": "01828aab-5bfd-42d5-a90c-b21706d46887", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1553292420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc86ed5ca134f9190da6755ca033390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9faccea-25", "ovs_interfaceid": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:1d:72,bridge_name='br-int',has_traffic_filtering=True,id=c9faccea-2597-44e1-9c1e-fb360771d4f2,network=Network(01828aab-5bfd-42d5-a90c-b21706d46887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9faccea-25') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG os_vif [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:1d:72,bridge_name='br-int',has_traffic_filtering=True,id=c9faccea-2597-44e1-9c1e-fb360771d4f2,network=Network(01828aab-5bfd-42d5-a90c-b21706d46887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9faccea-25') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f95d4128-f791-5445-bffd-81498120810e', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9faccea-25, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9faccea-25, col_values=(('qos', UUID('a0b9bde9-35ba-495f-b4f5-9cae55f57c11')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9faccea-25, col_values=(('external_ids', {'iface-id': 'c9faccea-2597-44e1-9c1e-fb360771d4f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:1d:72', 'vm-uuid': '92537376-b06d-4d0f-8ed4-1bc120d080fa'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:24 user nova-compute[74980]: INFO os_vif [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:1d:72,bridge_name='br-int',has_traffic_filtering=True,id=c9faccea-2597-44e1-9c1e-fb360771d4f2,network=Network(01828aab-5bfd-42d5-a90c-b21706d46887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9faccea-25')
Nov 02 17:23:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:23:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] No VIF found with MAC fa:16:3e:fb:1d:72, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:23:25 user nova-compute[74980]: DEBUG nova.network.neutron [req-524955de-4f74-41ab-b04f-07d72da9a8a3 req-2f5589da-34b1-4399-9b7a-6f08d3a957cd service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Updated VIF entry in instance network info cache for port c9faccea-2597-44e1-9c1e-fb360771d4f2. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:23:25 user nova-compute[74980]: DEBUG nova.network.neutron [req-524955de-4f74-41ab-b04f-07d72da9a8a3 req-2f5589da-34b1-4399-9b7a-6f08d3a957cd service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Updating instance_info_cache with network_info: [{"id": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "address": "fa:16:3e:fb:1d:72", "network": {"id": "01828aab-5bfd-42d5-a90c-b21706d46887", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1553292420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc86ed5ca134f9190da6755ca033390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9faccea-25", "ovs_interfaceid": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:23:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-524955de-4f74-41ab-b04f-07d72da9a8a3 req-2f5589da-34b1-4399-9b7a-6f08d3a957cd service nova] Releasing lock "refresh_cache-92537376-b06d-4d0f-8ed4-1bc120d080fa" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:23:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:27 user nova-compute[74980]: DEBUG nova.compute.manager [req-f7783ea8-98c7-48ac-b6be-0a7e406b5d6b req-b2d552fd-c3b7-4663-9cd5-4db8fbed8beb service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Received event network-vif-plugged-c9faccea-2597-44e1-9c1e-fb360771d4f2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f7783ea8-98c7-48ac-b6be-0a7e406b5d6b req-b2d552fd-c3b7-4663-9cd5-4db8fbed8beb service nova] Acquiring lock "92537376-b06d-4d0f-8ed4-1bc120d080fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f7783ea8-98c7-48ac-b6be-0a7e406b5d6b req-b2d552fd-c3b7-4663-9cd5-4db8fbed8beb service nova] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f7783ea8-98c7-48ac-b6be-0a7e406b5d6b req-b2d552fd-c3b7-4663-9cd5-4db8fbed8beb service nova] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:27 user nova-compute[74980]: DEBUG nova.compute.manager [req-f7783ea8-98c7-48ac-b6be-0a7e406b5d6b req-b2d552fd-c3b7-4663-9cd5-4db8fbed8beb service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] No waiting events found dispatching network-vif-plugged-c9faccea-2597-44e1-9c1e-fb360771d4f2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:27 user nova-compute[74980]: WARNING nova.compute.manager [req-f7783ea8-98c7-48ac-b6be-0a7e406b5d6b req-b2d552fd-c3b7-4663-9cd5-4db8fbed8beb service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Received unexpected event network-vif-plugged-c9faccea-2597-44e1-9c1e-fb360771d4f2 for instance with vm_state building and task_state spawning.
Nov 02 17:23:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqObNJxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:23:29 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:23:29 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:23:29 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa379a5d-5314-4c05-b686-7a4c3e898252]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:23:29 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee07f141-f5c3-446f-8bbd-d3c9577fcfe7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7] added
Nov 02 17:23:29 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG nova.compute.manager [req-b249b822-be2a-46bf-a000-bc9397914225 req-2823fc85-5d08-424e-93b5-7ffbaafc1000 service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Received event network-vif-plugged-c9faccea-2597-44e1-9c1e-fb360771d4f2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b249b822-be2a-46bf-a000-bc9397914225 req-2823fc85-5d08-424e-93b5-7ffbaafc1000 service nova] Acquiring lock "92537376-b06d-4d0f-8ed4-1bc120d080fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b249b822-be2a-46bf-a000-bc9397914225 req-2823fc85-5d08-424e-93b5-7ffbaafc1000 service nova] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b249b822-be2a-46bf-a000-bc9397914225 req-2823fc85-5d08-424e-93b5-7ffbaafc1000 service nova] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG nova.compute.manager [req-b249b822-be2a-46bf-a000-bc9397914225 req-2823fc85-5d08-424e-93b5-7ffbaafc1000 service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] No waiting events found dispatching network-vif-plugged-c9faccea-2597-44e1-9c1e-fb360771d4f2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:29 user nova-compute[74980]: WARNING nova.compute.manager [req-b249b822-be2a-46bf-a000-bc9397914225 req-2823fc85-5d08-424e-93b5-7ffbaafc1000 service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Received unexpected event network-vif-plugged-c9faccea-2597-44e1-9c1e-fb360771d4f2 for instance with vm_state building and task_state spawning.
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1257f7-1eb1-4034-9e57-4d6ffa07e776]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4bad0c-e406-4cdf-b481-9cb0871a4af7]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqObNJxI {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqObNJxI" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e562df-961e-4837-8221-68255687e5d9]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VqObNJxI'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[346b6af2-8a23-4098-8496-d2321aac6305]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e19833-d0db-4dec-a0ca-c44cdfa0e654]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:23:29 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:23:29 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:23:29 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 17:23:29 user nova-compute[74980]: 
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5feda99c-864d-4ce8-98e0-ad7d03a8c318]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260]
Nov 02 17:23:29 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260] successful.
Nov 02 17:23:29 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:23:29 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Instance spawned successfully.
Nov 02 17:23:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be2d757-b618-4939-b1a4-8d2a293ee4f2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e93054b-a1b9-48a4-b4bb-58ef55d7b676]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:23:29 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:23:29 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c273efab-2f6b-4a87-aa87-347330fedcf5]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqObNJxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:23:29 user nova-compute[74980]: INFO nova.compute.manager [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Took 6.84 seconds to spawn the instance on the hypervisor.
Nov 02 17:23:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:23:29 user nova-compute[74980]: INFO nova.compute.manager [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Took 8.32 seconds to build instance.
Nov 02 17:23:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b3146a4-002c-46b3-b152-4cb2f87670a9 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.639s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:23:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23437653865326134', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:23:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437653865326134', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:23:30 user nova-compute[74980]: DEBUG nova.objects.instance [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lazy-loading 'flavor' on Instance uuid 1620c8eb-067c-4156-b927-2f64eac9e340 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:23:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:23:30 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:23:30 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:23:30 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:23:30 user nova-compute[74980]:   <serial>df8cce4d-4862-4318-ac83-25951d18b8f7</serial>
Nov 02 17:23:30 user nova-compute[74980]: </disk>
Nov 02 17:23:30 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:23:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:23:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:23:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] No VIF found with MAC fa:16:3e:2a:60:a9, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:23:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5d7f3484-8a11-4f82-bed5-3a7edb7374aa tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "1620c8eb-067c-4156-b927-2f64eac9e340" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.862s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:32 user nova-compute[74980]: INFO nova.compute.manager [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Rebuilding instance
Nov 02 17:23:32 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:23:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-b4e92c5e-abc1-4389-b475-1f3a82fac1b7 req-4f71dbb4-f532-4ca4-bdb1-513f3ac91292 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received event network-vif-unplugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b4e92c5e-abc1-4389-b475-1f3a82fac1b7 req-4f71dbb4-f532-4ca4-bdb1-513f3ac91292 service nova] Acquiring lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b4e92c5e-abc1-4389-b475-1f3a82fac1b7 req-4f71dbb4-f532-4ca4-bdb1-513f3ac91292 service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b4e92c5e-abc1-4389-b475-1f3a82fac1b7 req-4f71dbb4-f532-4ca4-bdb1-513f3ac91292 service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-b4e92c5e-abc1-4389-b475-1f3a82fac1b7 req-4f71dbb4-f532-4ca4-bdb1-513f3ac91292 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] No waiting events found dispatching network-vif-unplugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:33 user nova-compute[74980]: WARNING nova.compute.manager [req-b4e92c5e-abc1-4389-b475-1f3a82fac1b7 req-4f71dbb4-f532-4ca4-bdb1-513f3ac91292 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received unexpected event network-vif-unplugged-a6485d81-59e2-4d5e-a060-fec023852f67 for instance with vm_state active and task_state rebuilding.
Nov 02 17:23:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:33 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Deleted allocations for instance 22b8ca59-959d-4687-bb7d-4fc7909aa852
Nov 02 17:23:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:33 user nova-compute[74980]: DEBUG nova.objects.instance [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lazy-loading 'numa_topology' on Instance uuid 22b8ca59-959d-4687-bb7d-4fc7909aa852 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:23:33 user nova-compute[74980]: DEBUG nova.objects.base [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Object Instance<22b8ca59-959d-4687-bb7d-4fc7909aa852> lazy-loaded attributes: resources,numa_topology {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:23:33 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Instance destroyed successfully.
Nov 02 17:23:33 user nova-compute[74980]: INFO nova.compute.manager [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Detaching volume df8cce4d-4862-4318-ac83-25951d18b8f7
Nov 02 17:23:34 user nova-compute[74980]: INFO nova.virt.block_device [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Attempting to driver detach volume df8cce4d-4862-4318-ac83-25951d18b8f7 from mountpoint /dev/vdb
Nov 02 17:23:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Attempting to detach device vdb from instance 1620c8eb-067c-4156-b927-2f64eac9e340 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:23:34 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:23:34 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:23:34 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:23:34 user nova-compute[74980]:   <serial>df8cce4d-4862-4318-ac83-25951d18b8f7</serial>
Nov 02 17:23:34 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:23:34 user nova-compute[74980]: </disk>
Nov 02 17:23:34 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:23:34 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Successfully detached device vdb from instance 1620c8eb-067c-4156-b927-2f64eac9e340 from the persistent domain config.
Nov 02 17:23:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqObNJxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:23:34 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0a05d6-bfa9-447c-a81d-591ff37ddbb2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:23:34 user nova-compute[74980]: No targets found.
Nov 02 17:23:34 user nova-compute[74980]: iSNS:
Nov 02 17:23:34 user nova-compute[74980]: No targets found.
Nov 02 17:23:34 user nova-compute[74980]: STATIC:
Nov 02 17:23:34 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7
Nov 02 17:23:34 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:23:34 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:23:34 user nova-compute[74980]: FIRMWARE:
Nov 02 17:23:34 user nova-compute[74980]: No targets found.
Nov 02 17:23:34 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:23:34 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:23:34 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.533s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[129404ac-6c9c-449d-b099-478996b24132]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c982afd5-510e-454b-b55c-9345dba3929d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:23:34 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:23:34 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5994642f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[794ebe8b-dff2-4937-ab67-f64f3b87e591]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-40e9f77b-3f92-48f6-a204-e5095d6ff8b0 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 19.891s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b371a29e-c771-4e5b-8996-7aaed8b11e78]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0843bc-11e3-48df-8ef5-bfd298e5bd62]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdecf61-346f-4b87-b069-ea63b73c8a09]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab955c7-5557-476b-ac68-521a8a4e1d72]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf66d0c-9a05-4561-9e25-731e34e263dd]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260]
Nov 02 17:23:34 user nova-compute[74980]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260] successful.
Nov 02 17:23:34 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0910184d-b471-49e8-8325-b3c66fdc9c4e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] <== disconnect_volume: return (435ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:23:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-52671076-5e39-4614-9aec-b4b234614394 req-9509393a-3aa0-48c5-b59f-fe72d5be8f22 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received event network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-52671076-5e39-4614-9aec-b4b234614394 req-9509393a-3aa0-48c5-b59f-fe72d5be8f22 service nova] Acquiring lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-52671076-5e39-4614-9aec-b4b234614394 req-9509393a-3aa0-48c5-b59f-fe72d5be8f22 service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-52671076-5e39-4614-9aec-b4b234614394 req-9509393a-3aa0-48c5-b59f-fe72d5be8f22 service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-52671076-5e39-4614-9aec-b4b234614394 req-9509393a-3aa0-48c5-b59f-fe72d5be8f22 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] No waiting events found dispatching network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:35 user nova-compute[74980]: WARNING nova.compute.manager [req-52671076-5e39-4614-9aec-b4b234614394 req-9509393a-3aa0-48c5-b59f-fe72d5be8f22 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received unexpected event network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 for instance with vm_state active and task_state rebuilding.
Nov 02 17:23:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "08309ef4-cf53-47b0-8960-01aba8903030" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:43 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:23:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:43 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:23:43 user nova-compute[74980]: INFO nova.compute.claims [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Claim successful on node user
Nov 02 17:23:44 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.666s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG nova.network.neutron [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:23:44 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:23:44 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG nova.policy [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2213678ccb5047c5a679917c61a1bc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fdd7d89a7e24ebab57bc95cc888fdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:23:44 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Creating image(s)
Nov 02 17:23:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "/opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "/opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "/opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.183s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.248s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk 1073741824" returned: 0 in 0.064s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.228s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:45 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:23:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:45 user nova-compute[74980]: DEBUG nova.network.neutron [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Successfully created port: fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:23:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:45 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Cannot resize image /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:23:45 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:23:45 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Ensure instance console log exists: /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:23:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.network.neutron [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Successfully updated port: fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquired lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.network.neutron [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-72db3406-d751-4b3b-b4b8-3e0b3f4c46ed req-f36fdb84-3db9-4c29-b68d-b0a777dcbfbb service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-changed-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-72db3406-d751-4b3b-b4b8-3e0b3f4c46ed req-f36fdb84-3db9-4c29-b68d-b0a777dcbfbb service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Refreshing instance network info cache due to event network-changed-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-72db3406-d751-4b3b-b4b8-3e0b3f4c46ed req-f36fdb84-3db9-4c29-b68d-b0a777dcbfbb service nova] Acquiring lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.network.neutron [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.network.neutron [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Updating instance_info_cache with network_info: [{"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Releasing lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Instance network_info: |[{"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-72db3406-d751-4b3b-b4b8-3e0b3f4c46ed req-f36fdb84-3db9-4c29-b68d-b0a777dcbfbb service nova] Acquired lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.network.neutron [req-72db3406-d751-4b3b-b4b8-3e0b3f4c46ed req-f36fdb84-3db9-4c29-b68d-b0a777dcbfbb service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Refreshing network info cache for port fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Start _get_guest_xml network_info=[{"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:23:46 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:23:46 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:23:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1380814959',display_name='tempest-ServerStableDeviceRescueTest-server-1380814959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1380814959',id=19,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbrZDVDF9WyskaiAHzOeYQPSBGf4ej2VA+399a6ly1594uUr7g7/LcK5OWhmyhR11uj6Xtpiag80/HJmX16EEfFuhlDjN9qlotT6SxweN3ezOBWJHHLcUs9aH5CmfDGyw==',key_name='tempest-keypair-763038001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fdd7d89a7e24ebab57bc95cc888fdf1',ramdisk_id='',reservation_id='r-nodh1jeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-101974758',owner_user_name='tempest-ServerStableDeviceRescueTest-101974758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2213678ccb5047c5a679917c61a1bc69',uuid=08309ef4-cf53-47b0-8960-01aba8903030,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Converting VIF {"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:19:cf,bridge_name='br-int',has_traffic_filtering=True,id=fe9b054a-bbfc-457c-86bf-dede3bb2c8dc,network=Network(2ee0006d-76b0-42e6-b47f-ab9804e4c021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9b054a-bb') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.objects.instance [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lazy-loading 'pci_devices' on Instance uuid 08309ef4-cf53-47b0-8960-01aba8903030 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:23:46 user nova-compute[74980]:   <uuid>08309ef4-cf53-47b0-8960-01aba8903030</uuid>
Nov 02 17:23:46 user nova-compute[74980]:   <name>instance-00000013</name>
Nov 02 17:23:46 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:23:46 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:23:46 user nova-compute[74980]:   <metadata>
Nov 02 17:23:46 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:23:46 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:23:46 user nova-compute[74980]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1380814959</nova:name>
Nov 02 17:23:46 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:23:46</nova:creationTime>
Nov 02 17:23:46 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:23:46 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:23:46 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:23:46 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:23:46 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:23:46 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:23:46 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:23:46 user nova-compute[74980]:       <nova:owner>
Nov 02 17:23:46 user nova-compute[74980]:         <nova:user uuid="2213678ccb5047c5a679917c61a1bc69">tempest-ServerStableDeviceRescueTest-101974758-project-member</nova:user>
Nov 02 17:23:46 user nova-compute[74980]:         <nova:project uuid="0fdd7d89a7e24ebab57bc95cc888fdf1">tempest-ServerStableDeviceRescueTest-101974758</nova:project>
Nov 02 17:23:46 user nova-compute[74980]:       </nova:owner>
Nov 02 17:23:46 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:23:46 user nova-compute[74980]:       <nova:ports>
Nov 02 17:23:46 user nova-compute[74980]:         <nova:port uuid="fe9b054a-bbfc-457c-86bf-dede3bb2c8dc">
Nov 02 17:23:46 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 17:23:46 user nova-compute[74980]:         </nova:port>
Nov 02 17:23:46 user nova-compute[74980]:       </nova:ports>
Nov 02 17:23:46 user nova-compute[74980]:     </nova:instance>
Nov 02 17:23:46 user nova-compute[74980]:   </metadata>
Nov 02 17:23:46 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:23:46 user nova-compute[74980]:     <system>
Nov 02 17:23:46 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:23:46 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:23:46 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:23:46 user nova-compute[74980]:       <entry name="serial">08309ef4-cf53-47b0-8960-01aba8903030</entry>
Nov 02 17:23:46 user nova-compute[74980]:       <entry name="uuid">08309ef4-cf53-47b0-8960-01aba8903030</entry>
Nov 02 17:23:46 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:23:46 user nova-compute[74980]:     </system>
Nov 02 17:23:46 user nova-compute[74980]:   </sysinfo>
Nov 02 17:23:46 user nova-compute[74980]:   <os>
Nov 02 17:23:46 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:23:46 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:23:46 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:23:46 user nova-compute[74980]:   </os>
Nov 02 17:23:46 user nova-compute[74980]:   <features>
Nov 02 17:23:46 user nova-compute[74980]:     <acpi/>
Nov 02 17:23:46 user nova-compute[74980]:     <apic/>
Nov 02 17:23:46 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:23:46 user nova-compute[74980]:   </features>
Nov 02 17:23:46 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:23:46 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:23:46 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:23:46 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:23:46 user nova-compute[74980]:   </clock>
Nov 02 17:23:46 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:23:46 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:23:46 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:23:46 user nova-compute[74980]:   </cpu>
Nov 02 17:23:46 user nova-compute[74980]:   <devices>
Nov 02 17:23:46 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:23:46 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:23:46 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk"/>
Nov 02 17:23:46 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:23:46 user nova-compute[74980]:     </disk>
Nov 02 17:23:46 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:23:46 user nova-compute[74980]:       <mac address="fa:16:3e:c6:19:cf"/>
Nov 02 17:23:46 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:23:46 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:23:46 user nova-compute[74980]:       <target dev="tapfe9b054a-bb"/>
Nov 02 17:23:46 user nova-compute[74980]:     </interface>
Nov 02 17:23:46 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:23:46 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/console.log" append="off"/>
Nov 02 17:23:46 user nova-compute[74980]:     </serial>
Nov 02 17:23:46 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:23:46 user nova-compute[74980]:     <video>
Nov 02 17:23:46 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:23:46 user nova-compute[74980]:     </video>
Nov 02 17:23:46 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:23:46 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:23:46 user nova-compute[74980]:     </rng>
Nov 02 17:23:46 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:23:46 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:23:46 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:23:46 user nova-compute[74980]:     </memballoon>
Nov 02 17:23:46 user nova-compute[74980]:   </devices>
Nov 02 17:23:46 user nova-compute[74980]: </domain>
Nov 02 17:23:46 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:23:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1380814959',display_name='tempest-ServerStableDeviceRescueTest-server-1380814959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1380814959',id=19,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbrZDVDF9WyskaiAHzOeYQPSBGf4ej2VA+399a6ly1594uUr7g7/LcK5OWhmyhR11uj6Xtpiag80/HJmX16EEfFuhlDjN9qlotT6SxweN3ezOBWJHHLcUs9aH5CmfDGyw==',key_name='tempest-keypair-763038001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fdd7d89a7e24ebab57bc95cc888fdf1',ramdisk_id='',reservation_id='r-nodh1jeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-101974758',owner_user_name='tempest-ServerStableDeviceRescueTest-101974758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2213678ccb5047c5a679917c61a1bc69',uuid=08309ef4-cf53-47b0-8960-01aba8903030,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Converting VIF {"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:19:cf,bridge_name='br-int',has_traffic_filtering=True,id=fe9b054a-bbfc-457c-86bf-dede3bb2c8dc,network=Network(2ee0006d-76b0-42e6-b47f-ab9804e4c021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9b054a-bb') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG os_vif [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:19:cf,bridge_name='br-int',has_traffic_filtering=True,id=fe9b054a-bbfc-457c-86bf-dede3bb2c8dc,network=Network(2ee0006d-76b0-42e6-b47f-ab9804e4c021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9b054a-bb') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4710b01d-ad66-5fa7-b9fa-0b530556bade', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe9b054a-bb, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe9b054a-bb, col_values=(('qos', UUID('b337c90e-8332-4e72-a1cd-f0985047af8f')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe9b054a-bb, col_values=(('external_ids', {'iface-id': 'fe9b054a-bbfc-457c-86bf-dede3bb2c8dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:19:cf', 'vm-uuid': '08309ef4-cf53-47b0-8960-01aba8903030'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:46 user nova-compute[74980]: INFO os_vif [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:19:cf,bridge_name='br-int',has_traffic_filtering=True,id=fe9b054a-bbfc-457c-86bf-dede3bb2c8dc,network=Network(2ee0006d-76b0-42e6-b47f-ab9804e4c021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9b054a-bb')
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] No VIF found with MAC fa:16:3e:c6:19:cf, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:23:46 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Instance destroyed successfully.
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1941433251',display_name='tempest-ServerActionsTestOtherA-server-65006197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1941433251',id=14,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/deb8PVkUiwTPZyCApz0Xe3J3eB/fIB0znwI8KF8qFCnRXvv+DwW74/YEGmM9BEGg6vomJjKMtQr16Ao4g8wl5z8W+UC6f7SOilkG+sjnacG9QOoRZHmSkFfpcffyx1g==',key_name='tempest-keypair-703289978',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:21:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7bb10da584734aedb3d08879a4ffc2b2',ramdisk_id='',reservation_id='r-jetzfw31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-50427258',owner_user_name='tempest-ServerActionsTestOtherA-50427258-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e61d486aa0bf4b1fb4332aabfa5dafd7',uuid=1620c8eb-067c-4156-b927-2f64eac9e340,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converting VIF {"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:60:a9,bridge_name='br-int',has_traffic_filtering=True,id=a6485d81-59e2-4d5e-a060-fec023852f67,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6485d81-59') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG os_vif [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:60:a9,bridge_name='br-int',has_traffic_filtering=True,id=a6485d81-59e2-4d5e-a060-fec023852f67,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6485d81-59') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6485d81-59, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b73ae320-512c-49d4-bd1d-4621b0d4446a) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:46 user nova-compute[74980]: INFO os_vif [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:60:a9,bridge_name='br-int',has_traffic_filtering=True,id=a6485d81-59e2-4d5e-a060-fec023852f67,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6485d81-59')
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqObNJxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:23:46 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 17:23:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[7551bdfb-0494-4e94-a96a-d1a51f2dbdcc]: Unexpected error while running command.
Nov 02 17:23:46 user nova-compute[74980]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 02 17:23:46 user nova-compute[74980]: Exit code: 21
Nov 02 17:23:46 user nova-compute[74980]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 02 17:23:46 user nova-compute[74980]: Stderr: '' {{(pid=86001) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 02 17:23:46 user nova-compute[74980]: Traceback (most recent call last):
Nov 02 17:23:46 user nova-compute[74980]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 02 17:23:46 user nova-compute[74980]:     ret = func(*f_args, **f_kwargs)
Nov 02 17:23:46 user nova-compute[74980]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 02 17:23:46 user nova-compute[74980]:     return func(*args, **kwargs)
Nov 02 17:23:46 user nova-compute[74980]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 02 17:23:46 user nova-compute[74980]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 02 17:23:46 user nova-compute[74980]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 02 17:23:46 user nova-compute[74980]:     return putils.execute(on_execute=on_execute,
Nov 02 17:23:46 user nova-compute[74980]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 02 17:23:46 user nova-compute[74980]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 02 17:23:46 user nova-compute[74980]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 02 17:23:46 user nova-compute[74980]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 02 17:23:46 user nova-compute[74980]: Exit code: 21
Nov 02 17:23:46 user nova-compute[74980]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 02 17:23:46 user nova-compute[74980]: Stderr: ''
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7551bdfb-0494-4e94-a96a-d1a51f2dbdcc]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 02 17:23:46 user nova-compute[74980]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 02 17:23:46 user nova-compute[74980]: Exit code: 21
Nov 02 17:23:46 user nova-compute[74980]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 02 17:23:46 user nova-compute[74980]: Stderr: ''
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi     self.driver.rebuild(**kwargs)
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi     raise NotImplementedError()
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi NotImplementedError
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi 
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi During handling of the above exception, another exception occurred:
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi 
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 02 17:23:46 user nova-compute[74980]: ERROR os_brick.initiator.connectors.iscsi 
Nov 02 17:23:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74980) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.046s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] <== disconnect_volume: return (50ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:23:46 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Deleting instance files /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340_del
Nov 02 17:23:46 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Deletion of /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340_del complete
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.network.neutron [req-72db3406-d751-4b3b-b4b8-3e0b3f4c46ed req-f36fdb84-3db9-4c29-b68d-b0a777dcbfbb service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Updated VIF entry in instance network info cache for port fe9b054a-bbfc-457c-86bf-dede3bb2c8dc. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.network.neutron [req-72db3406-d751-4b3b-b4b8-3e0b3f4c46ed req-f36fdb84-3db9-4c29-b68d-b0a777dcbfbb service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Updating instance_info_cache with network_info: [{"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-72db3406-d751-4b3b-b4b8-3e0b3f4c46ed req-f36fdb84-3db9-4c29-b68d-b0a777dcbfbb service nova] Releasing lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:46 user nova-compute[74980]: INFO nova.compute.manager [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Terminating instance
Nov 02 17:23:46 user nova-compute[74980]: DEBUG nova.compute.manager [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:23:47 user nova-compute[74980]: INFO nova.virt.block_device [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Booting with volume df8cce4d-4862-4318-ac83-25951d18b8f7 at /dev/vdb
Nov 02 17:23:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG os_brick.utils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e92333-74bd-4d1d-bdaa-f2061f28ee85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe1d852-66b3-4926-9acd-c942e520ef12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4f189c-ac23-4727-9d48-d4ec00ac94da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63f357b-b1b5-4a31-9ca0-d4f667610a9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-c73b0915-df63-4056-88b8-916406c4beb8 req-2f391968-0ba8-4579-8c20-79fb02f6a568 service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Received event network-vif-unplugged-7dcf262e-6a64-49f5-a219-26c869fe1d6f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c73b0915-df63-4056-88b8-916406c4beb8 req-2f391968-0ba8-4579-8c20-79fb02f6a568 service nova] Acquiring lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c73b0915-df63-4056-88b8-916406c4beb8 req-2f391968-0ba8-4579-8c20-79fb02f6a568 service nova] Lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c73b0915-df63-4056-88b8-916406c4beb8 req-2f391968-0ba8-4579-8c20-79fb02f6a568 service nova] Lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-c73b0915-df63-4056-88b8-916406c4beb8 req-2f391968-0ba8-4579-8c20-79fb02f6a568 service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] No waiting events found dispatching network-vif-unplugged-7dcf262e-6a64-49f5-a219-26c869fe1d6f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-c73b0915-df63-4056-88b8-916406c4beb8 req-2f391968-0ba8-4579-8c20-79fb02f6a568 service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Received event network-vif-unplugged-7dcf262e-6a64-49f5-a219-26c869fe1d6f for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:23:47 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:23:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d9aa0c-9abe-4ae9-a8b7-a51312761b89]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG os_brick.utils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Updating existing volume attachment record: d83716b1-2859-46dc-a17b-29bebf98fa96 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:48 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Instance destroyed successfully.
Nov 02 17:23:48 user nova-compute[74980]: DEBUG nova.objects.instance [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lazy-loading 'resources' on Instance uuid 854dd67d-7e05-47ad-b60a-23b9673bb8cd {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1161190547',display_name='tempest-VolumesAdminNegativeTest-server-1161190547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1161190547',id=16,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:21:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77c80ea4c5594618a1eb984162ab9a88',ramdisk_id='',reservation_id='r-yt7yimg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1454371770',owner_user_name='tempest-VolumesAdminNegativeTest-1454371770-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:21:45Z,user_data=None,user_id='fdf10ea963dd41a0b41493d5c9dd8d4a',uuid=854dd67d-7e05-47ad-b60a-23b9673bb8cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "address": "fa:16:3e:3e:90:82", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dcf262e-6a", "ovs_interfaceid": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Converting VIF {"id": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "address": "fa:16:3e:3e:90:82", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dcf262e-6a", "ovs_interfaceid": "7dcf262e-6a64-49f5-a219-26c869fe1d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:90:82,bridge_name='br-int',has_traffic_filtering=True,id=7dcf262e-6a64-49f5-a219-26c869fe1d6f,network=Network(d2d80d29-bc80-47d0-b989-112114a8523e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dcf262e-6a') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG os_vif [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:90:82,bridge_name='br-int',has_traffic_filtering=True,id=7dcf262e-6a64-49f5-a219-26c869fe1d6f,network=Network(d2d80d29-bc80-47d0-b989-112114a8523e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dcf262e-6a') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7dcf262e-6a, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fbe9499-380f-422e-abc9-8172e0af6eeb) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:48 user nova-compute[74980]: INFO os_vif [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:90:82,bridge_name='br-int',has_traffic_filtering=True,id=7dcf262e-6a64-49f5-a219-26c869fe1d6f,network=Network(d2d80d29-bc80-47d0-b989-112114a8523e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dcf262e-6a')
Nov 02 17:23:48 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Deleting instance files /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd_del
Nov 02 17:23:48 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Deletion of /opt/stack/data/nova/instances/854dd67d-7e05-47ad-b60a-23b9673bb8cd_del complete
Nov 02 17:23:48 user nova-compute[74980]: INFO nova.compute.manager [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 02 17:23:48 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-9b217fcd-7ac2-4546-b119-122f59d6c34b req-a8f88724-81e8-4681-ae91-f4191cd45fa1 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9b217fcd-7ac2-4546-b119-122f59d6c34b req-a8f88724-81e8-4681-ae91-f4191cd45fa1 service nova] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9b217fcd-7ac2-4546-b119-122f59d6c34b req-a8f88724-81e8-4681-ae91-f4191cd45fa1 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9b217fcd-7ac2-4546-b119-122f59d6c34b req-a8f88724-81e8-4681-ae91-f4191cd45fa1 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-9b217fcd-7ac2-4546-b119-122f59d6c34b req-a8f88724-81e8-4681-ae91-f4191cd45fa1 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] No waiting events found dispatching network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:49 user nova-compute[74980]: WARNING nova.compute.manager [req-9b217fcd-7ac2-4546-b119-122f59d6c34b req-a8f88724-81e8-4681-ae91-f4191cd45fa1 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received unexpected event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc for instance with vm_state building and task_state spawning.
Nov 02 17:23:49 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:23:49 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Took 0.88 seconds to deallocate network for instance.
Nov 02 17:23:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-1987b814-2a8f-40a5-97c2-cd4c106a02f9 req-86f47732-8bce-4c43-be0c-153c9ad1c9bd service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Received event network-vif-plugged-7dcf262e-6a64-49f5-a219-26c869fe1d6f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1987b814-2a8f-40a5-97c2-cd4c106a02f9 req-86f47732-8bce-4c43-be0c-153c9ad1c9bd service nova] Acquiring lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1987b814-2a8f-40a5-97c2-cd4c106a02f9 req-86f47732-8bce-4c43-be0c-153c9ad1c9bd service nova] Lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1987b814-2a8f-40a5-97c2-cd4c106a02f9 req-86f47732-8bce-4c43-be0c-153c9ad1c9bd service nova] Lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-1987b814-2a8f-40a5-97c2-cd4c106a02f9 req-86f47732-8bce-4c43-be0c-153c9ad1c9bd service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] No waiting events found dispatching network-vif-plugged-7dcf262e-6a64-49f5-a219-26c869fe1d6f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:49 user nova-compute[74980]: WARNING nova.compute.manager [req-1987b814-2a8f-40a5-97c2-cd4c106a02f9 req-86f47732-8bce-4c43-be0c-153c9ad1c9bd service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Received unexpected event network-vif-plugged-7dcf262e-6a64-49f5-a219-26c869fe1d6f for instance with vm_state active and task_state deleting.
Nov 02 17:23:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:49 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:23:49 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:23:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:50 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Deleted allocations for instance 854dd67d-7e05-47ad-b60a-23b9673bb8cd
Nov 02 17:23:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bf7bc8c6-63b9-4cbc-b41c-1ef328755215 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "854dd67d-7e05-47ad-b60a-23b9673bb8cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.205s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-6eb103e0-dde2-4820-a4b8-8482d9222c94 req-22b7c65f-cbbf-4055-a786-631fa260e0d3 service nova] [instance: 854dd67d-7e05-47ad-b60a-23b9673bb8cd] Received event network-vif-deleted-7dcf262e-6a64-49f5-a219-26c869fe1d6f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-6eb103e0-dde2-4820-a4b8-8482d9222c94 req-22b7c65f-cbbf-4055-a786-631fa260e0d3 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:23:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6eb103e0-dde2-4820-a4b8-8482d9222c94 req-22b7c65f-cbbf-4055-a786-631fa260e0d3 service nova] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6eb103e0-dde2-4820-a4b8-8482d9222c94 req-22b7c65f-cbbf-4055-a786-631fa260e0d3 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6eb103e0-dde2-4820-a4b8-8482d9222c94 req-22b7c65f-cbbf-4055-a786-631fa260e0d3 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-6eb103e0-dde2-4820-a4b8-8482d9222c94 req-22b7c65f-cbbf-4055-a786-631fa260e0d3 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] No waiting events found dispatching network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:23:51 user nova-compute[74980]: WARNING nova.compute.manager [req-6eb103e0-dde2-4820-a4b8-8482d9222c94 req-22b7c65f-cbbf-4055-a786-631fa260e0d3 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received unexpected event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc for instance with vm_state building and task_state spawning.
Nov 02 17:23:51 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:23:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:23:51 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Instance spawned successfully.
Nov 02 17:23:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:23:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:23:51 user nova-compute[74980]: INFO nova.compute.manager [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Took 6.94 seconds to spawn the instance on the hypervisor.
Nov 02 17:23:51 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:23:51 user nova-compute[74980]: INFO nova.compute.manager [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Took 7.98 seconds to build instance.
Nov 02 17:23:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6c3c18c7-15ae-4ffd-bb24-3d162c5f5d83 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "08309ef4-cf53-47b0-8960-01aba8903030" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.110s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:23:55 user nova-compute[74980]: WARNING nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
Nov 02 17:23:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid 4e6bfb81-f01c-47e6-b771-7c2b34587623 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid 1154d1f9-80b8-405b-8fd8-c10bb39c507f {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid f0eb2644-f721-4a49-834d-16c43ad6d5c2 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid 92537376-b06d-4d0f-8ed4-1bc120d080fa {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid 08309ef4-cf53-47b0-8960-01aba8903030 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid 1620c8eb-067c-4156-b927-2f64eac9e340 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "4e6bfb81-f01c-47e6-b771-7c2b34587623" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "08309ef4-cf53-47b0-8960-01aba8903030" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "1620c8eb-067c-4156-b927-2f64eac9e340" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "1620c8eb-067c-4156-b927-2f64eac9e340" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:23:55 user nova-compute[74980]: INFO nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "1620c8eb-067c-4156-b927-2f64eac9e340" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "08309ef4-cf53-47b0-8960-01aba8903030" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:23:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:23:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:24:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:01 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:24:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:24:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:24:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:04 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:24:04 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:24:04 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:24:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:24:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:24:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:05 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:24:05 user nova-compute[74980]: INFO nova.compute.claims [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Claim successful on node user
Nov 02 17:24:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.642s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:24:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:24:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG nova.policy [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a979e164900348beaab104704c92b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889d98476584bb1b18080bfa0664810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:24:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Creating image(s)
Nov 02 17:24:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "/opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "/opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "/opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.217s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.235s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk 1073741824" returned: 0 in 0.058s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Successfully created port: 8f8e5361-7ac7-4f39-9b66-e73a08417745 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.507s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:07 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:24:07 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:24:07 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=7849MB free_disk=25.467327117919922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Cannot resize image /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Ensure instance console log exists: /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 4e6bfb81-f01c-47e6-b771-7c2b34587623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1154d1f9-80b8-405b-8fd8-c10bb39c507f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1620c8eb-067c-4156-b927-2f64eac9e340 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance f0eb2644-f721-4a49-834d-16c43ad6d5c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 92537376-b06d-4d0f-8ed4-1bc120d080fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 08309ef4-cf53-47b0-8960-01aba8903030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a89a8f0a-c299-44cb-9fce-8fe5b883f4a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Successfully updated port: 8f8e5361-7ac7-4f39-9b66-e73a08417745 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "refresh_cache-a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquired lock "refresh_cache-a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.manager [req-6d3ff3bb-e1ab-4631-9322-d2fdc217100e req-4d28a1ac-aa70-4bdc-9f76-e480a05cd096 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Received event network-changed-8f8e5361-7ac7-4f39-9b66-e73a08417745 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.manager [req-6d3ff3bb-e1ab-4631-9322-d2fdc217100e req-4d28a1ac-aa70-4bdc-9f76-e480a05cd096 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Refreshing instance network info cache due to event network-changed-8f8e5361-7ac7-4f39-9b66-e73a08417745. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6d3ff3bb-e1ab-4631-9322-d2fdc217100e req-4d28a1ac-aa70-4bdc-9f76-e480a05cd096 service nova] Acquiring lock "refresh_cache-a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Updating instance_info_cache with network_info: [{"id": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "address": "fa:16:3e:2c:ce:eb", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8e5361-7a", "ovs_interfaceid": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Releasing lock "refresh_cache-a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Instance network_info: |[{"id": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "address": "fa:16:3e:2c:ce:eb", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8e5361-7a", "ovs_interfaceid": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6d3ff3bb-e1ab-4631-9322-d2fdc217100e req-4d28a1ac-aa70-4bdc-9f76-e480a05cd096 service nova] Acquired lock "refresh_cache-a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.network.neutron [req-6d3ff3bb-e1ab-4631-9322-d2fdc217100e req-4d28a1ac-aa70-4bdc-9f76-e480a05cd096 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Refreshing network info cache for port 8f8e5361-7ac7-4f39-9b66-e73a08417745 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Start _get_guest_xml network_info=[{"id": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "address": "fa:16:3e:2c:ce:eb", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8e5361-7a", "ovs_interfaceid": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:24:08 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:24:08 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-556167717',display_name='tempest-AttachVolumeNegativeTest-server-556167717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-556167717',id=20,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/AMGvK8/JbKfEdWi3y/ERn9TP30U1d78nAi0rFQg7ZPYBD1U+Q4Twy65VnyB9ec0BP1FIkINDYvnIThDBxuEzPaXFYGg1Xg8NlnDb4hL1DZxTJLKJ+rLCy1MmWYWqIjA==',key_name='tempest-keypair-178700891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b889d98476584bb1b18080bfa0664810',ramdisk_id='',reservation_id='r-84rql0s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1956142060',owner_user_name='tempest-AttachVolumeNegativeTest-1956142060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:24:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a979e164900348beaab104704c92b722',uuid=a89a8f0a-c299-44cb-9fce-8fe5b883f4a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "address": "fa:16:3e:2c:ce:eb", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8e5361-7a", "ovs_interfaceid": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converting VIF {"id": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "address": "fa:16:3e:2c:ce:eb", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8e5361-7a", "ovs_interfaceid": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ce:eb,bridge_name='br-int',has_traffic_filtering=True,id=8f8e5361-7ac7-4f39-9b66-e73a08417745,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f8e5361-7a') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.objects.instance [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'pci_devices' on Instance uuid a89a8f0a-c299-44cb-9fce-8fe5b883f4a0 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:24:08 user nova-compute[74980]:   <uuid>a89a8f0a-c299-44cb-9fce-8fe5b883f4a0</uuid>
Nov 02 17:24:08 user nova-compute[74980]:   <name>instance-00000014</name>
Nov 02 17:24:08 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:24:08 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:24:08 user nova-compute[74980]:   <metadata>
Nov 02 17:24:08 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:24:08 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:24:08 user nova-compute[74980]:       <nova:name>tempest-AttachVolumeNegativeTest-server-556167717</nova:name>
Nov 02 17:24:08 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:24:08</nova:creationTime>
Nov 02 17:24:08 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:24:08 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:24:08 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:24:08 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:24:08 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:24:08 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:24:08 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:24:08 user nova-compute[74980]:       <nova:owner>
Nov 02 17:24:08 user nova-compute[74980]:         <nova:user uuid="a979e164900348beaab104704c92b722">tempest-AttachVolumeNegativeTest-1956142060-project-member</nova:user>
Nov 02 17:24:08 user nova-compute[74980]:         <nova:project uuid="b889d98476584bb1b18080bfa0664810">tempest-AttachVolumeNegativeTest-1956142060</nova:project>
Nov 02 17:24:08 user nova-compute[74980]:       </nova:owner>
Nov 02 17:24:08 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:24:08 user nova-compute[74980]:       <nova:ports>
Nov 02 17:24:08 user nova-compute[74980]:         <nova:port uuid="8f8e5361-7ac7-4f39-9b66-e73a08417745">
Nov 02 17:24:08 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 17:24:08 user nova-compute[74980]:         </nova:port>
Nov 02 17:24:08 user nova-compute[74980]:       </nova:ports>
Nov 02 17:24:08 user nova-compute[74980]:     </nova:instance>
Nov 02 17:24:08 user nova-compute[74980]:   </metadata>
Nov 02 17:24:08 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:24:08 user nova-compute[74980]:     <system>
Nov 02 17:24:08 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:24:08 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:24:08 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:24:08 user nova-compute[74980]:       <entry name="serial">a89a8f0a-c299-44cb-9fce-8fe5b883f4a0</entry>
Nov 02 17:24:08 user nova-compute[74980]:       <entry name="uuid">a89a8f0a-c299-44cb-9fce-8fe5b883f4a0</entry>
Nov 02 17:24:08 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:24:08 user nova-compute[74980]:     </system>
Nov 02 17:24:08 user nova-compute[74980]:   </sysinfo>
Nov 02 17:24:08 user nova-compute[74980]:   <os>
Nov 02 17:24:08 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:24:08 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:24:08 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:24:08 user nova-compute[74980]:   </os>
Nov 02 17:24:08 user nova-compute[74980]:   <features>
Nov 02 17:24:08 user nova-compute[74980]:     <acpi/>
Nov 02 17:24:08 user nova-compute[74980]:     <apic/>
Nov 02 17:24:08 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:24:08 user nova-compute[74980]:   </features>
Nov 02 17:24:08 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:24:08 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:24:08 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:24:08 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:24:08 user nova-compute[74980]:   </clock>
Nov 02 17:24:08 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:24:08 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:24:08 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:24:08 user nova-compute[74980]:   </cpu>
Nov 02 17:24:08 user nova-compute[74980]:   <devices>
Nov 02 17:24:08 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:24:08 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:24:08 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk"/>
Nov 02 17:24:08 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:24:08 user nova-compute[74980]:     </disk>
Nov 02 17:24:08 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:24:08 user nova-compute[74980]:       <mac address="fa:16:3e:2c:ce:eb"/>
Nov 02 17:24:08 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:24:08 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:24:08 user nova-compute[74980]:       <target dev="tap8f8e5361-7a"/>
Nov 02 17:24:08 user nova-compute[74980]:     </interface>
Nov 02 17:24:08 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:24:08 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/console.log" append="off"/>
Nov 02 17:24:08 user nova-compute[74980]:     </serial>
Nov 02 17:24:08 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:24:08 user nova-compute[74980]:     <video>
Nov 02 17:24:08 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:24:08 user nova-compute[74980]:     </video>
Nov 02 17:24:08 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:24:08 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:24:08 user nova-compute[74980]:     </rng>
Nov 02 17:24:08 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:24:08 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:24:08 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:24:08 user nova-compute[74980]:     </memballoon>
Nov 02 17:24:08 user nova-compute[74980]:   </devices>
Nov 02 17:24:08 user nova-compute[74980]: </domain>
Nov 02 17:24:08 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-556167717',display_name='tempest-AttachVolumeNegativeTest-server-556167717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-556167717',id=20,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/AMGvK8/JbKfEdWi3y/ERn9TP30U1d78nAi0rFQg7ZPYBD1U+Q4Twy65VnyB9ec0BP1FIkINDYvnIThDBxuEzPaXFYGg1Xg8NlnDb4hL1DZxTJLKJ+rLCy1MmWYWqIjA==',key_name='tempest-keypair-178700891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b889d98476584bb1b18080bfa0664810',ramdisk_id='',reservation_id='r-84rql0s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1956142060',owner_user_name='tempest-AttachVolumeNegativeTest-1956142060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:24:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a979e164900348beaab104704c92b722',uuid=a89a8f0a-c299-44cb-9fce-8fe5b883f4a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "address": "fa:16:3e:2c:ce:eb", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8e5361-7a", "ovs_interfaceid": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converting VIF {"id": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "address": "fa:16:3e:2c:ce:eb", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8e5361-7a", "ovs_interfaceid": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ce:eb,bridge_name='br-int',has_traffic_filtering=True,id=8f8e5361-7ac7-4f39-9b66-e73a08417745,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f8e5361-7a') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG os_vif [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ce:eb,bridge_name='br-int',has_traffic_filtering=True,id=8f8e5361-7ac7-4f39-9b66-e73a08417745,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f8e5361-7a') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17385e66-49cd-56dd-983a-2fb147df4cac', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f8e5361-7a, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f8e5361-7a, col_values=(('qos', UUID('fda102d1-2691-490f-968c-269765300239')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f8e5361-7a, col_values=(('external_ids', {'iface-id': '8f8e5361-7ac7-4f39-9b66-e73a08417745', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:ce:eb', 'vm-uuid': 'a89a8f0a-c299-44cb-9fce-8fe5b883f4a0'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:08 user nova-compute[74980]: INFO os_vif [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ce:eb,bridge_name='br-int',has_traffic_filtering=True,id=8f8e5361-7ac7-4f39-9b66-e73a08417745,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f8e5361-7a')
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:24:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No VIF found with MAC fa:16:3e:2c:ce:eb, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:24:09 user nova-compute[74980]: DEBUG nova.network.neutron [req-6d3ff3bb-e1ab-4631-9322-d2fdc217100e req-4d28a1ac-aa70-4bdc-9f76-e480a05cd096 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Updated VIF entry in instance network info cache for port 8f8e5361-7ac7-4f39-9b66-e73a08417745. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:24:09 user nova-compute[74980]: DEBUG nova.network.neutron [req-6d3ff3bb-e1ab-4631-9322-d2fdc217100e req-4d28a1ac-aa70-4bdc-9f76-e480a05cd096 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Updating instance_info_cache with network_info: [{"id": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "address": "fa:16:3e:2c:ce:eb", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8e5361-7a", "ovs_interfaceid": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:24:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6d3ff3bb-e1ab-4631-9322-d2fdc217100e req-4d28a1ac-aa70-4bdc-9f76-e480a05cd096 service nova] Releasing lock "refresh_cache-a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:24:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:09 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:24:09 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:24:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:24:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:24:09 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:24:09 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:24:09 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Creating image(s)
Nov 02 17:24:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "/opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "/opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "/opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.178s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updating instance_info_cache with network_info: [{"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.190s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk 1073741824" returned: 0 in 0.057s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.239s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.compute.manager [req-cf8a5ed7-f1c2-4577-8a88-e4b13c9b509d req-26a641d7-7778-4eae-a1b3-396aec6fd633 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Received event network-vif-plugged-8f8e5361-7ac7-4f39-9b66-e73a08417745 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-cf8a5ed7-f1c2-4577-8a88-e4b13c9b509d req-26a641d7-7778-4eae-a1b3-396aec6fd633 service nova] Acquiring lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-cf8a5ed7-f1c2-4577-8a88-e4b13c9b509d req-26a641d7-7778-4eae-a1b3-396aec6fd633 service nova] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-cf8a5ed7-f1c2-4577-8a88-e4b13c9b509d req-26a641d7-7778-4eae-a1b3-396aec6fd633 service nova] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.compute.manager [req-cf8a5ed7-f1c2-4577-8a88-e4b13c9b509d req-26a641d7-7778-4eae-a1b3-396aec6fd633 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] No waiting events found dispatching network-vif-plugged-8f8e5361-7ac7-4f39-9b66-e73a08417745 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:24:10 user nova-compute[74980]: WARNING nova.compute.manager [req-cf8a5ed7-f1c2-4577-8a88-e4b13c9b509d req-26a641d7-7778-4eae-a1b3-396aec6fd633 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Received unexpected event network-vif-plugged-8f8e5361-7ac7-4f39-9b66-e73a08417745 for instance with vm_state building and task_state spawning.
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Cannot resize image /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Ensure instance console log exists: /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Start _get_guest_xml network_info=[{"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqObNJxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1620c8eb-067c-4156-b927-2f64eac9e340', 'attached_at': '', 'detached_at': '', 'volume_id': 'df8cce4d-4862-4318-ac83-25951d18b8f7', 'serial': 'df8cce4d-4862-4318-ac83-25951d18b8f7'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'd83716b1-2859-46dc-a17b-29bebf98fa96', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:24:10 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 17:24:10 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1620c8eb-067c-4156-b927-2f64eac9e340 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqObNJxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:24:10 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 17:24:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:24:10 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 17:24:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:24:10 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[725af54b-6fe8-461f-9268-9188ab5cf6e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:24:10 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[500d5eed-1f63-4f7e-bda5-282302a34acf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7] added
Nov 02 17:24:10 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdad1ebc-d017-4d87-91db-5825ab809e63]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bec0ef-39fd-41d4-8580-602470aba6c2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:24:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqObNJxI {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqObNJxI" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fafdd1-c167-48db-a123-964df5c3ad8a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VqObNJxI'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c680650-9bba-4605-a2bb-ecabefb5d77b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7ffa8c-5ca3-4e6d-a268-af0237369018]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:24:11 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:24:11 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:24:11 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 17:24:11 user nova-compute[74980]: : NotImplementedError
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6159106e-5e33-46eb-8913-a49ae0f37018]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260]
Nov 02 17:24:11 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260] successful.
Nov 02 17:24:11 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa963a43-1311-4a27-a870-b8da04f6a05b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d756e1-f4ac-4990-a14a-3d3a4a107f61]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:24:11 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:24:11 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c443db-e592-48a3-bb0f-bca18d96d9fe]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:24:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqObNJxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23437653865326134', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437653865326134', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T17:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1941433251',display_name='tempest-ServerActionsTestOtherA-server-65006197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1941433251',id=14,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/deb8PVkUiwTPZyCApz0Xe3J3eB/fIB0znwI8KF8qFCnRXvv+DwW74/YEGmM9BEGg6vomJjKMtQr16Ao4g8wl5z8W+UC6f7SOilkG+sjnacG9QOoRZHmSkFfpcffyx1g==',key_name='tempest-keypair-703289978',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:21:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7bb10da584734aedb3d08879a4ffc2b2',ramdisk_id='',reservation_id='r-jetzfw31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-50427258',owner_user_name='tempest-ServerActionsTestOtherA-50427258-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e61d486aa0bf4b1fb4332aabfa5dafd7',uuid=1620c8eb-067c-4156-b927-2f64eac9e340,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converting VIF {"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:60:a9,bridge_name='br-int',has_traffic_filtering=True,id=a6485d81-59e2-4d5e-a060-fec023852f67,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6485d81-59') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:24:12 user nova-compute[74980]:   <uuid>1620c8eb-067c-4156-b927-2f64eac9e340</uuid>
Nov 02 17:24:12 user nova-compute[74980]:   <name>instance-0000000e</name>
Nov 02 17:24:12 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:24:12 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:24:12 user nova-compute[74980]:   <metadata>
Nov 02 17:24:12 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:24:12 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:24:12 user nova-compute[74980]:       <nova:name>tempest-ServerActionsTestOtherA-server-65006197</nova:name>
Nov 02 17:24:12 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:24:10</nova:creationTime>
Nov 02 17:24:12 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:24:12 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:24:12 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:24:12 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:24:12 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:24:12 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:24:12 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:24:12 user nova-compute[74980]:       <nova:owner>
Nov 02 17:24:12 user nova-compute[74980]:         <nova:user uuid="e61d486aa0bf4b1fb4332aabfa5dafd7">tempest-ServerActionsTestOtherA-50427258-project-member</nova:user>
Nov 02 17:24:12 user nova-compute[74980]:         <nova:project uuid="7bb10da584734aedb3d08879a4ffc2b2">tempest-ServerActionsTestOtherA-50427258</nova:project>
Nov 02 17:24:12 user nova-compute[74980]:       </nova:owner>
Nov 02 17:24:12 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:24:12 user nova-compute[74980]:       <nova:ports>
Nov 02 17:24:12 user nova-compute[74980]:         <nova:port uuid="a6485d81-59e2-4d5e-a060-fec023852f67">
Nov 02 17:24:12 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 17:24:12 user nova-compute[74980]:         </nova:port>
Nov 02 17:24:12 user nova-compute[74980]:       </nova:ports>
Nov 02 17:24:12 user nova-compute[74980]:     </nova:instance>
Nov 02 17:24:12 user nova-compute[74980]:   </metadata>
Nov 02 17:24:12 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:24:12 user nova-compute[74980]:     <system>
Nov 02 17:24:12 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:24:12 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:24:12 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:24:12 user nova-compute[74980]:       <entry name="serial">1620c8eb-067c-4156-b927-2f64eac9e340</entry>
Nov 02 17:24:12 user nova-compute[74980]:       <entry name="uuid">1620c8eb-067c-4156-b927-2f64eac9e340</entry>
Nov 02 17:24:12 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:24:12 user nova-compute[74980]:     </system>
Nov 02 17:24:12 user nova-compute[74980]:   </sysinfo>
Nov 02 17:24:12 user nova-compute[74980]:   <os>
Nov 02 17:24:12 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:24:12 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:24:12 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:24:12 user nova-compute[74980]:   </os>
Nov 02 17:24:12 user nova-compute[74980]:   <features>
Nov 02 17:24:12 user nova-compute[74980]:     <acpi/>
Nov 02 17:24:12 user nova-compute[74980]:     <apic/>
Nov 02 17:24:12 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:24:12 user nova-compute[74980]:   </features>
Nov 02 17:24:12 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:24:12 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:24:12 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:24:12 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:24:12 user nova-compute[74980]:   </clock>
Nov 02 17:24:12 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:24:12 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:24:12 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:24:12 user nova-compute[74980]:   </cpu>
Nov 02 17:24:12 user nova-compute[74980]:   <devices>
Nov 02 17:24:12 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:24:12 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:24:12 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk"/>
Nov 02 17:24:12 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:24:12 user nova-compute[74980]:     </disk>
Nov 02 17:24:12 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:24:12 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:24:12 user nova-compute[74980]:       <source dev="/dev/sdb"/>
Nov 02 17:24:12 user nova-compute[74980]:       <target dev="vdb" bus="virtio"/>
Nov 02 17:24:12 user nova-compute[74980]:       <serial>df8cce4d-4862-4318-ac83-25951d18b8f7</serial>
Nov 02 17:24:12 user nova-compute[74980]:     </disk>
Nov 02 17:24:12 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:24:12 user nova-compute[74980]:       <mac address="fa:16:3e:2a:60:a9"/>
Nov 02 17:24:12 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:24:12 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:24:12 user nova-compute[74980]:       <target dev="tapa6485d81-59"/>
Nov 02 17:24:12 user nova-compute[74980]:     </interface>
Nov 02 17:24:12 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:24:12 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/console.log" append="off"/>
Nov 02 17:24:12 user nova-compute[74980]:     </serial>
Nov 02 17:24:12 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:24:12 user nova-compute[74980]:     <video>
Nov 02 17:24:12 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:24:12 user nova-compute[74980]:     </video>
Nov 02 17:24:12 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:24:12 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:24:12 user nova-compute[74980]:     </rng>
Nov 02 17:24:12 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:24:12 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:24:12 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:24:12 user nova-compute[74980]:     </memballoon>
Nov 02 17:24:12 user nova-compute[74980]:   </devices>
Nov 02 17:24:12 user nova-compute[74980]: </domain>
Nov 02 17:24:12 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T17:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1941433251',display_name='tempest-ServerActionsTestOtherA-server-65006197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1941433251',id=14,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/deb8PVkUiwTPZyCApz0Xe3J3eB/fIB0znwI8KF8qFCnRXvv+DwW74/YEGmM9BEGg6vomJjKMtQr16Ao4g8wl5z8W+UC6f7SOilkG+sjnacG9QOoRZHmSkFfpcffyx1g==',key_name='tempest-keypair-703289978',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:21:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7bb10da584734aedb3d08879a4ffc2b2',ramdisk_id='',reservation_id='r-jetzfw31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-50427258',owner_user_name='tempest-ServerActionsTestOtherA-50427258-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e61d486aa0bf4b1fb4332aabfa5dafd7',uuid=1620c8eb-067c-4156-b927-2f64eac9e340,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converting VIF {"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:60:a9,bridge_name='br-int',has_traffic_filtering=True,id=a6485d81-59e2-4d5e-a060-fec023852f67,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6485d81-59') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG os_vif [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:60:a9,bridge_name='br-int',has_traffic_filtering=True,id=a6485d81-59e2-4d5e-a060-fec023852f67,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6485d81-59') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36aa55ad-2322-5c34-8525-458d09db6dc6', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6485d81-59, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6485d81-59, col_values=(('qos', UUID('bda3211f-4e2f-4a8e-83d7-6b8e7c51a853')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6485d81-59, col_values=(('external_ids', {'iface-id': 'a6485d81-59e2-4d5e-a060-fec023852f67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:60:a9', 'vm-uuid': '1620c8eb-067c-4156-b927-2f64eac9e340'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:12 user nova-compute[74980]: INFO os_vif [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:60:a9,bridge_name='br-int',has_traffic_filtering=True,id=a6485d81-59e2-4d5e-a060-fec023852f67,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6485d81-59')
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] No VIF found with MAC fa:16:3e:2a:60:a9, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.compute.manager [req-88ebe84d-1d6c-4639-9a81-9e299e5c224f req-57d98549-4625-4057-b021-e9f3b73870a0 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Received event network-vif-plugged-8f8e5361-7ac7-4f39-9b66-e73a08417745 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-88ebe84d-1d6c-4639-9a81-9e299e5c224f req-57d98549-4625-4057-b021-e9f3b73870a0 service nova] Acquiring lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-88ebe84d-1d6c-4639-9a81-9e299e5c224f req-57d98549-4625-4057-b021-e9f3b73870a0 service nova] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-88ebe84d-1d6c-4639-9a81-9e299e5c224f req-57d98549-4625-4057-b021-e9f3b73870a0 service nova] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.compute.manager [req-88ebe84d-1d6c-4639-9a81-9e299e5c224f req-57d98549-4625-4057-b021-e9f3b73870a0 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] No waiting events found dispatching network-vif-plugged-8f8e5361-7ac7-4f39-9b66-e73a08417745 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:24:12 user nova-compute[74980]: WARNING nova.compute.manager [req-88ebe84d-1d6c-4639-9a81-9e299e5c224f req-57d98549-4625-4057-b021-e9f3b73870a0 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Received unexpected event network-vif-plugged-8f8e5361-7ac7-4f39-9b66-e73a08417745 for instance with vm_state building and task_state spawning.
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:24:12 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Instance spawned successfully.
Nov 02 17:24:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:24:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:24:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:24:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:24:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:24:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:24:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:24:13 user nova-compute[74980]: INFO nova.compute.manager [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Took 6.70 seconds to spawn the instance on the hypervisor.
Nov 02 17:24:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:24:13 user nova-compute[74980]: INFO nova.compute.manager [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Took 7.87 seconds to build instance.
Nov 02 17:24:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ea4df856-ca76-4512-9618-a857bb17157a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.023s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-30df68fb-dfb9-4cc8-b0cc-6495a6fdfc1d req-b60e42ce-8e42-482e-a2be-eef4f73388d5 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received event network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:24:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-30df68fb-dfb9-4cc8-b0cc-6495a6fdfc1d req-b60e42ce-8e42-482e-a2be-eef4f73388d5 service nova] Acquiring lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-30df68fb-dfb9-4cc8-b0cc-6495a6fdfc1d req-b60e42ce-8e42-482e-a2be-eef4f73388d5 service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-30df68fb-dfb9-4cc8-b0cc-6495a6fdfc1d req-b60e42ce-8e42-482e-a2be-eef4f73388d5 service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-30df68fb-dfb9-4cc8-b0cc-6495a6fdfc1d req-b60e42ce-8e42-482e-a2be-eef4f73388d5 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] No waiting events found dispatching network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:24:14 user nova-compute[74980]: WARNING nova.compute.manager [req-30df68fb-dfb9-4cc8-b0cc-6495a6fdfc1d req-b60e42ce-8e42-482e-a2be-eef4f73388d5 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received unexpected event network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 for instance with vm_state active and task_state rebuild_spawning.
Nov 02 17:24:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-6035de99-75c6-4757-9bf8-6fd61cf18034 req-3b56ee35-4cc2-42c9-b768-6a52f09318f7 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received event network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6035de99-75c6-4757-9bf8-6fd61cf18034 req-3b56ee35-4cc2-42c9-b768-6a52f09318f7 service nova] Acquiring lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6035de99-75c6-4757-9bf8-6fd61cf18034 req-3b56ee35-4cc2-42c9-b768-6a52f09318f7 service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6035de99-75c6-4757-9bf8-6fd61cf18034 req-3b56ee35-4cc2-42c9-b768-6a52f09318f7 service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-6035de99-75c6-4757-9bf8-6fd61cf18034 req-3b56ee35-4cc2-42c9-b768-6a52f09318f7 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] No waiting events found dispatching network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:24:16 user nova-compute[74980]: WARNING nova.compute.manager [req-6035de99-75c6-4757-9bf8-6fd61cf18034 req-3b56ee35-4cc2-42c9-b768-6a52f09318f7 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received unexpected event network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 for instance with vm_state active and task_state rebuild_spawning.
Nov 02 17:24:16 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:24:16 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Instance spawned successfully.
Nov 02 17:24:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74980) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 02 17:24:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b00a5370-c074-4f5f-bac7-d8527fda7efd tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.111s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:49 user nova-compute[74980]: INFO nova.compute.manager [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Terminating instance
Nov 02 17:24:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-c99ad546-2dff-4e76-9c0e-f7c12c741c95 req-90f45ec0-ffe9-430c-8fc6-c4f50d45c1ab service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Received event network-vif-unplugged-b915b940-4c54-4954-9996-938c74f1d50f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c99ad546-2dff-4e76-9c0e-f7c12c741c95 req-90f45ec0-ffe9-430c-8fc6-c4f50d45c1ab service nova] Acquiring lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c99ad546-2dff-4e76-9c0e-f7c12c741c95 req-90f45ec0-ffe9-430c-8fc6-c4f50d45c1ab service nova] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c99ad546-2dff-4e76-9c0e-f7c12c741c95 req-90f45ec0-ffe9-430c-8fc6-c4f50d45c1ab service nova] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-c99ad546-2dff-4e76-9c0e-f7c12c741c95 req-90f45ec0-ffe9-430c-8fc6-c4f50d45c1ab service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] No waiting events found dispatching network-vif-unplugged-b915b940-4c54-4954-9996-938c74f1d50f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:24:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-c99ad546-2dff-4e76-9c0e-f7c12c741c95 req-90f45ec0-ffe9-430c-8fc6-c4f50d45c1ab service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Received event network-vif-unplugged-b915b940-4c54-4954-9996-938c74f1d50f for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:24:50 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Instance destroyed successfully.
Nov 02 17:24:50 user nova-compute[74980]: DEBUG nova.objects.instance [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lazy-loading 'resources' on Instance uuid 1154d1f9-80b8-405b-8fd8-c10bb39c507f {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:24:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1187757527',display_name='tempest-VolumesAdminNegativeTest-server-1187757527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1187757527',id=5,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmuMDLeFBUg+z1XLKM4p7PaLhvt7TypfLAI0nsRFStncW8EkIuRKk3lRED0kkqVIrKDPfVMci5HlLzkxtS2E6b/eAa1RCrxQ9bwqNOofjD2zkCIhOe6SlD5sgrgK8QZxA==',key_name='tempest-keypair-676059616',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:17:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77c80ea4c5594618a1eb984162ab9a88',ramdisk_id='',reservation_id='r-vwn829ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1454371770',owner_user_name='tempest-VolumesAdminNegativeTest-1454371770-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdf10ea963dd41a0b41493d5c9dd8d4a',uuid=1154d1f9-80b8-405b-8fd8-c10bb39c507f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b915b940-4c54-4954-9996-938c74f1d50f", "address": "fa:16:3e:5d:ba:b9", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb915b940-4c", "ovs_interfaceid": "b915b940-4c54-4954-9996-938c74f1d50f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:24:50 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Converting VIF {"id": "b915b940-4c54-4954-9996-938c74f1d50f", "address": "fa:16:3e:5d:ba:b9", "network": {"id": "d2d80d29-bc80-47d0-b989-112114a8523e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-899539459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c80ea4c5594618a1eb984162ab9a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb915b940-4c", "ovs_interfaceid": "b915b940-4c54-4954-9996-938c74f1d50f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:24:50 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:ba:b9,bridge_name='br-int',has_traffic_filtering=True,id=b915b940-4c54-4954-9996-938c74f1d50f,network=Network(d2d80d29-bc80-47d0-b989-112114a8523e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb915b940-4c') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:24:50 user nova-compute[74980]: DEBUG os_vif [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:ba:b9,bridge_name='br-int',has_traffic_filtering=True,id=b915b940-4c54-4954-9996-938c74f1d50f,network=Network(d2d80d29-bc80-47d0-b989-112114a8523e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb915b940-4c') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:24:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb915b940-4c, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:24:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:24:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75ad6429-4edc-46a6-b478-01b1df4e5d00) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:24:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:24:50 user nova-compute[74980]: INFO os_vif [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:ba:b9,bridge_name='br-int',has_traffic_filtering=True,id=b915b940-4c54-4954-9996-938c74f1d50f,network=Network(d2d80d29-bc80-47d0-b989-112114a8523e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb915b940-4c')
Nov 02 17:24:50 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Deleting instance files /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f_del
Nov 02 17:24:50 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Deletion of /opt/stack/data/nova/instances/1154d1f9-80b8-405b-8fd8-c10bb39c507f_del complete
Nov 02 17:24:50 user nova-compute[74980]: INFO nova.compute.manager [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 02 17:24:50 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:24:50 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:24:50 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:24:51 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:24:51 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Took 0.91 seconds to deallocate network for instance.
Nov 02 17:24:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-5a198a57-6a85-401a-b56f-f942a333281b req-3169282c-fd7b-490a-ae6c-a675b9016703 service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Received event network-vif-deleted-b915b940-4c54-4954-9996-938c74f1d50f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:24:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:51 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:24:51 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:24:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:51 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Deleted allocations for instance 1154d1f9-80b8-405b-8fd8-c10bb39c507f
Nov 02 17:24:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0f17e763-2237-47ed-8464-6d77e886b4a6 tempest-VolumesAdminNegativeTest-1454371770 tempest-VolumesAdminNegativeTest-1454371770-project-member] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.584s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-12de7b0a-b0bc-4e51-b47d-31f897ab60df req-05ef1c14-a6da-4b8a-9da7-427115936b6a service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Received event network-vif-plugged-b915b940-4c54-4954-9996-938c74f1d50f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:24:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-12de7b0a-b0bc-4e51-b47d-31f897ab60df req-05ef1c14-a6da-4b8a-9da7-427115936b6a service nova] Acquiring lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-12de7b0a-b0bc-4e51-b47d-31f897ab60df req-05ef1c14-a6da-4b8a-9da7-427115936b6a service nova] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-12de7b0a-b0bc-4e51-b47d-31f897ab60df req-05ef1c14-a6da-4b8a-9da7-427115936b6a service nova] Lock "1154d1f9-80b8-405b-8fd8-c10bb39c507f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-12de7b0a-b0bc-4e51-b47d-31f897ab60df req-05ef1c14-a6da-4b8a-9da7-427115936b6a service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] No waiting events found dispatching network-vif-plugged-b915b940-4c54-4954-9996-938c74f1d50f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:24:51 user nova-compute[74980]: WARNING nova.compute.manager [req-12de7b0a-b0bc-4e51-b47d-31f897ab60df req-05ef1c14-a6da-4b8a-9da7-427115936b6a service nova] [instance: 1154d1f9-80b8-405b-8fd8-c10bb39c507f] Received unexpected event network-vif-plugged-b915b940-4c54-4954-9996-938c74f1d50f for instance with vm_state deleted and task_state None.
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquiring lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG nova.objects.instance [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lazy-loading 'flavor' on Instance uuid f0eb2644-f721-4a49-834d-16c43ad6d5c2 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquiring lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:24:53 user nova-compute[74980]: INFO nova.compute.manager [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Attaching volume ef93d33c-474a-41a8-9ad8-55184c3e94ba to /dev/vdb
Nov 02 17:24:53 user nova-compute[74980]: DEBUG os_brick.utils [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d594b11-e76d-40c0-89e8-d69440d84f5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3195e0-0ae5-4219-9135-2c8f0a148152]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cada5055-81d0-4686-82fa-541aa92e4d70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80d9a95-1006-42ab-a40e-299ba1707088]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-4fca5de6-bc06-4563-b9ef-6a34c60e254a req-4d85133f-4bf3-47f6-afb2-a8dd22789319 service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Received event network-changed-e48d9f29-5466-428b-b554-01882ec6484a {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-4fca5de6-bc06-4563-b9ef-6a34c60e254a req-4d85133f-4bf3-47f6-afb2-a8dd22789319 service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Refreshing instance network info cache due to event network-changed-e48d9f29-5466-428b-b554-01882ec6484a. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4fca5de6-bc06-4563-b9ef-6a34c60e254a req-4d85133f-4bf3-47f6-afb2-a8dd22789319 service nova] Acquiring lock "refresh_cache-f0eb2644-f721-4a49-834d-16c43ad6d5c2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4fca5de6-bc06-4563-b9ef-6a34c60e254a req-4d85133f-4bf3-47f6-afb2-a8dd22789319 service nova] Acquired lock "refresh_cache-f0eb2644-f721-4a49-834d-16c43ad6d5c2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG nova.network.neutron [req-4fca5de6-bc06-4563-b9ef-6a34c60e254a req-4d85133f-4bf3-47f6-afb2-a8dd22789319 service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Refreshing network info cache for port e48d9f29-5466-428b-b554-01882ec6484a {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:24:54 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:24:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4035435-cd20-4a9a-91fa-34d6e8d837a5]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG os_brick.utils [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Updating existing volume attachment record: 3ecb10a0-bad4-4613-a934-ebe3b6901caf {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG nova.network.neutron [req-4fca5de6-bc06-4563-b9ef-6a34c60e254a req-4d85133f-4bf3-47f6-afb2-a8dd22789319 service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Updated VIF entry in instance network info cache for port e48d9f29-5466-428b-b554-01882ec6484a. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG nova.network.neutron [req-4fca5de6-bc06-4563-b9ef-6a34c60e254a req-4d85133f-4bf3-47f6-afb2-a8dd22789319 service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Updating instance_info_cache with network_info: [{"id": "e48d9f29-5466-428b-b554-01882ec6484a", "address": "fa:16:3e:18:4e:03", "network": {"id": "9298cdb9-70a6-400f-8e51-cc4d62b1e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1547217393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18b5c618c10c4d94b1fc6e930e2aa22d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48d9f29-54", "ovs_interfaceid": "e48d9f29-5466-428b-b554-01882ec6484a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:24:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4fca5de6-bc06-4563-b9ef-6a34c60e254a req-4d85133f-4bf3-47f6-afb2-a8dd22789319 service nova] Releasing lock "refresh_cache-f0eb2644-f721-4a49-834d-16c43ad6d5c2" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:24:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:24:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:01 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:25:01 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:25:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:04 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:25:04 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:25:04 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:25:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:25:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:25:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:25:04 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:25:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "22b8ca59-959d-4687-bb7d-4fc7909aa852" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.003s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:25:06 user nova-compute[74980]: INFO nova.compute.manager [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Unshelving
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:06 user nova-compute[74980]: INFO nova.virt.block_device [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Booting with volume cbbeebc5-6eb4-4321-a394-86cbcd00837e at /dev/vda
Nov 02 17:25:06 user nova-compute[74980]: DEBUG os_brick.utils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc71d9f6-1d4f-4d66-9359-91aa0634bedc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[503b1ade-3824-4661-984d-0d0b52df708a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9273cf1c-5f84-44e5-8095-97d22612490f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d64e200-b55c-4d2e-9c09-4ba6e28f815c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:25:07 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:25:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7c0ceb-afcf-4c40-9d67-0ce096a72d59]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG os_brick.utils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updating existing volume attachment record: 50d0efe7-c452-4a9f-8f57-a871f71d6d56 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:08 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:25:08 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:25:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=7655MB free_disk=25.382160186767578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 4e6bfb81-f01c-47e6-b771-7c2b34587623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1620c8eb-067c-4156-b927-2f64eac9e340 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance f0eb2644-f721-4a49-834d-16c43ad6d5c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 92537376-b06d-4d0f-8ed4-1bc120d080fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 08309ef4-cf53-47b0-8960-01aba8903030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a89a8f0a-c299-44cb-9fce-8fe5b883f4a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 22b8ca59-959d-4687-bb7d-4fc7909aa852 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:25:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:25:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:25:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:25:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:25:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-1620c8eb-067c-4156-b927-2f64eac9e340" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:25:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-1620c8eb-067c-4156-b927-2f64eac9e340" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:25:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:25:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Updating instance_info_cache with network_info: [{"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:25:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-1620c8eb-067c-4156-b927-2f64eac9e340" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:25:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:25:11 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:25:11 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:25:11 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:25:11 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:25:12 user nova-compute[74980]: DEBUG nova.compute.manager [req-b0c94d3b-077a-42ca-8a43-54a6d14e3f3b req-a2c593a7-51e9-4f52-9340-0bb8abcfb049 service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Received event network-changed-c9faccea-2597-44e1-9c1e-fb360771d4f2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:25:12 user nova-compute[74980]: DEBUG nova.compute.manager [req-b0c94d3b-077a-42ca-8a43-54a6d14e3f3b req-a2c593a7-51e9-4f52-9340-0bb8abcfb049 service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Refreshing instance network info cache due to event network-changed-c9faccea-2597-44e1-9c1e-fb360771d4f2. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:25:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b0c94d3b-077a-42ca-8a43-54a6d14e3f3b req-a2c593a7-51e9-4f52-9340-0bb8abcfb049 service nova] Acquiring lock "refresh_cache-92537376-b06d-4d0f-8ed4-1bc120d080fa" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:25:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b0c94d3b-077a-42ca-8a43-54a6d14e3f3b req-a2c593a7-51e9-4f52-9340-0bb8abcfb049 service nova] Acquired lock "refresh_cache-92537376-b06d-4d0f-8ed4-1bc120d080fa" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:25:12 user nova-compute[74980]: DEBUG nova.network.neutron [req-b0c94d3b-077a-42ca-8a43-54a6d14e3f3b req-a2c593a7-51e9-4f52-9340-0bb8abcfb049 service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Refreshing network info cache for port c9faccea-2597-44e1-9c1e-fb360771d4f2 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:25:12 user nova-compute[74980]: DEBUG nova.network.neutron [req-b0c94d3b-077a-42ca-8a43-54a6d14e3f3b req-a2c593a7-51e9-4f52-9340-0bb8abcfb049 service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Updated VIF entry in instance network info cache for port c9faccea-2597-44e1-9c1e-fb360771d4f2. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:25:12 user nova-compute[74980]: DEBUG nova.network.neutron [req-b0c94d3b-077a-42ca-8a43-54a6d14e3f3b req-a2c593a7-51e9-4f52-9340-0bb8abcfb049 service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Updating instance_info_cache with network_info: [{"id": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "address": "fa:16:3e:fb:1d:72", "network": {"id": "01828aab-5bfd-42d5-a90c-b21706d46887", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1553292420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc86ed5ca134f9190da6755ca033390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9faccea-25", "ovs_interfaceid": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:25:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b0c94d3b-077a-42ca-8a43-54a6d14e3f3b req-a2c593a7-51e9-4f52-9340-0bb8abcfb049 service nova] Releasing lock "refresh_cache-92537376-b06d-4d0f-8ed4-1bc120d080fa" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG nova.objects.instance [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lazy-loading 'flavor' on Instance uuid 92537376-b06d-4d0f-8ed4-1bc120d080fa {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:25:13 user nova-compute[74980]: INFO nova.compute.manager [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Attaching volume 04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb to /dev/vdb
Nov 02 17:25:13 user nova-compute[74980]: DEBUG os_brick.utils [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6826d2-6150-4b56-a13b-52234340dfbb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[35818ee9-abfc-4f8c-b90c-a386682aff2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[85826eda-c552-47e9-8d25-bf0965790c55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cd8488-47cb-4edc-8335-6651553c17eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:25:13 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:25:13 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1209e474-f414-4ef6-9b4f-9386a0705270]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG os_brick.utils [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:25:13 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Updating existing volume attachment record: 79b9801c-dfce-403a-b5ed-5601d674cce1 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:25:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gpVzAnSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:25:15 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:25:15 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:25:15 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc76aeaf-402e-45d1-9229-a22857f536e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:25:15 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e1114f-5563-4572-b48e-5373efa18ff5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba] added
Nov 02 17:25:15 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b3ae9b-b4d9-4895-88b1-e12d5c2e9ce1]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a5f37a-0590-4b4f-a197-c055dc15d55e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gpVzAnSU {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gpVzAnSU" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35d0b97-2e79-4472-abeb-29a3f49d5bb3]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gpVzAnSU'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4727aa90-4b4b-486d-942b-2467e87bf7d1]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[113af1e9-fb98-4ce4-913c-e25e7e83aa87]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:15 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:15 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b054ecff-bde6-4fb9-974e-f32768113727]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260]
Nov 02 17:25:15 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260] successful.
Nov 02 17:25:15 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[114469cf-2b96-4b31-b04e-55d6214bf397]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb07a5e3-969a-4e84-8ff7-2feb31930559]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:15 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:15 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:15 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:15 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[54150d57-6fcf-443f-a486-bb27e87c6104]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:15 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:25:16 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:25:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gpVzAnSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:25:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:25:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26564343737396133', 'path': '/dev/sdc'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:25:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564343737396133', 'path': '/dev/sdc'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:25:16 user nova-compute[74980]: DEBUG nova.objects.instance [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lazy-loading 'flavor' on Instance uuid f0eb2644-f721-4a49-834d-16c43ad6d5c2 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:25:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:25:16 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:25:16 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:25:16 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:25:16 user nova-compute[74980]:   <serial>ef93d33c-474a-41a8-9ad8-55184c3e94ba</serial>
Nov 02 17:25:16 user nova-compute[74980]: </disk>
Nov 02 17:25:16 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:25:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:25:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:25:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] No VIF found with MAC fa:16:3e:18:4e:03, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:25:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87ea31c9-f5e3-4e2d-a262-c7c38110fbb5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.270s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Acquiring lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG os_brick.utils [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb5cba6-4388-4969-9333-1372eb76e00c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac42e0d-91cd-4e64-a082-7d1fd38857cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[097dc465-d39b-4819-a9da-7ef06156af43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[560fb0c1-35c5-47ba-b3ed-9f3395e4ea50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:25:18 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:25:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec64c68-3468-4253-9eb6-d8bacdc796f9]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:25:18 user nova-compute[74980]: DEBUG os_brick.utils [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:25:18 user nova-compute[74980]: INFO nova.compute.manager [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Swapping volume ef93d33c-474a-41a8-9ad8-55184c3e94ba for b936d1d3-199f-4620-8898-60072b93b717
Nov 02 17:25:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:25:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:25:29 user nova-compute[74980]: DEBUG nova.objects.instance [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lazy-loading 'pci_requests' on Instance uuid 22b8ca59-959d-4687-bb7d-4fc7909aa852 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:25:29 user nova-compute[74980]: DEBUG nova.objects.instance [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lazy-loading 'numa_topology' on Instance uuid 22b8ca59-959d-4687-bb7d-4fc7909aa852 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:25:29 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:25:29 user nova-compute[74980]: INFO nova.compute.claims [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Claim successful on node user
Nov 02 17:25:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:29 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:25:29 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:25:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:25:29 user nova-compute[74980]: INFO nova.network.neutron [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updating port 1d0a548b-f00a-401b-9867-c1b9a4ee8d20 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 02 17:25:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:25:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquired lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:25:30 user nova-compute[74980]: DEBUG nova.network.neutron [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:25:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-a91b1964-c508-4297-b1c6-edd090571c0c req-bcd1506f-b8c4-4a45-8d74-d7bb8b29d122 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received event network-changed-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:25:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-a91b1964-c508-4297-b1c6-edd090571c0c req-bcd1506f-b8c4-4a45-8d74-d7bb8b29d122 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Refreshing instance network info cache due to event network-changed-1d0a548b-f00a-401b-9867-c1b9a4ee8d20. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:25:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a91b1964-c508-4297-b1c6-edd090571c0c req-bcd1506f-b8c4-4a45-8d74-d7bb8b29d122 service nova] Acquiring lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.network.neutron [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updating instance_info_cache with network_info: [{"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Releasing lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:25:31 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Creating image(s)
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Ensure instance console log exists: /opt/stack/data/nova/instances/22b8ca59-959d-4687-bb7d-4fc7909aa852/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Start _get_guest_xml network_info=[{"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFxWpjSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '22b8ca59-959d-4687-bb7d-4fc7909aa852', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbbeebc5-6eb4-4321-a394-86cbcd00837e', 'serial': 'cbbeebc5-6eb4-4321-a394-86cbcd00837e'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '50d0efe7-c452-4a9f-8f57-a871f71d6d56', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a91b1964-c508-4297-b1c6-edd090571c0c req-bcd1506f-b8c4-4a45-8d74-d7bb8b29d122 service nova] Acquired lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.network.neutron [req-a91b1964-c508-4297-b1c6-edd090571c0c req-bcd1506f-b8c4-4a45-8d74-d7bb8b29d122 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Refreshing network info cache for port 1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:25:31 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:25:31 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.objects.instance [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lazy-loading 'vcpu_model' on Instance uuid 22b8ca59-959d-4687-bb7d-4fc7909aa852 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.objects.base [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Object Instance<22b8ca59-959d-4687-bb7d-4fc7909aa852> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFxWpjSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:25:31 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:25:31 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:25:31 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5904ccad-71f2-45cc-87b6-ae06b199cc4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:25:31 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a245db9-f26e-4afb-bef4-c242b9299081]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e] added
Nov 02 17:25:31 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc66bc3-ef58-4a46-88f8-f43455611d5d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b722bb-dbd1-4211-a288-b68d83997952]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFxWpjSZ {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFxWpjSZ" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5602d3e5-abe5-415f-827f-515d2242f3a8]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lFxWpjSZ'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f0db7e-60bc-40a2-ba8d-f501e06fb58a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdc7a18-e830-4e8a-b6e1-1470121cb2e6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:31 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:31 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:31 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:31 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[add3b37b-43c9-4092-9795-edcb93432989]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260]
Nov 02 17:25:31 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260] successful.
Nov 02 17:25:31 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcadcffc-ce0b-4d0d-8b86-68968c04df8e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7283b7bc-ce4b-4ed3-a13a-ec4a60bd9827]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:31 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:31 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:25:31 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:31 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:31 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:25:31 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc4eb29-e8a3-4b79-951e-7a2151e4e8ac]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFxWpjSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.network.neutron [req-a91b1964-c508-4297-b1c6-edd090571c0c req-bcd1506f-b8c4-4a45-8d74-d7bb8b29d122 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updated VIF entry in instance network info cache for port 1d0a548b-f00a-401b-9867-c1b9a4ee8d20. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG nova.network.neutron [req-a91b1964-c508-4297-b1c6-edd090571c0c req-bcd1506f-b8c4-4a45-8d74-d7bb8b29d122 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updating instance_info_cache with network_info: [{"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:25:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a91b1964-c508-4297-b1c6-edd090571c0c req-bcd1506f-b8c4-4a45-8d74-d7bb8b29d122 service nova] Releasing lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26630663736626635', 'path': '/dev/sdd'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630663736626635', 'path': '/dev/sdd'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T17:21:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1948769732',display_name='tempest-TestShelveInstance-server-1948769732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1948769732',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-713239200',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:21:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3cf3b7e1970d471d8a80d04497963276',ramdisk_id='',reservation_id='r-00qsqblb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1367401440',owner_user_name='tempest-TestShelveInstance-1367401440-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:25:07Z,user_data=None,user_id='9c5c816110044002a6753a93e13459fc',uuid=22b8ca59-959d-4687-bb7d-4fc7909aa852,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Converting VIF {"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:1c:d0,bridge_name='br-int',has_traffic_filtering=True,id=1d0a548b-f00a-401b-9867-c1b9a4ee8d20,network=Network(6009ce0d-3076-4e9a-85f6-3ca97fcd5457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0a548b-f0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG nova.objects.instance [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lazy-loading 'pci_devices' on Instance uuid 22b8ca59-959d-4687-bb7d-4fc7909aa852 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG nova.objects.base [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Object Instance<22b8ca59-959d-4687-bb7d-4fc7909aa852> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:25:32 user nova-compute[74980]:   <uuid>22b8ca59-959d-4687-bb7d-4fc7909aa852</uuid>
Nov 02 17:25:32 user nova-compute[74980]:   <name>instance-0000000f</name>
Nov 02 17:25:32 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:25:32 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:25:32 user nova-compute[74980]:   <metadata>
Nov 02 17:25:32 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:25:32 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:25:32 user nova-compute[74980]:       <nova:name>tempest-TestShelveInstance-server-1948769732</nova:name>
Nov 02 17:25:32 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:25:31</nova:creationTime>
Nov 02 17:25:32 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:25:32 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:25:32 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:25:32 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:25:32 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:25:32 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:25:32 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:25:32 user nova-compute[74980]:       <nova:owner>
Nov 02 17:25:32 user nova-compute[74980]:         <nova:user uuid="9c5c816110044002a6753a93e13459fc">tempest-TestShelveInstance-1367401440-project-member</nova:user>
Nov 02 17:25:32 user nova-compute[74980]:         <nova:project uuid="3cf3b7e1970d471d8a80d04497963276">tempest-TestShelveInstance-1367401440</nova:project>
Nov 02 17:25:32 user nova-compute[74980]:       </nova:owner>
Nov 02 17:25:32 user nova-compute[74980]:       <nova:ports>
Nov 02 17:25:32 user nova-compute[74980]:         <nova:port uuid="1d0a548b-f00a-401b-9867-c1b9a4ee8d20">
Nov 02 17:25:32 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 17:25:32 user nova-compute[74980]:         </nova:port>
Nov 02 17:25:32 user nova-compute[74980]:       </nova:ports>
Nov 02 17:25:32 user nova-compute[74980]:     </nova:instance>
Nov 02 17:25:32 user nova-compute[74980]:   </metadata>
Nov 02 17:25:32 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:25:32 user nova-compute[74980]:     <system>
Nov 02 17:25:32 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:25:32 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:25:32 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:25:32 user nova-compute[74980]:       <entry name="serial">22b8ca59-959d-4687-bb7d-4fc7909aa852</entry>
Nov 02 17:25:32 user nova-compute[74980]:       <entry name="uuid">22b8ca59-959d-4687-bb7d-4fc7909aa852</entry>
Nov 02 17:25:32 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:25:32 user nova-compute[74980]:     </system>
Nov 02 17:25:32 user nova-compute[74980]:   </sysinfo>
Nov 02 17:25:32 user nova-compute[74980]:   <os>
Nov 02 17:25:32 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:25:32 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:25:32 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:25:32 user nova-compute[74980]:   </os>
Nov 02 17:25:32 user nova-compute[74980]:   <features>
Nov 02 17:25:32 user nova-compute[74980]:     <acpi/>
Nov 02 17:25:32 user nova-compute[74980]:     <apic/>
Nov 02 17:25:32 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:25:32 user nova-compute[74980]:   </features>
Nov 02 17:25:32 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:25:32 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:25:32 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:25:32 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:25:32 user nova-compute[74980]:   </clock>
Nov 02 17:25:32 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:25:32 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:25:32 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:25:32 user nova-compute[74980]:   </cpu>
Nov 02 17:25:32 user nova-compute[74980]:   <devices>
Nov 02 17:25:32 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:25:32 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:25:32 user nova-compute[74980]:       <source dev="/dev/sdd"/>
Nov 02 17:25:32 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:25:32 user nova-compute[74980]:       <serial>cbbeebc5-6eb4-4321-a394-86cbcd00837e</serial>
Nov 02 17:25:32 user nova-compute[74980]:     </disk>
Nov 02 17:25:32 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:25:32 user nova-compute[74980]:       <mac address="fa:16:3e:d8:1c:d0"/>
Nov 02 17:25:32 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:25:32 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:25:32 user nova-compute[74980]:       <target dev="tap1d0a548b-f0"/>
Nov 02 17:25:32 user nova-compute[74980]:     </interface>
Nov 02 17:25:32 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:25:32 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/22b8ca59-959d-4687-bb7d-4fc7909aa852/console.log" append="off"/>
Nov 02 17:25:32 user nova-compute[74980]:     </serial>
Nov 02 17:25:32 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:25:32 user nova-compute[74980]:     <video>
Nov 02 17:25:32 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:25:32 user nova-compute[74980]:     </video>
Nov 02 17:25:32 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:25:32 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:25:32 user nova-compute[74980]:     </rng>
Nov 02 17:25:32 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:25:32 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:25:32 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:25:32 user nova-compute[74980]:     </memballoon>
Nov 02 17:25:32 user nova-compute[74980]:   </devices>
Nov 02 17:25:32 user nova-compute[74980]: </domain>
Nov 02 17:25:32 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T17:21:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1948769732',display_name='tempest-TestShelveInstance-server-1948769732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1948769732',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-713239200',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:21:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3cf3b7e1970d471d8a80d04497963276',ramdisk_id='',reservation_id='r-00qsqblb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1367401440',owner_user_name='tempest-TestShelveInstance-1367401440-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:25:07Z,user_data=None,user_id='9c5c816110044002a6753a93e13459fc',uuid=22b8ca59-959d-4687-bb7d-4fc7909aa852,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Converting VIF {"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:1c:d0,bridge_name='br-int',has_traffic_filtering=True,id=1d0a548b-f00a-401b-9867-c1b9a4ee8d20,network=Network(6009ce0d-3076-4e9a-85f6-3ca97fcd5457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0a548b-f0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG os_vif [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:1c:d0,bridge_name='br-int',has_traffic_filtering=True,id=1d0a548b-f00a-401b-9867-c1b9a4ee8d20,network=Network(6009ce0d-3076-4e9a-85f6-3ca97fcd5457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0a548b-f0') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '867833ea-2c98-5193-b92f-50a3e385f071', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d0a548b-f0, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d0a548b-f0, col_values=(('qos', UUID('eb7652fd-45f3-455d-aaa4-f5e64f4fddd4')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d0a548b-f0, col_values=(('external_ids', {'iface-id': '1d0a548b-f00a-401b-9867-c1b9a4ee8d20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:1c:d0', 'vm-uuid': '22b8ca59-959d-4687-bb7d-4fc7909aa852'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:32 user nova-compute[74980]: INFO os_vif [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:1c:d0,bridge_name='br-int',has_traffic_filtering=True,id=1d0a548b-f00a-401b-9867-c1b9a4ee8d20,network=Network(6009ce0d-3076-4e9a-85f6-3ca97fcd5457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0a548b-f0')
Nov 02 17:25:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:25:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] No VIF found with MAC fa:16:3e:d8:1c:d0, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:25:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:34 user nova-compute[74980]: DEBUG nova.compute.manager [req-1544b336-d93c-4549-80dd-f2a7c7ffcd76 req-5f892a06-3fba-4860-9822-7799da005f4f service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received event network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:25:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1544b336-d93c-4549-80dd-f2a7c7ffcd76 req-5f892a06-3fba-4860-9822-7799da005f4f service nova] Acquiring lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:25:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1544b336-d93c-4549-80dd-f2a7c7ffcd76 req-5f892a06-3fba-4860-9822-7799da005f4f service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:25:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1544b336-d93c-4549-80dd-f2a7c7ffcd76 req-5f892a06-3fba-4860-9822-7799da005f4f service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:25:34 user nova-compute[74980]: DEBUG nova.compute.manager [req-1544b336-d93c-4549-80dd-f2a7c7ffcd76 req-5f892a06-3fba-4860-9822-7799da005f4f service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] No waiting events found dispatching network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:25:34 user nova-compute[74980]: WARNING nova.compute.manager [req-1544b336-d93c-4549-80dd-f2a7c7ffcd76 req-5f892a06-3fba-4860-9822-7799da005f4f service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received unexpected event network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 17:25:34 user nova-compute[74980]: DEBUG nova.compute.manager [req-fe517725-5722-4c01-85e9-aeb6079f335c req-6a025076-8ae1-456a-b82d-aa6b067f59ab service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-changed-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:25:34 user nova-compute[74980]: DEBUG nova.compute.manager [req-fe517725-5722-4c01-85e9-aeb6079f335c req-6a025076-8ae1-456a-b82d-aa6b067f59ab service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Refreshing instance network info cache due to event network-changed-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:25:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fe517725-5722-4c01-85e9-aeb6079f335c req-6a025076-8ae1-456a-b82d-aa6b067f59ab service nova] Acquiring lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:25:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fe517725-5722-4c01-85e9-aeb6079f335c req-6a025076-8ae1-456a-b82d-aa6b067f59ab service nova] Acquired lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:25:34 user nova-compute[74980]: DEBUG nova.network.neutron [req-fe517725-5722-4c01-85e9-aeb6079f335c req-6a025076-8ae1-456a-b82d-aa6b067f59ab service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Refreshing network info cache for port fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:25:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:35 user nova-compute[74980]: DEBUG nova.network.neutron [req-fe517725-5722-4c01-85e9-aeb6079f335c req-6a025076-8ae1-456a-b82d-aa6b067f59ab service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Updated VIF entry in instance network info cache for port fe9b054a-bbfc-457c-86bf-dede3bb2c8dc. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:25:35 user nova-compute[74980]: DEBUG nova.network.neutron [req-fe517725-5722-4c01-85e9-aeb6079f335c req-6a025076-8ae1-456a-b82d-aa6b067f59ab service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Updating instance_info_cache with network_info: [{"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:25:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fe517725-5722-4c01-85e9-aeb6079f335c req-6a025076-8ae1-456a-b82d-aa6b067f59ab service nova] Releasing lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:25:36 user nova-compute[74980]: INFO nova.compute.manager [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] instance snapshotting
Nov 02 17:25:36 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Beginning live snapshot process
Nov 02 17:25:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjNfBGSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:25:36 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:25:36 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:25:36 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a250ea-9b5d-4002-9f9c-4a9939a2a313]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:25:36 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4930df-e297-44ba-ab6e-77609e693f06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb] added
Nov 02 17:25:36 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json -f qcow2 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.104s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8d2feb-dc53-402d-80ed-416eaccd147a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf542f0-5cef-4964-8af3-2c469602ebfa]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjNfBGSm {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjNfBGSm" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1b346a-1a4b-49fb-a7f3-b3d7fc03f7ad]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kjNfBGSm'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d079e257-834b-4729-a497-504bb0ddb63a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json -f qcow2" returned: 0 in 0.214s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json -f qcow2 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d579f48-5d57-4e94-b5fe-52017facd4a4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:36 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:36 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:25:36 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:36 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:36 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:25:36 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-026f4544-3fb1-4427-815a-2006b54c4654 req-a5358100-df82-435c-a586-ff9b16cc822f service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received event network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-026f4544-3fb1-4427-815a-2006b54c4654 req-a5358100-df82-435c-a586-ff9b16cc822f service nova] Acquiring lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-026f4544-3fb1-4427-815a-2006b54c4654 req-a5358100-df82-435c-a586-ff9b16cc822f service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-026f4544-3fb1-4427-815a-2006b54c4654 req-a5358100-df82-435c-a586-ff9b16cc822f service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-026f4544-3fb1-4427-815a-2006b54c4654 req-a5358100-df82-435c-a586-ff9b16cc822f service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] No waiting events found dispatching network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:25:36 user nova-compute[74980]: WARNING nova.compute.manager [req-026f4544-3fb1-4427-815a-2006b54c4654 req-a5358100-df82-435c-a586-ff9b16cc822f service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received unexpected event network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a59e31-58d3-4c03-8335-caaa0baa7f92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb, portal: 172.16.0.220,3260]
Nov 02 17:25:36 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb, portal: 172.16.0.220,3260] successful.
Nov 02 17:25:36 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c36ec52-afe2-49b0-a075-b42592b0da95]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[04676779-8fd1-435f-9a82-58d63212ef9c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:36 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:36 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:25:36 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:25:36 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:36 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:36 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:25:36 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:25:36 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.477s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json -f qcow2" returned: 0 in 0.210s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:37 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41dcfc4-8137-40d0-a535-4ed1bb883d0b]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:37 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:25:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjNfBGSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:25:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:25:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:25:37 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Instance spawned successfully.
Nov 02 17:25:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:25:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.206s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz7a3p37j/a0115d8638794753a5dfb9ac5d18703c.delta 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3409bce4-fa20-442c-8265-4b6adaa3521d tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 30.756s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:25:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz7a3p37j/a0115d8638794753a5dfb9ac5d18703c.delta 1073741824" returned: 0 in 0.060s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:37 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 17:25:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.564s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:25:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] <== connect_volume: return (1566ms) {'type': 'block', 'scsi_wwn': '23966613562643733', 'path': '/dev/sde'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:25:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966613562643733', 'path': '/dev/sde'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:25:38 user nova-compute[74980]: DEBUG nova.objects.instance [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lazy-loading 'flavor' on Instance uuid 92537376-b06d-4d0f-8ed4-1bc120d080fa {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:25:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:25:38 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:25:38 user nova-compute[74980]:   <source dev="/dev/sde"/>
Nov 02 17:25:38 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:25:38 user nova-compute[74980]:   <serial>04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb</serial>
Nov 02 17:25:38 user nova-compute[74980]: </disk>
Nov 02 17:25:38 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:25:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:25:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:25:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:25:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] No VIF found with MAC fa:16:3e:fb:1d:72, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:25:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:25:38 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 17:25:38 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:25:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz7a3p37j/a0115d8638794753a5dfb9ac5d18703c.delta /opt/stack/data/nova/instances/snapshots/tmpz7a3p37j/a0115d8638794753a5dfb9ac5d18703c {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-20f04e20-fb21-4b47-a251-1bfd51778d5d tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.482s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:25:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz7a3p37j/a0115d8638794753a5dfb9ac5d18703c.delta /opt/stack/data/nova/instances/snapshots/tmpz7a3p37j/a0115d8638794753a5dfb9ac5d18703c" returned: 0 in 0.353s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:39 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Snapshot extracted, beginning image upload
Nov 02 17:25:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHyNdRTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0eb2644-f721-4a49-834d-16c43ad6d5c2', 'attached_at': '', 'detached_at': '', 'volume_id': 'b936d1d3-199f-4620-8898-60072b93b717', 'serial': 'b936d1d3-199f-4620-8898-60072b93b717'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gpVzAnSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f0eb2644-f721-4a49-834d-16c43ad6d5c2', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef93d33c-474a-41a8-9ad8-55184c3e94ba', 'serial'} {{(pid=74980) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHyNdRTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:25:41 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:25:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:25:41 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:25:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:25:41 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:25:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1930bab0-c104-476e-880c-d5fba0c65de6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:25:41 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a017038b-4032-4567-93c2-ace9ad200c50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717] added
Nov 02 17:25:41 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e238a9ec-4e4b-4b5c-8741-50f6c8f98206]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b53d5ab-19c9-493d-88bc-7938bdadaf08]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHyNdRTI {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHyNdRTI" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5b5a83-c56f-407f-aabe-2e6948682419]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PHyNdRTI'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fe293f-8c78-425b-8b0a-8a6770766bfc]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[52857d2b-4835-48f7-8513-bcb2af34c702]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:42 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:42 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:25:42 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:25:42 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:42 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:42 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:25:42 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:25:42 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fdfffe-fe48-4fd4-bbb6-163f0e51e61c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717, portal: 172.16.0.220,3260]
Nov 02 17:25:42 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717, portal: 172.16.0.220,3260] successful.
Nov 02 17:25:42 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e264cfd8-d168-42bc-a927-4dcee9ededd3]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c1f777-1424-4572-a663-a112194308a1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:42 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:42 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:25:42 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:25:42 user nova-compute[74980]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)
Nov 02 17:25:42 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:42 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:42 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:25:42 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:25:42 user nova-compute[74980]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)
Nov 02 17:25:42 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.068s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee550398-de08-43f1-a238-c450f082c31b]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:25:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHyNdRTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:25:42 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Snapshot image upload complete
Nov 02 17:25:42 user nova-compute[74980]: INFO nova.compute.manager [None req-1132a22e-e962-42bc-a9af-01696de57db4 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Took 6.19 seconds to snapshot the instance on the hypervisor.
Nov 02 17:25:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:25:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '23063333865333063', 'path': '/dev/sdf'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:25:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063333865333063', 'path': '/dev/sdf'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:25:43 user nova-compute[74980]: DEBUG nova.objects.instance [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lazy-loading 'flavor' on Instance uuid f0eb2644-f721-4a49-834d-16c43ad6d5c2 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:25:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:25:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:25:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG nova.objects.instance [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lazy-loading 'flavor' on Instance uuid 92537376-b06d-4d0f-8ed4-1bc120d080fa {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 141557760 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:25:44 user nova-compute[74980]: INFO nova.compute.manager [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Attaching volume 1917cac4-adc5-4a71-ad92-480a56d0d3f4 to /dev/vdc
Nov 02 17:25:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG os_brick.utils [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c063f6f6-1cd1-4600-8982-b014f18e8c49]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4c3e93-02fd-422e-93bd-1f9c28f97a49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6223573f-da67-4728-8a22-0a3f5f1d4d74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7349f7f4-de7c-43d4-9263-22224af986c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:25:44 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:25:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9315c5ad-8048-4f27-8a07-380f56d0256c]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG os_brick.utils [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Updating existing volume attachment record: d0e4afc8-cd2a-4e2a-8f4f-9a8b4f50819d {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:25:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 262144000 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:25:45 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 406847488 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:25:45 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 550502400 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:25:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 710934528 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:25:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 749731840 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:25:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 926941184 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:25:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gpVzAnSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:25:48 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9170a088-cae0-4b18-9bdc-dbaaa979c9aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:25:48 user nova-compute[74980]: No targets found.
Nov 02 17:25:48 user nova-compute[74980]: iSNS:
Nov 02 17:25:48 user nova-compute[74980]: No targets found.
Nov 02 17:25:48 user nova-compute[74980]: STATIC:
Nov 02 17:25:48 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7
Nov 02 17:25:48 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:25:48 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:25:48 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb
Nov 02 17:25:48 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:25:48 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:25:48 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e
Nov 02 17:25:48 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:25:48 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:25:48 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba
Nov 02 17:25:48 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:25:48 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:25:48 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717
Nov 02 17:25:48 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:25:48 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:25:48 user nova-compute[74980]: FIRMWARE:
Nov 02 17:25:48 user nova-compute[74980]: No targets found.
Nov 02 17:25:48 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:25:48 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:25:48 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5249a5b1-5dab-4190-8188-1bfcc57e089c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dad488-9261-43f8-99fc-98af4163428f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:48 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:48 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:25:48 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:25:48 user nova-compute[74980]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)
Nov 02 17:25:48 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:25:48 user nova-compute[74980]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:25:48 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:25:48 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:25:48 user nova-compute[74980]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)
Nov 02 17:25:48 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59c40d93f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba'): ({'sdc'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Removing single pathed devices sdc {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c66663c-904a-42a9-92cb-796127890de0]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93d7794-e691-42a6-8aa1-d25607ab64e3]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Flushing IO for device /dev/sdc {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e392e2db-49c0-4039-8933-9a0c1ee08fd4]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb54821-7579-471b-9882-33eae882d5f0]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5c5c43-ec7f-4462-98a4-63fce64afb2c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aa38e4-c10e-47c9-8b34-b019fd1845b7]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260]
Nov 02 17:25:48 user nova-compute[74980]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260] successful.
Nov 02 17:25:48 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[091615cf-f9c9-4ad3-b818-abe3a4f0d8b2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] <== disconnect_volume: return (380ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHyNdRTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'f0eb2644-f721-4a49-834d-16c43ad6d5c2', 'attached_at': '', 'detached_at': '', 'volume_id': 'b936d1d3-199f-4620-8898-60072b93b717', 'serial'} {{(pid=74980) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 02 17:25:48 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] swap_volume: removing Cinder connection for volume ef93d33c-474a-41a8-9ad8-55184c3e94ba {{(pid=74980) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 02 17:25:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] swap_volume: Updating volume ef93d33c-474a-41a8-9ad8-55184c3e94ba BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "PHyNdRTI", "auth_password": "5vy9wo72NaGUHO", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "b936d1d3-199f-4620-8898-60072b93b717"}, "status": "reserved", "instance": "f0eb2644-f721-4a49-834d-16c43ad6d5c2", "attached_at": "", "detached_at": "", "volume_id": "b936d1d3-199f-4620-8898-60072b93b717", "serial": "b936d1d3-199f-4620-8898-60072b93b717"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b936d1d3-199f-4620-8898-60072b93b717', 'no_device': None, 'attachment_id': '0a8a32fd-711a-4c4c-a9da-6c8c054c66d7'} {{(pid=74980) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 02 17:25:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8be26a74-1e54-4d52-bb9e-0caf106f4350 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 31.750s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:25:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Acquiring lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:25:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:25:50 user nova-compute[74980]: DEBUG os_brick.utils [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:25:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cfaf76-9062-4771-8bf5-156423f33f28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6518a7a-f379-4430-b0b1-6499b41a6d12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:25:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[da233c86-ba57-4296-9513-fc276c32d40c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5914379-b2a1-4f04-864e-3afa20632755]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:25:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:25:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:25:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:25:51 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:25:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfabb1d1-6cc8-4f4c-9caf-6cf393022398]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:25:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:25:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:25:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:25:51 user nova-compute[74980]: DEBUG os_brick.utils [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:25:51 user nova-compute[74980]: INFO nova.compute.manager [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Swapping volume b936d1d3-199f-4620-8898-60072b93b717 for ef93d33c-474a-41a8-9ad8-55184c3e94ba
Nov 02 17:25:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-00821ea0-9796-4504-b9ca-109fffcfcc8d req-42d5476d-9c80-42b1-98b5-975901a8aeb4 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Received event network-changed-8f8e5361-7ac7-4f39-9b66-e73a08417745 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:25:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-00821ea0-9796-4504-b9ca-109fffcfcc8d req-42d5476d-9c80-42b1-98b5-975901a8aeb4 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Refreshing instance network info cache due to event network-changed-8f8e5361-7ac7-4f39-9b66-e73a08417745. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:25:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-00821ea0-9796-4504-b9ca-109fffcfcc8d req-42d5476d-9c80-42b1-98b5-975901a8aeb4 service nova] Acquiring lock "refresh_cache-a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:25:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-00821ea0-9796-4504-b9ca-109fffcfcc8d req-42d5476d-9c80-42b1-98b5-975901a8aeb4 service nova] Acquired lock "refresh_cache-a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:25:56 user nova-compute[74980]: DEBUG nova.network.neutron [req-00821ea0-9796-4504-b9ca-109fffcfcc8d req-42d5476d-9c80-42b1-98b5-975901a8aeb4 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Refreshing network info cache for port 8f8e5361-7ac7-4f39-9b66-e73a08417745 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:25:57 user nova-compute[74980]: DEBUG nova.network.neutron [req-00821ea0-9796-4504-b9ca-109fffcfcc8d req-42d5476d-9c80-42b1-98b5-975901a8aeb4 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Updated VIF entry in instance network info cache for port 8f8e5361-7ac7-4f39-9b66-e73a08417745. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:25:57 user nova-compute[74980]: DEBUG nova.network.neutron [req-00821ea0-9796-4504-b9ca-109fffcfcc8d req-42d5476d-9c80-42b1-98b5-975901a8aeb4 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Updating instance_info_cache with network_info: [{"id": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "address": "fa:16:3e:2c:ce:eb", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8e5361-7a", "ovs_interfaceid": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:25:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-00821ea0-9796-4504-b9ca-109fffcfcc8d req-42d5476d-9c80-42b1-98b5-975901a8aeb4 service nova] Releasing lock "refresh_cache-a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:25:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:25:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:01 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:26:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Acquiring lock "07bc020d-9394-4327-9c90-9902b7256bf9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "07bc020d-9394-4327-9c90-9902b7256bf9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:01 user nova-compute[74980]: DEBUG nova.compute.manager [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:26:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:26:02 user nova-compute[74980]: INFO nova.compute.claims [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Claim successful on node user
Nov 02 17:26:02 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:26:02 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:26:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:02 user nova-compute[74980]: DEBUG nova.compute.manager [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:26:02 user nova-compute[74980]: DEBUG nova.compute.manager [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:26:02 user nova-compute[74980]: DEBUG nova.network.neutron [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:26:02 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:26:02 user nova-compute[74980]: DEBUG nova.compute.manager [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:26:02 user nova-compute[74980]: DEBUG nova.policy [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b75cd0a07a404094b74c73e9ced8f5f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caae5e1d54624270920015819e250435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:26:02 user nova-compute[74980]: DEBUG nova.compute.manager [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:26:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:26:02 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Creating image(s)
Nov 02 17:26:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Acquiring lock "/opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "/opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "/opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.211s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.225s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG nova.network.neutron [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Successfully created port: 3f505851-98d3-4b75-b946-c3ed7e4267e2 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk 1073741824" returned: 0 in 0.099s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.242s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Cannot resize image /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Ensure instance console log exists: /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.network.neutron [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Successfully updated port: 3f505851-98d3-4b75-b946-c3ed7e4267e2 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Acquiring lock "refresh_cache-07bc020d-9394-4327-9c90-9902b7256bf9" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Acquired lock "refresh_cache-07bc020d-9394-4327-9c90-9902b7256bf9" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.network.neutron [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-fc8e162e-fb5f-4de4-986e-05f6af964894 req-4dd47b72-08cd-4ccf-8028-f577624876d0 service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Received event network-changed-3f505851-98d3-4b75-b946-c3ed7e4267e2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-fc8e162e-fb5f-4de4-986e-05f6af964894 req-4dd47b72-08cd-4ccf-8028-f577624876d0 service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Refreshing instance network info cache due to event network-changed-3f505851-98d3-4b75-b946-c3ed7e4267e2. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fc8e162e-fb5f-4de4-986e-05f6af964894 req-4dd47b72-08cd-4ccf-8028-f577624876d0 service nova] Acquiring lock "refresh_cache-07bc020d-9394-4327-9c90-9902b7256bf9" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.network.neutron [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.network.neutron [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Updating instance_info_cache with network_info: [{"id": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "address": "fa:16:3e:11:c5:b4", "network": {"id": "6a7dc076-5437-429f-a011-a41212b7807f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-595587795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caae5e1d54624270920015819e250435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f505851-98", "ovs_interfaceid": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Releasing lock "refresh_cache-07bc020d-9394-4327-9c90-9902b7256bf9" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.compute.manager [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Instance network_info: |[{"id": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "address": "fa:16:3e:11:c5:b4", "network": {"id": "6a7dc076-5437-429f-a011-a41212b7807f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-595587795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caae5e1d54624270920015819e250435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f505851-98", "ovs_interfaceid": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fc8e162e-fb5f-4de4-986e-05f6af964894 req-4dd47b72-08cd-4ccf-8028-f577624876d0 service nova] Acquired lock "refresh_cache-07bc020d-9394-4327-9c90-9902b7256bf9" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.network.neutron [req-fc8e162e-fb5f-4de4-986e-05f6af964894 req-4dd47b72-08cd-4ccf-8028-f577624876d0 service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Refreshing network info cache for port 3f505851-98d3-4b75-b946-c3ed7e4267e2 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Start _get_guest_xml network_info=[{"id": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "address": "fa:16:3e:11:c5:b4", "network": {"id": "6a7dc076-5437-429f-a011-a41212b7807f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-595587795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caae5e1d54624270920015819e250435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f505851-98", "ovs_interfaceid": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:26:04 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:26:04 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:26:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1251564298',display_name='tempest-DeleteServersTestJSON-server-1251564298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1251564298',id=21,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caae5e1d54624270920015819e250435',ramdisk_id='',reservation_id='r-kdyygfq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-510258544',owner_user_name='tempest-DeleteServersTestJSON-510258544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:26:03Z,user_data=None,user_id='b75cd0a07a404094b74c73e9ced8f5f4',uuid=07bc020d-9394-4327-9c90-9902b7256bf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "address": "fa:16:3e:11:c5:b4", "network": {"id": "6a7dc076-5437-429f-a011-a41212b7807f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-595587795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caae5e1d54624270920015819e250435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f505851-98", "ovs_interfaceid": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Converting VIF {"id": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "address": "fa:16:3e:11:c5:b4", "network": {"id": "6a7dc076-5437-429f-a011-a41212b7807f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-595587795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caae5e1d54624270920015819e250435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f505851-98", "ovs_interfaceid": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=3f505851-98d3-4b75-b946-c3ed7e4267e2,network=Network(6a7dc076-5437-429f-a011-a41212b7807f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f505851-98') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.objects.instance [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lazy-loading 'pci_devices' on Instance uuid 07bc020d-9394-4327-9c90-9902b7256bf9 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:26:04 user nova-compute[74980]:   <uuid>07bc020d-9394-4327-9c90-9902b7256bf9</uuid>
Nov 02 17:26:04 user nova-compute[74980]:   <name>instance-00000015</name>
Nov 02 17:26:04 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:26:04 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:26:04 user nova-compute[74980]:   <metadata>
Nov 02 17:26:04 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:26:04 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:26:04 user nova-compute[74980]:       <nova:name>tempest-DeleteServersTestJSON-server-1251564298</nova:name>
Nov 02 17:26:04 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:26:04</nova:creationTime>
Nov 02 17:26:04 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:26:04 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:26:04 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:26:04 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:26:04 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:26:04 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:26:04 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:26:04 user nova-compute[74980]:       <nova:owner>
Nov 02 17:26:04 user nova-compute[74980]:         <nova:user uuid="b75cd0a07a404094b74c73e9ced8f5f4">tempest-DeleteServersTestJSON-510258544-project-member</nova:user>
Nov 02 17:26:04 user nova-compute[74980]:         <nova:project uuid="caae5e1d54624270920015819e250435">tempest-DeleteServersTestJSON-510258544</nova:project>
Nov 02 17:26:04 user nova-compute[74980]:       </nova:owner>
Nov 02 17:26:04 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:26:04 user nova-compute[74980]:       <nova:ports>
Nov 02 17:26:04 user nova-compute[74980]:         <nova:port uuid="3f505851-98d3-4b75-b946-c3ed7e4267e2">
Nov 02 17:26:04 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 17:26:04 user nova-compute[74980]:         </nova:port>
Nov 02 17:26:04 user nova-compute[74980]:       </nova:ports>
Nov 02 17:26:04 user nova-compute[74980]:     </nova:instance>
Nov 02 17:26:04 user nova-compute[74980]:   </metadata>
Nov 02 17:26:04 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:26:04 user nova-compute[74980]:     <system>
Nov 02 17:26:04 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:26:04 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:26:04 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:26:04 user nova-compute[74980]:       <entry name="serial">07bc020d-9394-4327-9c90-9902b7256bf9</entry>
Nov 02 17:26:04 user nova-compute[74980]:       <entry name="uuid">07bc020d-9394-4327-9c90-9902b7256bf9</entry>
Nov 02 17:26:04 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:26:04 user nova-compute[74980]:     </system>
Nov 02 17:26:04 user nova-compute[74980]:   </sysinfo>
Nov 02 17:26:04 user nova-compute[74980]:   <os>
Nov 02 17:26:04 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:26:04 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:26:04 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:26:04 user nova-compute[74980]:   </os>
Nov 02 17:26:04 user nova-compute[74980]:   <features>
Nov 02 17:26:04 user nova-compute[74980]:     <acpi/>
Nov 02 17:26:04 user nova-compute[74980]:     <apic/>
Nov 02 17:26:04 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:26:04 user nova-compute[74980]:   </features>
Nov 02 17:26:04 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:26:04 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:26:04 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:26:04 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:26:04 user nova-compute[74980]:   </clock>
Nov 02 17:26:04 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:26:04 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:26:04 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:26:04 user nova-compute[74980]:   </cpu>
Nov 02 17:26:04 user nova-compute[74980]:   <devices>
Nov 02 17:26:04 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:26:04 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:26:04 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk"/>
Nov 02 17:26:04 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:26:04 user nova-compute[74980]:     </disk>
Nov 02 17:26:04 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:26:04 user nova-compute[74980]:       <mac address="fa:16:3e:11:c5:b4"/>
Nov 02 17:26:04 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:26:04 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:26:04 user nova-compute[74980]:       <target dev="tap3f505851-98"/>
Nov 02 17:26:04 user nova-compute[74980]:     </interface>
Nov 02 17:26:04 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:26:04 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/console.log" append="off"/>
Nov 02 17:26:04 user nova-compute[74980]:     </serial>
Nov 02 17:26:04 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:26:04 user nova-compute[74980]:     <video>
Nov 02 17:26:04 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:26:04 user nova-compute[74980]:     </video>
Nov 02 17:26:04 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:26:04 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:26:04 user nova-compute[74980]:     </rng>
Nov 02 17:26:04 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:26:04 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:26:04 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:26:04 user nova-compute[74980]:     </memballoon>
Nov 02 17:26:04 user nova-compute[74980]:   </devices>
Nov 02 17:26:04 user nova-compute[74980]: </domain>
Nov 02 17:26:04 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:26:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1251564298',display_name='tempest-DeleteServersTestJSON-server-1251564298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1251564298',id=21,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caae5e1d54624270920015819e250435',ramdisk_id='',reservation_id='r-kdyygfq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-510258544',owner_user_name='tempest-DeleteServersTestJSON-510258544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:26:03Z,user_data=None,user_id='b75cd0a07a404094b74c73e9ced8f5f4',uuid=07bc020d-9394-4327-9c90-9902b7256bf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "address": "fa:16:3e:11:c5:b4", "network": {"id": "6a7dc076-5437-429f-a011-a41212b7807f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-595587795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caae5e1d54624270920015819e250435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f505851-98", "ovs_interfaceid": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Converting VIF {"id": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "address": "fa:16:3e:11:c5:b4", "network": {"id": "6a7dc076-5437-429f-a011-a41212b7807f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-595587795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caae5e1d54624270920015819e250435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f505851-98", "ovs_interfaceid": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=3f505851-98d3-4b75-b946-c3ed7e4267e2,network=Network(6a7dc076-5437-429f-a011-a41212b7807f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f505851-98') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG os_vif [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=3f505851-98d3-4b75-b946-c3ed7e4267e2,network=Network(6a7dc076-5437-429f-a011-a41212b7807f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f505851-98') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba87c014-2213-5a8d-8526-fb627154b101', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f505851-98, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f505851-98, col_values=(('qos', UUID('0ef88990-9cc6-4faa-be6b-3178d7295cd5')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f505851-98, col_values=(('external_ids', {'iface-id': '3f505851-98d3-4b75-b946-c3ed7e4267e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:c5:b4', 'vm-uuid': '07bc020d-9394-4327-9c90-9902b7256bf9'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:04 user nova-compute[74980]: INFO os_vif [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=3f505851-98d3-4b75-b946-c3ed7e4267e2,network=Network(6a7dc076-5437-429f-a011-a41212b7807f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f505851-98')
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:26:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] No VIF found with MAC fa:16:3e:11:c5:b4, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:26:05 user nova-compute[74980]: DEBUG nova.network.neutron [req-fc8e162e-fb5f-4de4-986e-05f6af964894 req-4dd47b72-08cd-4ccf-8028-f577624876d0 service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Updated VIF entry in instance network info cache for port 3f505851-98d3-4b75-b946-c3ed7e4267e2. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:26:05 user nova-compute[74980]: DEBUG nova.network.neutron [req-fc8e162e-fb5f-4de4-986e-05f6af964894 req-4dd47b72-08cd-4ccf-8028-f577624876d0 service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Updating instance_info_cache with network_info: [{"id": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "address": "fa:16:3e:11:c5:b4", "network": {"id": "6a7dc076-5437-429f-a011-a41212b7807f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-595587795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caae5e1d54624270920015819e250435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f505851-98", "ovs_interfaceid": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:26:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fc8e162e-fb5f-4de4-986e-05f6af964894 req-4dd47b72-08cd-4ccf-8028-f577624876d0 service nova] Releasing lock "refresh_cache-07bc020d-9394-4327-9c90-9902b7256bf9" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:26:05 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:26:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-421a0f6c-8760-4900-9280-73efc6f9b39c req-260649ed-81b4-45b4-af82-95ded31de353 service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Received event network-vif-plugged-3f505851-98d3-4b75-b946-c3ed7e4267e2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-421a0f6c-8760-4900-9280-73efc6f9b39c req-260649ed-81b4-45b4-af82-95ded31de353 service nova] Acquiring lock "07bc020d-9394-4327-9c90-9902b7256bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-421a0f6c-8760-4900-9280-73efc6f9b39c req-260649ed-81b4-45b4-af82-95ded31de353 service nova] Lock "07bc020d-9394-4327-9c90-9902b7256bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-421a0f6c-8760-4900-9280-73efc6f9b39c req-260649ed-81b4-45b4-af82-95ded31de353 service nova] Lock "07bc020d-9394-4327-9c90-9902b7256bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-421a0f6c-8760-4900-9280-73efc6f9b39c req-260649ed-81b4-45b4-af82-95ded31de353 service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] No waiting events found dispatching network-vif-plugged-3f505851-98d3-4b75-b946-c3ed7e4267e2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:26:06 user nova-compute[74980]: WARNING nova.compute.manager [req-421a0f6c-8760-4900-9280-73efc6f9b39c req-260649ed-81b4-45b4-af82-95ded31de353 service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Received unexpected event network-vif-plugged-3f505851-98d3-4b75-b946-c3ed7e4267e2 for instance with vm_state building and task_state spawning.
Nov 02 17:26:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:26:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:26:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG nova.compute.manager [req-46aab95a-daf7-4eb3-91dd-4c80d287da29 req-4b48c8a0-bf0d-4b4a-953c-663ee801db1c service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Received event network-vif-plugged-3f505851-98d3-4b75-b946-c3ed7e4267e2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-46aab95a-daf7-4eb3-91dd-4c80d287da29 req-4b48c8a0-bf0d-4b4a-953c-663ee801db1c service nova] Acquiring lock "07bc020d-9394-4327-9c90-9902b7256bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-46aab95a-daf7-4eb3-91dd-4c80d287da29 req-4b48c8a0-bf0d-4b4a-953c-663ee801db1c service nova] Lock "07bc020d-9394-4327-9c90-9902b7256bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-46aab95a-daf7-4eb3-91dd-4c80d287da29 req-4b48c8a0-bf0d-4b4a-953c-663ee801db1c service nova] Lock "07bc020d-9394-4327-9c90-9902b7256bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG nova.compute.manager [req-46aab95a-daf7-4eb3-91dd-4c80d287da29 req-4b48c8a0-bf0d-4b4a-953c-663ee801db1c service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] No waiting events found dispatching network-vif-plugged-3f505851-98d3-4b75-b946-c3ed7e4267e2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:26:08 user nova-compute[74980]: WARNING nova.compute.manager [req-46aab95a-daf7-4eb3-91dd-4c80d287da29 req-4b48c8a0-bf0d-4b4a-953c-663ee801db1c service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Received unexpected event network-vif-plugged-3f505851-98d3-4b75-b946-c3ed7e4267e2 for instance with vm_state building and task_state spawning.
Nov 02 17:26:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:26:08 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Instance spawned successfully.
Nov 02 17:26:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:08 user nova-compute[74980]: INFO nova.compute.manager [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 02 17:26:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZpAhgdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:26:08 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:26:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:26:08 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:26:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:26:08 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf175ebe-2b36-4aed-a1c6-70b39bcd479c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:26:08 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50655fc-aa3d-4ec8-9ca7-7e5eb467b243]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4] added
Nov 02 17:26:09 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:09 user nova-compute[74980]: INFO nova.compute.manager [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Took 6.98 seconds to build instance.
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[67173c28-bb98-4ba9-9e38-1ba0472e16e2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-26673bca-b3ef-4551-95bb-99c46720e70a tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "07bc020d-9394-4327-9c90-9902b7256bf9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.120s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d24e411-f8d7-49ab-a0f3-25183ee9d723]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZpAhgdx {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZpAhgdx" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8886762c-36da-4c2e-9a84-83a282223b57]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OZpAhgdx'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b2b8f9-1c0d-4e99-8351-80383b41870d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[254f1b25-9031-4a98-bb2d-e1696c6680fb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:09 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:09 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:09 user nova-compute[74980]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)
Nov 02 17:26:09 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:09 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:09 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:09 user nova-compute[74980]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)
Nov 02 17:26:09 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8090fc88-b12d-47af-afd8-796e50ecdce1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4, portal: 172.16.0.220,3260]
Nov 02 17:26:09 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4, portal: 172.16.0.220,3260] successful.
Nov 02 17:26:09 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf0cc7b-e19a-4d76-b99f-cda170b824f2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc2d3fc-4d28-4686-b856-e30bb28fa0a8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:09 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:09 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:09 user nova-compute[74980]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)
Nov 02 17:26:09 user nova-compute[74980]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 (non-flash)
Nov 02 17:26:09 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:09 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:09 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:09 user nova-compute[74980]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)
Nov 02 17:26:09 user nova-compute[74980]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 (non-flash)
Nov 02 17:26:09 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.459s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed3054b-932f-44e4-a262-43c68f55ca9c]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZpAhgdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.521s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:26:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] <== connect_volume: return (1526ms) {'type': 'block', 'scsi_wwn': '23765393939303935', 'path': '/dev/sdc'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:26:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765393939303935', 'path': '/dev/sdc'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:26:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lazy-loading 'flavor' on Instance uuid 92537376-b06d-4d0f-8ed4-1bc120d080fa {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:26:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:26:10 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:26:10 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:26:10 user nova-compute[74980]:   <target dev="vdc" bus="virtio"/>
Nov 02 17:26:10 user nova-compute[74980]:   <serial>1917cac4-adc5-4a71-ad92-480a56d0d3f4</serial>
Nov 02 17:26:10 user nova-compute[74980]: </disk>
Nov 02 17:26:10 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:26:11 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:26:11 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=7677MB free_disk=25.319110870361328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] No VIF found with MAC fa:16:3e:fb:1d:72, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.objects.instance [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'flavor' on Instance uuid a89a8f0a-c299-44cb-9fce-8fe5b883f4a0 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 4e6bfb81-f01c-47e6-b771-7c2b34587623 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1620c8eb-067c-4156-b927-2f64eac9e340 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance f0eb2644-f721-4a49-834d-16c43ad6d5c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 92537376-b06d-4d0f-8ed4-1bc120d080fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 08309ef4-cf53-47b0-8960-01aba8903030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a89a8f0a-c299-44cb-9fce-8fe5b883f4a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 22b8ca59-959d-4687-bb7d-4fc7909aa852 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 07bc020d-9394-4327-9c90-9902b7256bf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-93cf1a2f-460d-42c3-bc86-f348c1f91bb1 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.108s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:11 user nova-compute[74980]: INFO nova.compute.manager [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Attaching volume 397105af-5088-443d-8dd3-6b000789bd09 to /dev/vdb
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG os_brick.utils [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d103203d-d850-4bb9-8c33-602b7503a8e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d48332-2cf7-4e3b-a861-d71a459f82eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[658e25ed-c979-409d-964c-2003e59bc3d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9196d35-b498-46db-8f49-8d79bad59584]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:26:11 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:26:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[230c7cd7-9a9c-4cdc-a930-24ea1aad920a]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG os_brick.utils [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:26:11 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Updating existing volume attachment record: 64da81e3-10c2-4ae5-9054-5416c9a27442 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:26:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:12 user nova-compute[74980]: INFO nova.compute.manager [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Detaching volume 1917cac4-adc5-4a71-ad92-480a56d0d3f4
Nov 02 17:26:12 user nova-compute[74980]: INFO nova.virt.block_device [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Attempting to driver detach volume 1917cac4-adc5-4a71-ad92-480a56d0d3f4 from mountpoint /dev/vdc
Nov 02 17:26:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Attempting to detach device vdc from instance 92537376-b06d-4d0f-8ed4-1bc120d080fa from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:26:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:26:12 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:26:12 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:26:12 user nova-compute[74980]:   <target dev="vdc" bus="virtio"/>
Nov 02 17:26:12 user nova-compute[74980]:   <serial>1917cac4-adc5-4a71-ad92-480a56d0d3f4</serial>
Nov 02 17:26:12 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 17:26:12 user nova-compute[74980]: </disk>
Nov 02 17:26:12 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:26:12 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Successfully detached device vdc from instance 92537376-b06d-4d0f-8ed4-1bc120d080fa from the persistent domain config.
Nov 02 17:26:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 92537376-b06d-4d0f-8ed4-1bc120d080fa from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:26:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:26:12 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:26:12 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:26:12 user nova-compute[74980]:   <target dev="vdc" bus="virtio"/>
Nov 02 17:26:12 user nova-compute[74980]:   <serial>1917cac4-adc5-4a71-ad92-480a56d0d3f4</serial>
Nov 02 17:26:12 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 17:26:12 user nova-compute[74980]: </disk>
Nov 02 17:26:12 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:26:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 92537376-b06d-4d0f-8ed4-1bc120d080fa {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:26:12 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:26:12 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:26:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:26:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:26:13 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:26:13 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updating instance_info_cache with network_info: [{"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:26:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:26:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:26:13 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:26:13 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:26:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG nova.compute.manager [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gpVzAnSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0eb2644-f721-4a49-834d-16c43ad6d5c2', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef93d33c-474a-41a8-9ad8-55184c3e94ba', 'serial': 'ef93d33c-474a-41a8-9ad8-55184c3e94ba'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHyNdRTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'b936d1d3-199f-4620-8898-60072b93b717'}, 'status': 'reserved', 'instance': 'f0eb2644-f721-4a49-834d-16c43ad6d5c2', 'attached_at': '', 'detached_at': '', 'volume_id': 'b936d1d3-199f-4620-8898-60072b93b717', 'serial'} {{(pid=74980) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gpVzAnSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:26:15 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:26:15 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:26:15 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d81be38-0256-4194-b383-df9115fa9ec3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:26:15 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2ef8be-1c5b-44d0-8b19-df146a61d2af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba] added
Nov 02 17:26:15 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ed62be-1f92-4477-9d49-222d746ba4de]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[901d225b-01b3-434b-b4dd-594edca7e1f7]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gpVzAnSU {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gpVzAnSU" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3aa3b5-174e-4e57-b694-0281084b32c2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gpVzAnSU'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1e59ec-16ee-4c49-a893-09f865043697]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1400fd7-6cbc-4187-aa98-308462fad606]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 (non-flash)
Nov 02 17:26:15 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 (non-flash)
Nov 02 17:26:15 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3043d0f-0aec-498e-8ef4-ef16db64f7a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260]
Nov 02 17:26:15 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260] successful.
Nov 02 17:26:15 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df0a526-083a-431b-9b2e-93846f3ba2b4]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd1f167-4738-4a50-997e-60f85b988b7b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:26:15 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 (non-flash)
Nov 02 17:26:15 user nova-compute[74980]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:26:15 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff84a447-d25a-4dc3-9ff7-5f322d2e1592]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:15 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:26:16 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:26:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gpVzAnSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:26:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:26:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26564343737396133', 'path': '/dev/sdg'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:26:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564343737396133', 'path': '/dev/sdg'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:26:16 user nova-compute[74980]: DEBUG nova.objects.instance [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lazy-loading 'flavor' on Instance uuid f0eb2644-f721-4a49-834d-16c43ad6d5c2 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:26:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:26:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 114294784 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:26:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 247463936 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:26:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 363855872 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:26:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 535822336 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:26:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 659554304 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:26:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:26:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5008 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:26:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:26:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:26:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 788529152 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:26:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 897581056 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 1037041664 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHyNdRTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'b936d1d3-199f-4620-8898-60072b93b717'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:26:21 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5055fc06-061f-4d1f-baa0-ead9195a1336]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:26:21 user nova-compute[74980]: No targets found.
Nov 02 17:26:21 user nova-compute[74980]: iSNS:
Nov 02 17:26:21 user nova-compute[74980]: No targets found.
Nov 02 17:26:21 user nova-compute[74980]: STATIC:
Nov 02 17:26:21 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7
Nov 02 17:26:21 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:21 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:21 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb
Nov 02 17:26:21 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:21 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:21 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4
Nov 02 17:26:21 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:21 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:21 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e
Nov 02 17:26:21 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:21 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:21 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba
Nov 02 17:26:21 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:21 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:21 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717
Nov 02 17:26:21 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:21 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:21 user nova-compute[74980]: FIRMWARE:
Nov 02 17:26:21 user nova-compute[74980]: No targets found.
Nov 02 17:26:21 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:26:21 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:26:21 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce82ec1-bc5c-4b28-a8a0-722073197bd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[45380098-f33b-4898-ac6d-d9ffd0d1ec12]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:21 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:21 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:21 user nova-compute[74980]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)
Nov 02 17:26:21 user nova-compute[74980]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 (non-flash)
Nov 02 17:26:21 user nova-compute[74980]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:26:21 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:21 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:21 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:21 user nova-compute[74980]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 (non-flash)
Nov 02 17:26:21 user nova-compute[74980]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 (non-flash)
Nov 02 17:26:21 user nova-compute[74980]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:26:21 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5994640dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717'): ({'sdf'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Removing single pathed devices sdf {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4381e39e-0ebf-4be8-92d7-67542c16e35f]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4626b6-1722-4913-ba7d-6cd4c1fb4717]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Flushing IO for device /dev/sdf {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[27870942-6db4-4b99-8c3c-2641d60fd5f9]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30c909c-bc28-4116-a7c9-35bb40d49622]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] SCSI volumes sdf have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48a0b3a-4266-497d-a485-e68ef84a571e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[97595429-7e87-4e55-bb09-3982c20fdd23]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717, portal: 172.16.0.220,3260]
Nov 02 17:26:21 user nova-compute[74980]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717, portal: 172.16.0.220,3260] successful.
Nov 02 17:26:21 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b936d1d3-199f-4620-8898-60072b93b717 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b4bb31-56b9-4e05-8e85-1c392863fe73]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:26:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] <== disconnect_volume: return (365ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:26:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:26:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gpVzAnSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'f0eb2644-f721-4a49-834d-16c43ad6d5c2', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef93d33c-474a-41a8-9ad8-55184c3e94ba', 'serial'} {{(pid=74980) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 02 17:26:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] swap_volume: removing Cinder connection for volume b936d1d3-199f-4620-8898-60072b93b717 {{(pid=74980) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 02 17:26:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] swap_volume: Updating volume b936d1d3-199f-4620-8898-60072b93b717 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "gpVzAnSU", "auth_password": "iAQl3ZJ4OWc507", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "ef93d33c-474a-41a8-9ad8-55184c3e94ba"}, "status": "reserved", "instance": "f0eb2644-f721-4a49-834d-16c43ad6d5c2", "attached_at": "", "detached_at": "", "volume_id": "ef93d33c-474a-41a8-9ad8-55184c3e94ba", "serial": "ef93d33c-474a-41a8-9ad8-55184c3e94ba"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ef93d33c-474a-41a8-9ad8-55184c3e94ba', 'no_device': None, 'attachment_id': '6c248819-bacc-42a7-b9d0-c68d7e3a7395'} {{(pid=74980) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 02 17:26:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7689567b-5262-4b48-977b-8ba911f95315 tempest-TestVolumeSwap-347987467 tempest-TestVolumeSwap-347987467-project-admin] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 32.168s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquiring lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:23 user nova-compute[74980]: INFO nova.compute.manager [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Detaching volume ef93d33c-474a-41a8-9ad8-55184c3e94ba
Nov 02 17:26:24 user nova-compute[74980]: INFO nova.virt.block_device [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Attempting to driver detach volume ef93d33c-474a-41a8-9ad8-55184c3e94ba from mountpoint /dev/vdb
Nov 02 17:26:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Attempting to detach device vdb from instance f0eb2644-f721-4a49-834d-16c43ad6d5c2 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:26:24 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:26:24 user nova-compute[74980]:   <source dev="/dev/sdg"/>
Nov 02 17:26:24 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:26:24 user nova-compute[74980]:   <serial>ef93d33c-474a-41a8-9ad8-55184c3e94ba</serial>
Nov 02 17:26:24 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:26:24 user nova-compute[74980]: </disk>
Nov 02 17:26:24 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:26:24 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Successfully detached device vdb from instance f0eb2644-f721-4a49-834d-16c43ad6d5c2 from the persistent domain config.
Nov 02 17:26:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0eb2644-f721-4a49-834d-16c43ad6d5c2 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:26:24 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:26:24 user nova-compute[74980]:   <source dev="/dev/sdg"/>
Nov 02 17:26:24 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:26:24 user nova-compute[74980]:   <serial>ef93d33c-474a-41a8-9ad8-55184c3e94ba</serial>
Nov 02 17:26:24 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:26:24 user nova-compute[74980]: </disk>
Nov 02 17:26:24 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "4e6bfb81-f01c-47e6-b771-7c2b34587623" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "4e6bfb81-f01c-47e6-b771-7c2b34587623-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:24 user nova-compute[74980]: INFO nova.compute.manager [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Terminating instance
Nov 02 17:26:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0eb2644-f721-4a49-834d-16c43ad6d5c2 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-58d0bc30-76c6-491d-ad8b-d7c3a59da3eb req-840ae45f-f6d2-41b4-8177-6a091742e4f6 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Received event network-vif-unplugged-6189316b-4df5-4f6e-ab3d-77d321a6aafb {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-58d0bc30-76c6-491d-ad8b-d7c3a59da3eb req-840ae45f-f6d2-41b4-8177-6a091742e4f6 service nova] Acquiring lock "4e6bfb81-f01c-47e6-b771-7c2b34587623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-58d0bc30-76c6-491d-ad8b-d7c3a59da3eb req-840ae45f-f6d2-41b4-8177-6a091742e4f6 service nova] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-58d0bc30-76c6-491d-ad8b-d7c3a59da3eb req-840ae45f-f6d2-41b4-8177-6a091742e4f6 service nova] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-58d0bc30-76c6-491d-ad8b-d7c3a59da3eb req-840ae45f-f6d2-41b4-8177-6a091742e4f6 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] No waiting events found dispatching network-vif-unplugged-6189316b-4df5-4f6e-ab3d-77d321a6aafb {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:26:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-58d0bc30-76c6-491d-ad8b-d7c3a59da3eb req-840ae45f-f6d2-41b4-8177-6a091742e4f6 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Received event network-vif-unplugged-6189316b-4df5-4f6e-ab3d-77d321a6aafb for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:26:25 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Instance destroyed successfully.
Nov 02 17:26:25 user nova-compute[74980]: DEBUG nova.objects.instance [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lazy-loading 'resources' on Instance uuid 4e6bfb81-f01c-47e6-b771-7c2b34587623 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:26:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1940927778',display_name='tempest-ServersNegativeTestJSON-server-1940927778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1940927778',id=1,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:17:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7978c159e5d431aba9762331de242f1',ramdisk_id='',reservation_id='r-8vt5t0pi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1915471849',owner_user_name='tempest-ServersNegativeTestJSON-1915471849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:17:28Z,user_data=None,user_id='05186d8245f04cb19095cf71ee92f70b',uuid=4e6bfb81-f01c-47e6-b771-7c2b34587623,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "address": "fa:16:3e:95:9a:bc", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6189316b-4d", "ovs_interfaceid": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:26:25 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Converting VIF {"id": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "address": "fa:16:3e:95:9a:bc", "network": {"id": "e19b7ac0-cd44-4a92-8414-9f1a78021fe2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-370036628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7978c159e5d431aba9762331de242f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6189316b-4d", "ovs_interfaceid": "6189316b-4df5-4f6e-ab3d-77d321a6aafb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:26:25 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:9a:bc,bridge_name='br-int',has_traffic_filtering=True,id=6189316b-4df5-4f6e-ab3d-77d321a6aafb,network=Network(e19b7ac0-cd44-4a92-8414-9f1a78021fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6189316b-4d') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:26:25 user nova-compute[74980]: DEBUG os_vif [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:9a:bc,bridge_name='br-int',has_traffic_filtering=True,id=6189316b-4df5-4f6e-ab3d-77d321a6aafb,network=Network(e19b7ac0-cd44-4a92-8414-9f1a78021fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6189316b-4d') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:26:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6189316b-4d, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:26:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:26:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19dfef21-9ef8-405e-ac50-4e03b1fccc3f) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:26:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:26:25 user nova-compute[74980]: INFO os_vif [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:9a:bc,bridge_name='br-int',has_traffic_filtering=True,id=6189316b-4df5-4f6e-ab3d-77d321a6aafb,network=Network(e19b7ac0-cd44-4a92-8414-9f1a78021fe2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6189316b-4d')
Nov 02 17:26:25 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Deleting instance files /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623_del
Nov 02 17:26:25 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Deletion of /opt/stack/data/nova/instances/4e6bfb81-f01c-47e6-b771-7c2b34587623_del complete
Nov 02 17:26:25 user nova-compute[74980]: INFO nova.compute.manager [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 02 17:26:25 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:26:25 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:26:25 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:26:25 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:26:25 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Took 0.71 seconds to deallocate network for instance.
Nov 02 17:26:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:26 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:26:26 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:26:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:26 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Deleted allocations for instance 4e6bfb81-f01c-47e6-b771-7c2b34587623
Nov 02 17:26:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-49c6ee1a-06f4-4119-90eb-31829c7228e1 tempest-ServersNegativeTestJSON-1915471849 tempest-ServersNegativeTestJSON-1915471849-project-member] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.180s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-bba3220c-00a8-4985-9e50-1b2372861532 req-48902740-bc7f-4f2a-8356-c565dfcb26b9 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Received event network-vif-plugged-6189316b-4df5-4f6e-ab3d-77d321a6aafb {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:26:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bba3220c-00a8-4985-9e50-1b2372861532 req-48902740-bc7f-4f2a-8356-c565dfcb26b9 service nova] Acquiring lock "4e6bfb81-f01c-47e6-b771-7c2b34587623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bba3220c-00a8-4985-9e50-1b2372861532 req-48902740-bc7f-4f2a-8356-c565dfcb26b9 service nova] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bba3220c-00a8-4985-9e50-1b2372861532 req-48902740-bc7f-4f2a-8356-c565dfcb26b9 service nova] Lock "4e6bfb81-f01c-47e6-b771-7c2b34587623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-bba3220c-00a8-4985-9e50-1b2372861532 req-48902740-bc7f-4f2a-8356-c565dfcb26b9 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] No waiting events found dispatching network-vif-plugged-6189316b-4df5-4f6e-ab3d-77d321a6aafb {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:26:26 user nova-compute[74980]: WARNING nova.compute.manager [req-bba3220c-00a8-4985-9e50-1b2372861532 req-48902740-bc7f-4f2a-8356-c565dfcb26b9 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Received unexpected event network-vif-plugged-6189316b-4df5-4f6e-ab3d-77d321a6aafb for instance with vm_state deleted and task_state None.
Nov 02 17:26:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-bba3220c-00a8-4985-9e50-1b2372861532 req-48902740-bc7f-4f2a-8356-c565dfcb26b9 service nova] [instance: 4e6bfb81-f01c-47e6-b771-7c2b34587623] Received event network-vif-deleted-6189316b-4df5-4f6e-ab3d-77d321a6aafb {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:26:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "1620c8eb-067c-4156-b927-2f64eac9e340" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "1620c8eb-067c-4156-b927-2f64eac9e340" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:29 user nova-compute[74980]: INFO nova.compute.manager [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Detaching volume df8cce4d-4862-4318-ac83-25951d18b8f7
Nov 02 17:26:29 user nova-compute[74980]: INFO nova.virt.block_device [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Attempting to driver detach volume df8cce4d-4862-4318-ac83-25951d18b8f7 from mountpoint /dev/vdb
Nov 02 17:26:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Attempting to detach device vdb from instance 1620c8eb-067c-4156-b927-2f64eac9e340 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:26:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:26:29 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:26:29 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:26:29 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:26:29 user nova-compute[74980]:   <serial>df8cce4d-4862-4318-ac83-25951d18b8f7</serial>
Nov 02 17:26:29 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 17:26:29 user nova-compute[74980]: </disk>
Nov 02 17:26:29 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:26:29 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Successfully detached device vdb from instance 1620c8eb-067c-4156-b927-2f64eac9e340 from the persistent domain config.
Nov 02 17:26:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1620c8eb-067c-4156-b927-2f64eac9e340 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:26:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:26:29 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:26:29 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:26:29 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:26:29 user nova-compute[74980]:   <serial>df8cce4d-4862-4318-ac83-25951d18b8f7</serial>
Nov 02 17:26:29 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 17:26:29 user nova-compute[74980]: </disk>
Nov 02 17:26:29 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:26:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1620c8eb-067c-4156-b927-2f64eac9e340 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:26:32 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 92537376-b06d-4d0f-8ed4-1bc120d080fa is timed out.
Nov 02 17:26:32 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Successfully detached device vdc from instance 92537376-b06d-4d0f-8ed4-1bc120d080fa from the live domain config.
Nov 02 17:26:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZpAhgdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:26:32 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c007b76d-5177-48aa-9d50-be96472ab6f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:26:32 user nova-compute[74980]: No targets found.
Nov 02 17:26:32 user nova-compute[74980]: iSNS:
Nov 02 17:26:32 user nova-compute[74980]: No targets found.
Nov 02 17:26:32 user nova-compute[74980]: STATIC:
Nov 02 17:26:32 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7
Nov 02 17:26:32 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:32 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:32 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb
Nov 02 17:26:32 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:32 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:32 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4
Nov 02 17:26:32 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:32 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:32 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e
Nov 02 17:26:32 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:32 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:32 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba
Nov 02 17:26:32 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:32 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:32 user nova-compute[74980]: FIRMWARE:
Nov 02 17:26:32 user nova-compute[74980]: No targets found.
Nov 02 17:26:32 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:26:32 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:26:32 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfecb2b7-dc4b-4814-92f2-d09ec4e5586a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[28de4f14-bbc3-4adf-accf-dd658831c0a0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:32 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:32 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:32 user nova-compute[74980]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 (non-flash)
Nov 02 17:26:32 user nova-compute[74980]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:26:32 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:32 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:32 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:32 user nova-compute[74980]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 (non-flash)
Nov 02 17:26:32 user nova-compute[74980]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:26:32 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b45d7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4'): ({'sdc'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Removing single pathed devices sdc {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a556ac-cd80-4b9e-bb75-43d865251722]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[de731418-9756-4c15-ae53-2a8a49d20258]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Flushing IO for device /dev/sdc {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e822967-b080-411f-b410-f189d94c2e3e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd9f21a-038a-434c-ac50-a71f8425d8eb]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f844d9-02c0-4286-8a95-0db9266b2eac]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:33 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2d7401-5a25-42ed-aa4f-3752073e08bb]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4, portal: 172.16.0.220,3260]
Nov 02 17:26:33 user nova-compute[74980]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4, portal: 172.16.0.220,3260] successful.
Nov 02 17:26:33 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1917cac4-adc5-4a71-ad92-480a56d0d3f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:33 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a736bc-8732-4d93-871a-a9c9f5684ab5]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:26:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] <== disconnect_volume: return (330ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:26:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:26:34 user nova-compute[74980]: DEBUG nova.objects.instance [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lazy-loading 'flavor' on Instance uuid 92537376-b06d-4d0f-8ed4-1bc120d080fa {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:26:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-72300981-4178-401b-85e2-03ce0f84998b tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.925s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:44 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f0eb2644-f721-4a49-834d-16c43ad6d5c2 is timed out.
Nov 02 17:26:44 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Successfully detached device vdb from instance f0eb2644-f721-4a49-834d-16c43ad6d5c2 from the live domain config.
Nov 02 17:26:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gpVzAnSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'ef93d33c-474a-41a8-9ad8-55184c3e94ba'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:26:44 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5929dd6-730d-47be-ac16-6c3fec44514d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:26:44 user nova-compute[74980]: No targets found.
Nov 02 17:26:44 user nova-compute[74980]: iSNS:
Nov 02 17:26:44 user nova-compute[74980]: No targets found.
Nov 02 17:26:44 user nova-compute[74980]: STATIC:
Nov 02 17:26:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7
Nov 02 17:26:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb
Nov 02 17:26:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e
Nov 02 17:26:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba
Nov 02 17:26:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:44 user nova-compute[74980]: FIRMWARE:
Nov 02 17:26:44 user nova-compute[74980]: No targets found.
Nov 02 17:26:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:26:44 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:26:44 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[184e1080-db7e-4b94-9e78-fe56016f63cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d56b08-91e1-4a81-8286-122092332d7a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:44 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:44 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:44 user nova-compute[74980]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:26:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:44 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:44 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:44 user nova-compute[74980]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba (non-flash)
Nov 02 17:26:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59947ac8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba'): ({'sdg'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Removing single pathed devices sdg {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1856c952-6ca6-41e0-835a-ff3a52cb1611]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e107b4a5-7d77-4ff8-8ea4-a3f8324fcfe0]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Flushing IO for device /dev/sdg {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0e573c-5711-41e5-a6f3-4da42731b7bb]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4a6747-05cc-4ee0-96d5-a89937c89cf1]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] SCSI volumes sdg have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c5e45e-66a0-4fb3-9ab4-23f8f930ae85]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74584d7-6158-4c96-985a-a68f9bc0327c]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260]
Nov 02 17:26:44 user nova-compute[74980]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba, portal: 172.16.0.220,3260] successful.
Nov 02 17:26:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef93d33c-474a-41a8-9ad8-55184c3e94ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae2941e-60f9-4ae1-9de9-98658a8fde38]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] <== disconnect_volume: return (322ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:26:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFONdouX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:26:45 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:26:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:26:45 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:26:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:26:45 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG nova.objects.instance [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lazy-loading 'flavor' on Instance uuid f0eb2644-f721-4a49-834d-16c43ad6d5c2 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ec41af-2fab-49cf-b1e2-03d639b60a0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:26:45 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a46b4be-4d9b-42fe-b60f-393b2af9549d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09] added
Nov 02 17:26:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fd318630-a7fc-474e-9633-b99bad7a19dd tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.904s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6579702c-1562-4e28-a412-fa8003509c77]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfd7b03-a7b0-4bc5-9bc6-635e5b849438]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mFONdouX {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mFONdouX" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae22c1d-cf50-4dba-8e44-95d6c16f2ab4]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mFONdouX'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf4d245-9471-406e-b7f5-4861ce572a87]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4521b7c-bb84-46e8-b001-fe1a0495de86]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:45 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:45 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:45 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:45 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:26:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95e8211-bb10-4b8e-901a-837f4fba08ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09, portal: 172.16.0.220,3260]
Nov 02 17:26:46 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09, portal: 172.16.0.220,3260] successful.
Nov 02 17:26:46 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[929f8c0e-937c-4ee2-a0fa-17a2e15eb4c6]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76972b2-7cc3-41ce-aed0-11f7b1ab9629]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:46 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:46 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:46 user nova-compute[74980]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 (non-flash)
Nov 02 17:26:46 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:46 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:46 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:46 user nova-compute[74980]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 (non-flash)
Nov 02 17:26:46 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6123a0a9-c2ff-4542-a78f-e184c7faf44a]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:46 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:26:47 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:26:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFONdouX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:26:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:26:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23330303730326130', 'path': '/dev/sdc'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:26:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330303730326130', 'path': '/dev/sdc'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:26:47 user nova-compute[74980]: DEBUG nova.objects.instance [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'flavor' on Instance uuid a89a8f0a-c299-44cb-9fce-8fe5b883f4a0 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:26:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:26:47 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:26:47 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:26:47 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:26:47 user nova-compute[74980]:   <serial>397105af-5088-443d-8dd3-6b000789bd09</serial>
Nov 02 17:26:47 user nova-compute[74980]: </disk>
Nov 02 17:26:47 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:26:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:26:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:26:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No VIF found with MAC fa:16:3e:2c:ce:eb, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:26:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d7dd1680-9d8f-4a0a-81b8-e49461f08f82 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.016s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:48 user nova-compute[74980]: INFO nova.compute.manager [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Detaching volume 397105af-5088-443d-8dd3-6b000789bd09
Nov 02 17:26:49 user nova-compute[74980]: INFO nova.virt.block_device [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Attempting to driver detach volume 397105af-5088-443d-8dd3-6b000789bd09 from mountpoint /dev/vdb
Nov 02 17:26:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Attempting to detach device vdb from instance a89a8f0a-c299-44cb-9fce-8fe5b883f4a0 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:26:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:26:49 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:26:49 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:26:49 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:26:49 user nova-compute[74980]:   <serial>397105af-5088-443d-8dd3-6b000789bd09</serial>
Nov 02 17:26:49 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:26:49 user nova-compute[74980]: </disk>
Nov 02 17:26:49 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:26:49 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Successfully detached device vdb from instance a89a8f0a-c299-44cb-9fce-8fe5b883f4a0 from the persistent domain config.
Nov 02 17:26:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a89a8f0a-c299-44cb-9fce-8fe5b883f4a0 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:26:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:26:49 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:26:49 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:26:49 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:26:49 user nova-compute[74980]:   <serial>397105af-5088-443d-8dd3-6b000789bd09</serial>
Nov 02 17:26:49 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:26:49 user nova-compute[74980]: </disk>
Nov 02 17:26:49 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:26:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a89a8f0a-c299-44cb-9fce-8fe5b883f4a0 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:50 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1620c8eb-067c-4156-b927-2f64eac9e340 is timed out.
Nov 02 17:26:50 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Successfully detached device vdb from instance 1620c8eb-067c-4156-b927-2f64eac9e340 from the live domain config.
Nov 02 17:26:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqObNJxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:26:50 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87d7c24-5ffb-42df-b87c-5844677d1a72]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:26:50 user nova-compute[74980]: No targets found.
Nov 02 17:26:50 user nova-compute[74980]: iSNS:
Nov 02 17:26:50 user nova-compute[74980]: No targets found.
Nov 02 17:26:50 user nova-compute[74980]: STATIC:
Nov 02 17:26:50 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7
Nov 02 17:26:50 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:50 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:50 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb
Nov 02 17:26:50 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:50 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:50 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e
Nov 02 17:26:50 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:50 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:50 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09
Nov 02 17:26:50 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:50 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:50 user nova-compute[74980]: FIRMWARE:
Nov 02 17:26:50 user nova-compute[74980]: No targets found.
Nov 02 17:26:50 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:26:50 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:26:50 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7d54d1-0894-4fa0-881b-7e866053f24c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceef51ae-3b0b-4e23-a7d4-37985905e7a8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:50 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:50 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:50 user nova-compute[74980]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 (non-flash)
Nov 02 17:26:50 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 (non-flash)
Nov 02 17:26:50 user nova-compute[74980]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:50 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:50 user nova-compute[74980]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 (non-flash)
Nov 02 17:26:50 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59c43d9510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[821d2ef0-d3aa-48b9-94d5-cf7fe2f6fd8c]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[594860f9-0ff6-4ba2-9228-ac39200c0c0b]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43eca1f-fe85-432b-b73e-043794af4a9d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8e0f06-94ea-4ecc-811f-bdb57fe4e09b]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1c55d4-ee01-4510-aa45-7b51d01e5b3c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd5a48c-f1ef-425f-8ea7-2facfb15e641]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260]
Nov 02 17:26:50 user nova-compute[74980]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7, portal: 172.16.0.220,3260] successful.
Nov 02 17:26:50 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df8cce4d-4862-4318-ac83-25951d18b8f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39725f4-9f27-40aa-a1ef-e15671b47528]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] <== disconnect_volume: return (339ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:26:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:26:51 user nova-compute[74980]: DEBUG nova.objects.instance [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lazy-loading 'flavor' on Instance uuid 1620c8eb-067c-4156-b927-2f64eac9e340 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:26:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d97020e8-1f56-4430-b76c-e1597c76fd03 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "1620c8eb-067c-4156-b927-2f64eac9e340" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.967s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:26:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-085d93a7-e1ed-4ce8-8a4e-8ffca51a116d req-083891ab-960e-408f-80d1-c31a54e4a522 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received event network-changed-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-085d93a7-e1ed-4ce8-8a4e-8ffca51a116d req-083891ab-960e-408f-80d1-c31a54e4a522 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Refreshing instance network info cache due to event network-changed-1d0a548b-f00a-401b-9867-c1b9a4ee8d20. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-085d93a7-e1ed-4ce8-8a4e-8ffca51a116d req-083891ab-960e-408f-80d1-c31a54e4a522 service nova] Acquiring lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-085d93a7-e1ed-4ce8-8a4e-8ffca51a116d req-083891ab-960e-408f-80d1-c31a54e4a522 service nova] Acquired lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG nova.network.neutron [req-085d93a7-e1ed-4ce8-8a4e-8ffca51a116d req-083891ab-960e-408f-80d1-c31a54e4a522 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Refreshing network info cache for port 1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "22b8ca59-959d-4687-bb7d-4fc7909aa852" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:58 user nova-compute[74980]: INFO nova.compute.manager [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Terminating instance
Nov 02 17:26:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-b51d8591-9aed-49f1-b14c-981b62631ad1 req-32dcb6d6-1b2c-4b77-8503-8e748f49a836 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received event network-vif-unplugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b51d8591-9aed-49f1-b14c-981b62631ad1 req-32dcb6d6-1b2c-4b77-8503-8e748f49a836 service nova] Acquiring lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b51d8591-9aed-49f1-b14c-981b62631ad1 req-32dcb6d6-1b2c-4b77-8503-8e748f49a836 service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b51d8591-9aed-49f1-b14c-981b62631ad1 req-32dcb6d6-1b2c-4b77-8503-8e748f49a836 service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-b51d8591-9aed-49f1-b14c-981b62631ad1 req-32dcb6d6-1b2c-4b77-8503-8e748f49a836 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] No waiting events found dispatching network-vif-unplugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-b51d8591-9aed-49f1-b14c-981b62631ad1 req-32dcb6d6-1b2c-4b77-8503-8e748f49a836 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received event network-vif-unplugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG nova.network.neutron [req-085d93a7-e1ed-4ce8-8a4e-8ffca51a116d req-083891ab-960e-408f-80d1-c31a54e4a522 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updated VIF entry in instance network info cache for port 1d0a548b-f00a-401b-9867-c1b9a4ee8d20. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG nova.network.neutron [req-085d93a7-e1ed-4ce8-8a4e-8ffca51a116d req-083891ab-960e-408f-80d1-c31a54e4a522 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updating instance_info_cache with network_info: [{"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-085d93a7-e1ed-4ce8-8a4e-8ffca51a116d req-083891ab-960e-408f-80d1-c31a54e4a522 service nova] Releasing lock "refresh_cache-22b8ca59-959d-4687-bb7d-4fc7909aa852" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:26:58 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Instance destroyed successfully.
Nov 02 17:26:58 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lazy-loading 'resources' on Instance uuid 22b8ca59-959d-4687-bb7d-4fc7909aa852 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T17:21:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1948769732',display_name='tempest-TestShelveInstance-server-1948769732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1948769732',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBv3hFR2ExwN4lcjeGa2BdBDTiPIvIMfgWaKwc9SINl9eWcOYXiCvZXCh1PVrKZ4XQ7kVoydP62j/N7Nn/Kp/S+xJZS5UnPB8y1PQFmO4tQR+kVUHM2f0tUgKhLjr+OWsw==',key_name='tempest-TestShelveInstance-713239200',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:25:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3cf3b7e1970d471d8a80d04497963276',ramdisk_id='',reservation_id='r-00qsqblb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1367401440',owner_user_name='tempest-TestShelveInstance-1367401440-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:25:37Z,user_data=None,user_id='9c5c816110044002a6753a93e13459fc',uuid=22b8ca59-959d-4687-bb7d-4fc7909aa852,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Converting VIF {"id": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "address": "fa:16:3e:d8:1c:d0", "network": {"id": "6009ce0d-3076-4e9a-85f6-3ca97fcd5457", "bridge": "br-int", "label": "tempest-TestShelveInstance-2008395250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cf3b7e1970d471d8a80d04497963276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0a548b-f0", "ovs_interfaceid": "1d0a548b-f00a-401b-9867-c1b9a4ee8d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:1c:d0,bridge_name='br-int',has_traffic_filtering=True,id=1d0a548b-f00a-401b-9867-c1b9a4ee8d20,network=Network(6009ce0d-3076-4e9a-85f6-3ca97fcd5457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0a548b-f0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG os_vif [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:1c:d0,bridge_name='br-int',has_traffic_filtering=True,id=1d0a548b-f00a-401b-9867-c1b9a4ee8d20,network=Network(6009ce0d-3076-4e9a-85f6-3ca97fcd5457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0a548b-f0') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d0a548b-f0, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb7652fd-45f3-455d-aaa4-f5e64f4fddd4) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:26:58 user nova-compute[74980]: INFO os_vif [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:1c:d0,bridge_name='br-int',has_traffic_filtering=True,id=1d0a548b-f00a-401b-9867-c1b9a4ee8d20,network=Network(6009ce0d-3076-4e9a-85f6-3ca97fcd5457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0a548b-f0')
Nov 02 17:26:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFxWpjSZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:26:58 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:26:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a07047-42f0-40f8-a07e-9487baca9be4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:26:58 user nova-compute[74980]: No targets found.
Nov 02 17:26:58 user nova-compute[74980]: iSNS:
Nov 02 17:26:58 user nova-compute[74980]: No targets found.
Nov 02 17:26:58 user nova-compute[74980]: STATIC:
Nov 02 17:26:58 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb
Nov 02 17:26:58 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:58 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:58 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e
Nov 02 17:26:58 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:58 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:58 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09
Nov 02 17:26:58 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:26:58 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:26:58 user nova-compute[74980]: FIRMWARE:
Nov 02 17:26:58 user nova-compute[74980]: No targets found.
Nov 02 17:26:58 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:26:58 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:26:58 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b919d291-8e79-44c9-910c-c9834b59176a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a708912d-811d-425f-9941-7316e7d642cf]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:58 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:58 user nova-compute[74980]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 (non-flash)
Nov 02 17:26:58 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e (non-flash)
Nov 02 17:26:58 user nova-compute[74980]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:26:58 user nova-compute[74980]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 (non-flash)
Nov 02 17:26:58 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b4610700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e'): ({'sdd'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Removing single pathed devices sdd {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:26:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6ab302-0247-4caf-a85b-2a85df4e6dc8]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4cd3de-ecfb-4206-a481-c155fac63dc1]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Flushing IO for device /dev/sdd {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc04856d-ba7e-4f73-9ee6-a706ac46f8c4]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[361bff91-4aed-4eb3-91a0-392a3c8fffe9]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] SCSI volumes sdd have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26630663736626635', '/dev/disk/by-id/scsi-1SCST_BIO3253338e-f0f76bf5180cfbb4', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3253338e') {{(pid=86001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ece9fda-eb52-4dc1-bc03-bd00b36c7d5c]: (4, None) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[852db4c6-deae-488b-99a8-98f77111873f]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3e8d70-3d05-4dbe-9e9b-a3f600a7076e]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260]
Nov 02 17:26:59 user nova-compute[74980]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e, portal: 172.16.0.220,3260] successful.
Nov 02 17:26:59 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbbeebc5-6eb4-4321-a394-86cbcd00837e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8cbf59-4434-4c10-ba75-96dbc9621332]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] <== disconnect_volume: return (327ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:26:59 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Deleting instance files /opt/stack/data/nova/instances/22b8ca59-959d-4687-bb7d-4fc7909aa852_del
Nov 02 17:26:59 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Deletion of /opt/stack/data/nova/instances/22b8ca59-959d-4687-bb7d-4fc7909aa852_del complete
Nov 02 17:26:59 user nova-compute[74980]: INFO nova.compute.manager [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 02 17:26:59 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:26:59 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Took 0.46 seconds to deallocate network for instance.
Nov 02 17:26:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-90072b75-2ec5-4a48-9413-ade248955e9b req-92eeab01-32b2-43c1-a520-4ae185d0d307 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received event network-vif-deleted-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:26:59 user nova-compute[74980]: INFO nova.compute.manager [req-90072b75-2ec5-4a48-9413-ade248955e9b req-92eeab01-32b2-43c1-a520-4ae185d0d307 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Neutron deleted interface 1d0a548b-f00a-401b-9867-c1b9a4ee8d20; detaching it from the instance and deleting it from the info cache
Nov 02 17:26:59 user nova-compute[74980]: DEBUG nova.network.neutron [req-90072b75-2ec5-4a48-9413-ade248955e9b req-92eeab01-32b2-43c1-a520-4ae185d0d307 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:26:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-90072b75-2ec5-4a48-9413-ade248955e9b req-92eeab01-32b2-43c1-a520-4ae185d0d307 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Detach interface failed, port_id=1d0a548b-f00a-401b-9867-c1b9a4ee8d20, reason: Instance 22b8ca59-959d-4687-bb7d-4fc7909aa852 could not be found. {{(pid=74980) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 17:27:00 user nova-compute[74980]: DEBUG nova.compute.manager [req-dc9480d6-2c81-4b75-91ff-417f950d04cb req-9878c191-f74a-4912-b343-92b1d45b0118 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received event network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dc9480d6-2c81-4b75-91ff-417f950d04cb req-9878c191-f74a-4912-b343-92b1d45b0118 service nova] Acquiring lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dc9480d6-2c81-4b75-91ff-417f950d04cb req-9878c191-f74a-4912-b343-92b1d45b0118 service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dc9480d6-2c81-4b75-91ff-417f950d04cb req-9878c191-f74a-4912-b343-92b1d45b0118 service nova] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:00 user nova-compute[74980]: DEBUG nova.compute.manager [req-dc9480d6-2c81-4b75-91ff-417f950d04cb req-9878c191-f74a-4912-b343-92b1d45b0118 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] No waiting events found dispatching network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:27:00 user nova-compute[74980]: WARNING nova.compute.manager [req-dc9480d6-2c81-4b75-91ff-417f950d04cb req-9878c191-f74a-4912-b343-92b1d45b0118 service nova] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Received unexpected event network-vif-plugged-1d0a548b-f00a-401b-9867-c1b9a4ee8d20 for instance with vm_state active and task_state deleting.
Nov 02 17:27:00 user nova-compute[74980]: INFO nova.compute.manager [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Took 0.96 seconds to detach 1 volumes for instance.
Nov 02 17:27:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] [instance: 22b8ca59-959d-4687-bb7d-4fc7909aa852] Deleting volume: cbbeebc5-6eb4-4321-a394-86cbcd00837e {{(pid=74980) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 17:27:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:01 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:27:01 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:27:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:01 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Deleted allocations for instance 22b8ca59-959d-4687-bb7d-4fc7909aa852
Nov 02 17:27:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b3f7c625-169d-4ebb-9e94-2e4f6020e2c1 tempest-TestShelveInstance-1367401440 tempest-TestShelveInstance-1367401440-project-member] Lock "22b8ca59-959d-4687-bb7d-4fc7909aa852" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.280s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:02 user nova-compute[74980]: INFO nova.compute.manager [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Detaching volume 04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb
Nov 02 17:27:02 user nova-compute[74980]: INFO nova.virt.block_device [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Attempting to driver detach volume 04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb from mountpoint /dev/vdb
Nov 02 17:27:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Attempting to detach device vdb from instance 92537376-b06d-4d0f-8ed4-1bc120d080fa from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:27:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:27:02 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:27:02 user nova-compute[74980]:   <source dev="/dev/sde"/>
Nov 02 17:27:02 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:27:02 user nova-compute[74980]:   <serial>04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb</serial>
Nov 02 17:27:02 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:27:02 user nova-compute[74980]: </disk>
Nov 02 17:27:02 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:27:02 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Successfully detached device vdb from instance 92537376-b06d-4d0f-8ed4-1bc120d080fa from the persistent domain config.
Nov 02 17:27:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92537376-b06d-4d0f-8ed4-1bc120d080fa from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:27:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:27:02 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:27:02 user nova-compute[74980]:   <source dev="/dev/sde"/>
Nov 02 17:27:02 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:27:02 user nova-compute[74980]:   <serial>04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb</serial>
Nov 02 17:27:02 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:27:02 user nova-compute[74980]: </disk>
Nov 02 17:27:02 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:27:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92537376-b06d-4d0f-8ed4-1bc120d080fa {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:27:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:27:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:27:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:27:07 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:27:07 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:27:07 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:27:08 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:27:08 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:27:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:08 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:27:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:09 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a89a8f0a-c299-44cb-9fce-8fe5b883f4a0 is timed out.
Nov 02 17:27:09 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Successfully detached device vdb from instance a89a8f0a-c299-44cb-9fce-8fe5b883f4a0 from the live domain config.
Nov 02 17:27:09 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFONdouX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:27:09 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd85c8f-457b-4b7f-9517-790ae2900dd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:27:09 user nova-compute[74980]: No targets found.
Nov 02 17:27:09 user nova-compute[74980]: iSNS:
Nov 02 17:27:09 user nova-compute[74980]: No targets found.
Nov 02 17:27:09 user nova-compute[74980]: STATIC:
Nov 02 17:27:09 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb
Nov 02 17:27:09 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:27:09 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:27:09 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09
Nov 02 17:27:09 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:27:09 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:27:09 user nova-compute[74980]: FIRMWARE:
Nov 02 17:27:09 user nova-compute[74980]: No targets found.
Nov 02 17:27:09 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:27:09 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:27:09 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[32932ff9-4345-4758-82ce-69554a258e71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[498b0eff-c901-4896-821f-75907c1a04e5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:27:09 user nova-compute[74980]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 (non-flash)
Nov 02 17:27:09 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:27:09 user nova-compute[74980]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 (non-flash)
Nov 02 17:27:09 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b47c25f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09'): ({'sdc'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Removing single pathed devices sdc {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ab77fc-557d-4df6-a50e-3ffc5b4a6c19]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3b4fb2-70cf-4a77-a624-867e51c78897]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Flushing IO for device /dev/sdc {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.153s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cd3210-a2d9-45ab-b64d-72a32e10fbfc]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96044d6-ae64-488e-bed9-81e6156de127]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e11099-2acf-42cb-bffe-2af3b29d48d7]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5688421-5ff0-443d-84c7-f9a43b33eda2]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09, portal: 172.16.0.220,3260]
Nov 02 17:27:09 user nova-compute[74980]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09, portal: 172.16.0.220,3260] successful.
Nov 02 17:27:09 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397105af-5088-443d-8dd3-6b000789bd09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[25181566-fb87-4a09-a20d-055688d769b2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] <== disconnect_volume: return (476ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:27:09 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:27:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:12 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:27:12 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:27:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=7867MB free_disk=25.314422607421875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1620c8eb-067c-4156-b927-2f64eac9e340 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance f0eb2644-f721-4a49-834d-16c43ad6d5c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 92537376-b06d-4d0f-8ed4-1bc120d080fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 08309ef4-cf53-47b0-8960-01aba8903030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a89a8f0a-c299-44cb-9fce-8fe5b883f4a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 07bc020d-9394-4327-9c90-9902b7256bf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG nova.objects.instance [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'flavor' on Instance uuid a89a8f0a-c299-44cb-9fce-8fe5b883f4a0 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8374041e-921a-4d0a-ae7c-e57ebb20b1bd tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.469s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:27:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:27:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:27:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:27:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:27:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquiring lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquiring lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:14 user nova-compute[74980]: INFO nova.compute.manager [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Terminating instance
Nov 02 17:27:14 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Didn't find any instances for network info cache update. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-fcc8cfff-4d68-48cf-be03-478d2d736dd0 req-32388fa8-aab8-48e8-818a-6940c0cfa3d3 service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Received event network-vif-unplugged-e48d9f29-5466-428b-b554-01882ec6484a {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fcc8cfff-4d68-48cf-be03-478d2d736dd0 req-32388fa8-aab8-48e8-818a-6940c0cfa3d3 service nova] Acquiring lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fcc8cfff-4d68-48cf-be03-478d2d736dd0 req-32388fa8-aab8-48e8-818a-6940c0cfa3d3 service nova] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fcc8cfff-4d68-48cf-be03-478d2d736dd0 req-32388fa8-aab8-48e8-818a-6940c0cfa3d3 service nova] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-fcc8cfff-4d68-48cf-be03-478d2d736dd0 req-32388fa8-aab8-48e8-818a-6940c0cfa3d3 service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] No waiting events found dispatching network-vif-unplugged-e48d9f29-5466-428b-b554-01882ec6484a {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:27:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-fcc8cfff-4d68-48cf-be03-478d2d736dd0 req-32388fa8-aab8-48e8-818a-6940c0cfa3d3 service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Received event network-vif-unplugged-e48d9f29-5466-428b-b554-01882ec6484a for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:27:15 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Instance destroyed successfully.
Nov 02 17:27:15 user nova-compute[74980]: DEBUG nova.objects.instance [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lazy-loading 'resources' on Instance uuid f0eb2644-f721-4a49-834d-16c43ad6d5c2 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:27:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1772040712',display_name='tempest-TestVolumeSwap-server-1772040712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1772040712',id=17,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQd7w5t+3YkB2W+JRtTysaaf21uU48mHQvxEZN0JzXn2p8A9XxaEnx+YmeuuFOi7YlXhZc9ylcFWJqE5NdjnARgRwJqye2wgVhcvH5iFiACgprMuZ67q+yIRiVTIYfIOw==',key_name='tempest-keypair-450498757',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:23:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18b5c618c10c4d94b1fc6e930e2aa22d',ramdisk_id='',reservation_id='r-tbcw1gxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1151215288',owner_user_name='tempest-TestVolumeSwap-1151215288-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:23:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc7302bfeed466e8140faf81456bb38',uuid=f0eb2644-f721-4a49-834d-16c43ad6d5c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e48d9f29-5466-428b-b554-01882ec6484a", "address": "fa:16:3e:18:4e:03", "network": {"id": "9298cdb9-70a6-400f-8e51-cc4d62b1e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1547217393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18b5c618c10c4d94b1fc6e930e2aa22d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48d9f29-54", "ovs_interfaceid": "e48d9f29-5466-428b-b554-01882ec6484a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:27:15 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Converting VIF {"id": "e48d9f29-5466-428b-b554-01882ec6484a", "address": "fa:16:3e:18:4e:03", "network": {"id": "9298cdb9-70a6-400f-8e51-cc4d62b1e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1547217393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18b5c618c10c4d94b1fc6e930e2aa22d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape48d9f29-54", "ovs_interfaceid": "e48d9f29-5466-428b-b554-01882ec6484a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:27:15 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:4e:03,bridge_name='br-int',has_traffic_filtering=True,id=e48d9f29-5466-428b-b554-01882ec6484a,network=Network(9298cdb9-70a6-400f-8e51-cc4d62b1e98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48d9f29-54') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:27:15 user nova-compute[74980]: DEBUG os_vif [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:4e:03,bridge_name='br-int',has_traffic_filtering=True,id=e48d9f29-5466-428b-b554-01882ec6484a,network=Network(9298cdb9-70a6-400f-8e51-cc4d62b1e98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48d9f29-54') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:27:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape48d9f29-54, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:27:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3dbac2e6-8275-411a-bdec-3ada5dd24279) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:27:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:27:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:15 user nova-compute[74980]: INFO os_vif [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:4e:03,bridge_name='br-int',has_traffic_filtering=True,id=e48d9f29-5466-428b-b554-01882ec6484a,network=Network(9298cdb9-70a6-400f-8e51-cc4d62b1e98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48d9f29-54')
Nov 02 17:27:15 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Deleting instance files /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2_del
Nov 02 17:27:15 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Deletion of /opt/stack/data/nova/instances/f0eb2644-f721-4a49-834d-16c43ad6d5c2_del complete
Nov 02 17:27:15 user nova-compute[74980]: INFO nova.compute.manager [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 02 17:27:15 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:27:15 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:27:15 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:27:16 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:27:16 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Took 0.90 seconds to deallocate network for instance.
Nov 02 17:27:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:16 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:27:16 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:27:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-6c5895db-1f15-4239-9c7b-6c462a51df9a req-3e8d11e8-6413-4e61-b05f-6249629178a1 service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Received event network-vif-plugged-e48d9f29-5466-428b-b554-01882ec6484a {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6c5895db-1f15-4239-9c7b-6c462a51df9a req-3e8d11e8-6413-4e61-b05f-6249629178a1 service nova] Acquiring lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6c5895db-1f15-4239-9c7b-6c462a51df9a req-3e8d11e8-6413-4e61-b05f-6249629178a1 service nova] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6c5895db-1f15-4239-9c7b-6c462a51df9a req-3e8d11e8-6413-4e61-b05f-6249629178a1 service nova] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-6c5895db-1f15-4239-9c7b-6c462a51df9a req-3e8d11e8-6413-4e61-b05f-6249629178a1 service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] No waiting events found dispatching network-vif-plugged-e48d9f29-5466-428b-b554-01882ec6484a {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:27:16 user nova-compute[74980]: WARNING nova.compute.manager [req-6c5895db-1f15-4239-9c7b-6c462a51df9a req-3e8d11e8-6413-4e61-b05f-6249629178a1 service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Received unexpected event network-vif-plugged-e48d9f29-5466-428b-b554-01882ec6484a for instance with vm_state deleted and task_state None.
Nov 02 17:27:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-6c5895db-1f15-4239-9c7b-6c462a51df9a req-3e8d11e8-6413-4e61-b05f-6249629178a1 service nova] [instance: f0eb2644-f721-4a49-834d-16c43ad6d5c2] Received event network-vif-deleted-e48d9f29-5466-428b-b554-01882ec6484a {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:16 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Deleted allocations for instance f0eb2644-f721-4a49-834d-16c43ad6d5c2
Nov 02 17:27:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2d04725f-eaca-41a5-8462-1a3e6614efd5 tempest-TestVolumeSwap-1151215288 tempest-TestVolumeSwap-1151215288-project-member] Lock "f0eb2644-f721-4a49-834d-16c43ad6d5c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.537s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "1620c8eb-067c-4156-b927-2f64eac9e340" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "1620c8eb-067c-4156-b927-2f64eac9e340" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:20 user nova-compute[74980]: INFO nova.compute.manager [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Terminating instance
Nov 02 17:27:20 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG nova.compute.manager [req-84a08095-0f6d-4a2b-aabb-e36f515b5a2b req-4b968576-2164-431d-bf9d-e04c618f2d5d service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received event network-vif-unplugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-84a08095-0f6d-4a2b-aabb-e36f515b5a2b req-4b968576-2164-431d-bf9d-e04c618f2d5d service nova] Acquiring lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-84a08095-0f6d-4a2b-aabb-e36f515b5a2b req-4b968576-2164-431d-bf9d-e04c618f2d5d service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-84a08095-0f6d-4a2b-aabb-e36f515b5a2b req-4b968576-2164-431d-bf9d-e04c618f2d5d service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG nova.compute.manager [req-84a08095-0f6d-4a2b-aabb-e36f515b5a2b req-4b968576-2164-431d-bf9d-e04c618f2d5d service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] No waiting events found dispatching network-vif-unplugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:27:20 user nova-compute[74980]: DEBUG nova.compute.manager [req-84a08095-0f6d-4a2b-aabb-e36f515b5a2b req-4b968576-2164-431d-bf9d-e04c618f2d5d service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received event network-vif-unplugged-a6485d81-59e2-4d5e-a060-fec023852f67 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:27:21 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Instance destroyed successfully.
Nov 02 17:27:21 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lazy-loading 'resources' on Instance uuid 1620c8eb-067c-4156-b927-2f64eac9e340 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:27:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T17:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1941433251',display_name='tempest-ServerActionsTestOtherA-server-65006197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1941433251',id=14,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/deb8PVkUiwTPZyCApz0Xe3J3eB/fIB0znwI8KF8qFCnRXvv+DwW74/YEGmM9BEGg6vomJjKMtQr16Ao4g8wl5z8W+UC6f7SOilkG+sjnacG9QOoRZHmSkFfpcffyx1g==',key_name='tempest-keypair-703289978',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:24:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bb10da584734aedb3d08879a4ffc2b2',ramdisk_id='',reservation_id='r-jetzfw31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-50427258',owner_user_name='tempest-ServerActionsTestOtherA-50427258-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:24:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e61d486aa0bf4b1fb4332aabfa5dafd7',uuid=1620c8eb-067c-4156-b927-2f64eac9e340,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:27:21 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converting VIF {"id": "a6485d81-59e2-4d5e-a060-fec023852f67", "address": "fa:16:3e:2a:60:a9", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6485d81-59", "ovs_interfaceid": "a6485d81-59e2-4d5e-a060-fec023852f67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:27:21 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:60:a9,bridge_name='br-int',has_traffic_filtering=True,id=a6485d81-59e2-4d5e-a060-fec023852f67,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6485d81-59') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:27:21 user nova-compute[74980]: DEBUG os_vif [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:60:a9,bridge_name='br-int',has_traffic_filtering=True,id=a6485d81-59e2-4d5e-a060-fec023852f67,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6485d81-59') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:27:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6485d81-59, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:27:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:27:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bda3211f-4e2f-4a8e-83d7-6b8e7c51a853) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:27:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:27:21 user nova-compute[74980]: INFO os_vif [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:60:a9,bridge_name='br-int',has_traffic_filtering=True,id=a6485d81-59e2-4d5e-a060-fec023852f67,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6485d81-59')
Nov 02 17:27:21 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Deleting instance files /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340_del
Nov 02 17:27:21 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Deletion of /opt/stack/data/nova/instances/1620c8eb-067c-4156-b927-2f64eac9e340_del complete
Nov 02 17:27:21 user nova-compute[74980]: INFO nova.compute.manager [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 02 17:27:21 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:27:21 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:27:21 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:27:22 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:27:22 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Took 1.46 seconds to deallocate network for instance.
Nov 02 17:27:22 user nova-compute[74980]: DEBUG nova.compute.manager [req-7cb6f76a-f314-4013-b386-4ad29a034b02 req-ac43033b-4889-4434-8dfe-b37fd9d94543 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received event network-vif-deleted-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:22 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:27:22 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:27:22 user nova-compute[74980]: DEBUG nova.compute.manager [req-db8809cf-73c7-4f48-90f0-211bd1ec0f4a req-20881967-3190-4dbe-9e48-06f46df4bc09 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received event network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-db8809cf-73c7-4f48-90f0-211bd1ec0f4a req-20881967-3190-4dbe-9e48-06f46df4bc09 service nova] Acquiring lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-db8809cf-73c7-4f48-90f0-211bd1ec0f4a req-20881967-3190-4dbe-9e48-06f46df4bc09 service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-db8809cf-73c7-4f48-90f0-211bd1ec0f4a req-20881967-3190-4dbe-9e48-06f46df4bc09 service nova] Lock "1620c8eb-067c-4156-b927-2f64eac9e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:22 user nova-compute[74980]: DEBUG nova.compute.manager [req-db8809cf-73c7-4f48-90f0-211bd1ec0f4a req-20881967-3190-4dbe-9e48-06f46df4bc09 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] No waiting events found dispatching network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:27:22 user nova-compute[74980]: WARNING nova.compute.manager [req-db8809cf-73c7-4f48-90f0-211bd1ec0f4a req-20881967-3190-4dbe-9e48-06f46df4bc09 service nova] [instance: 1620c8eb-067c-4156-b927-2f64eac9e340] Received unexpected event network-vif-plugged-a6485d81-59e2-4d5e-a060-fec023852f67 for instance with vm_state deleted and task_state None.
Nov 02 17:27:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:22 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Deleted allocations for instance 1620c8eb-067c-4156-b927-2f64eac9e340
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdb4c787-6f19-45a9-981b-e2febccbc71c tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "1620c8eb-067c-4156-b927-2f64eac9e340" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.807s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:23 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 92537376-b06d-4d0f-8ed4-1bc120d080fa is timed out.
Nov 02 17:27:23 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Successfully detached device vdb from instance 92537376-b06d-4d0f-8ed4-1bc120d080fa from the live domain config.
Nov 02 17:27:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjNfBGSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:27:23 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20893f4-dd7c-4820-838b-79897694a0b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:27:23 user nova-compute[74980]: No targets found.
Nov 02 17:27:23 user nova-compute[74980]: iSNS:
Nov 02 17:27:23 user nova-compute[74980]: No targets found.
Nov 02 17:27:23 user nova-compute[74980]: STATIC:
Nov 02 17:27:23 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb
Nov 02 17:27:23 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:27:23 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:27:23 user nova-compute[74980]: FIRMWARE:
Nov 02 17:27:23 user nova-compute[74980]: No targets found.
Nov 02 17:27:23 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:27:23 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:27:23 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eca0ace-ae07-48fb-8f3b-1daf26ad0957]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e501b96e-8cea-49e6-a533-a4fafc04505d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:27:23 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb (non-flash)
Nov 02 17:27:23 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b45d6f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb'): ({'sde'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Removing single pathed devices sde {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d6a48a-a779-4a4d-8524-6a45b70b3f5f]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1f1c6e-4efd-424a-bace-a2cddbeeec56]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Flushing IO for device /dev/sde {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48c60c1-6db9-4932-b1c6-45067a02529f]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fdf434-e1b7-4f46-b60a-601a322fad8e]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] SCSI volumes sde have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fa05db-33e4-462d-95c9-75052bac6aa4]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b4f9ad-8cf4-43a4-b57c-01c3a92e640c]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb, portal: 172.16.0.220,3260]
Nov 02 17:27:23 user nova-compute[74980]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb, portal: 172.16.0.220,3260] successful.
Nov 02 17:27:23 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04fc3ae7-fc52-4db6-aeeb-1a3bed01e9cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dd07b5-fcc0-4b3d-8ea1-1ca9bee18db2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] <== disconnect_volume: return (287ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:27:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:27:24 user nova-compute[74980]: DEBUG nova.objects.instance [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lazy-loading 'flavor' on Instance uuid 92537376-b06d-4d0f-8ed4-1bc120d080fa {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:27:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f397a450-dcf7-4152-aa68-0ae30763e9b6 tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.891s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "08309ef4-cf53-47b0-8960-01aba8903030" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:27 user nova-compute[74980]: DEBUG nova.objects.instance [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lazy-loading 'flavor' on Instance uuid 08309ef4-cf53-47b0-8960-01aba8903030 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:27:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "08309ef4-cf53-47b0-8960-01aba8903030" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "08309ef4-cf53-47b0-8960-01aba8903030" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:28 user nova-compute[74980]: INFO nova.compute.manager [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Attaching volume e82ef809-3d48-410b-830a-39125caea1f1 to /dev/vdb
Nov 02 17:27:28 user nova-compute[74980]: DEBUG os_brick.utils [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[514bdb48-c756-4b1c-9747-73c0ebdd94bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3421158-bf4c-4b25-bb1e-2164ba5c5c29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5e1ef0-4475-4662-89d9-2737ac82cec6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cf915e-1b49-4afa-8f0a-4ed691026ff8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:27:28 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:27:28 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abcfea6-c850-4cfe-8b96-175e06d9528e]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG os_brick.utils [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:27:28 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Updating existing volume attachment record: 44d082c6-8688-4b4a-af4b-7d125893f5fe {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:27:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:39 user nova-compute[74980]: INFO nova.compute.manager [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Terminating instance
Nov 02 17:27:39 user nova-compute[74980]: DEBUG nova.compute.manager [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:27:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:39 user nova-compute[74980]: DEBUG nova.compute.manager [req-e1f97ed9-5312-4204-a8a9-052bb3ff9446 req-150be076-bfe1-4f09-8424-f720162a9f54 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Received event network-vif-unplugged-8f8e5361-7ac7-4f39-9b66-e73a08417745 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e1f97ed9-5312-4204-a8a9-052bb3ff9446 req-150be076-bfe1-4f09-8424-f720162a9f54 service nova] Acquiring lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e1f97ed9-5312-4204-a8a9-052bb3ff9446 req-150be076-bfe1-4f09-8424-f720162a9f54 service nova] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e1f97ed9-5312-4204-a8a9-052bb3ff9446 req-150be076-bfe1-4f09-8424-f720162a9f54 service nova] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:39 user nova-compute[74980]: DEBUG nova.compute.manager [req-e1f97ed9-5312-4204-a8a9-052bb3ff9446 req-150be076-bfe1-4f09-8424-f720162a9f54 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] No waiting events found dispatching network-vif-unplugged-8f8e5361-7ac7-4f39-9b66-e73a08417745 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:27:39 user nova-compute[74980]: DEBUG nova.compute.manager [req-e1f97ed9-5312-4204-a8a9-052bb3ff9446 req-150be076-bfe1-4f09-8424-f720162a9f54 service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Received event network-vif-unplugged-8f8e5361-7ac7-4f39-9b66-e73a08417745 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:27:40 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Instance destroyed successfully.
Nov 02 17:27:40 user nova-compute[74980]: DEBUG nova.objects.instance [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'resources' on Instance uuid a89a8f0a-c299-44cb-9fce-8fe5b883f4a0 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:27:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-556167717',display_name='tempest-AttachVolumeNegativeTest-server-556167717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-556167717',id=20,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/AMGvK8/JbKfEdWi3y/ERn9TP30U1d78nAi0rFQg7ZPYBD1U+Q4Twy65VnyB9ec0BP1FIkINDYvnIThDBxuEzPaXFYGg1Xg8NlnDb4hL1DZxTJLKJ+rLCy1MmWYWqIjA==',key_name='tempest-keypair-178700891',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:24:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b889d98476584bb1b18080bfa0664810',ramdisk_id='',reservation_id='r-84rql0s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1956142060',owner_user_name='tempest-AttachVolumeNegativeTest-1956142060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:24:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a979e164900348beaab104704c92b722',uuid=a89a8f0a-c299-44cb-9fce-8fe5b883f4a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "address": "fa:16:3e:2c:ce:eb", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8e5361-7a", "ovs_interfaceid": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:27:40 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converting VIF {"id": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "address": "fa:16:3e:2c:ce:eb", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8e5361-7a", "ovs_interfaceid": "8f8e5361-7ac7-4f39-9b66-e73a08417745", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:27:40 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:ce:eb,bridge_name='br-int',has_traffic_filtering=True,id=8f8e5361-7ac7-4f39-9b66-e73a08417745,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f8e5361-7a') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:27:40 user nova-compute[74980]: DEBUG os_vif [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:ce:eb,bridge_name='br-int',has_traffic_filtering=True,id=8f8e5361-7ac7-4f39-9b66-e73a08417745,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f8e5361-7a') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:27:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f8e5361-7a, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:27:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:27:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fda102d1-2691-490f-968c-269765300239) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:27:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:27:40 user nova-compute[74980]: INFO os_vif [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:ce:eb,bridge_name='br-int',has_traffic_filtering=True,id=8f8e5361-7ac7-4f39-9b66-e73a08417745,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f8e5361-7a')
Nov 02 17:27:40 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Deleting instance files /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0_del
Nov 02 17:27:40 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Deletion of /opt/stack/data/nova/instances/a89a8f0a-c299-44cb-9fce-8fe5b883f4a0_del complete
Nov 02 17:27:40 user nova-compute[74980]: INFO nova.compute.manager [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 02 17:27:40 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:27:40 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:27:40 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:27:41 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:27:41 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Took 0.86 seconds to deallocate network for instance.
Nov 02 17:27:41 user nova-compute[74980]: DEBUG nova.compute.manager [req-a3a17471-fcaf-4b13-8ac2-ddfea01bd06a req-a2aefc60-0832-4c9d-aca8-c1773171eb3a service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Received event network-vif-deleted-8f8e5361-7ac7-4f39-9b66-e73a08417745 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:41 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:27:41 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:27:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:41 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Deleted allocations for instance a89a8f0a-c299-44cb-9fce-8fe5b883f4a0
Nov 02 17:27:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-080306a9-f55d-4623-98e7-df63b18a227d tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.383s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-9df2461f-ace1-43d5-8d09-8325e1625d29 req-89f6f2dd-9cce-4748-8328-6631028f86eb service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Received event network-vif-plugged-8f8e5361-7ac7-4f39-9b66-e73a08417745 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9df2461f-ace1-43d5-8d09-8325e1625d29 req-89f6f2dd-9cce-4748-8328-6631028f86eb service nova] Acquiring lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9df2461f-ace1-43d5-8d09-8325e1625d29 req-89f6f2dd-9cce-4748-8328-6631028f86eb service nova] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9df2461f-ace1-43d5-8d09-8325e1625d29 req-89f6f2dd-9cce-4748-8328-6631028f86eb service nova] Lock "a89a8f0a-c299-44cb-9fce-8fe5b883f4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-9df2461f-ace1-43d5-8d09-8325e1625d29 req-89f6f2dd-9cce-4748-8328-6631028f86eb service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] No waiting events found dispatching network-vif-plugged-8f8e5361-7ac7-4f39-9b66-e73a08417745 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:27:42 user nova-compute[74980]: WARNING nova.compute.manager [req-9df2461f-ace1-43d5-8d09-8325e1625d29 req-89f6f2dd-9cce-4748-8328-6631028f86eb service nova] [instance: a89a8f0a-c299-44cb-9fce-8fe5b883f4a0] Received unexpected event network-vif-plugged-8f8e5361-7ac7-4f39-9b66-e73a08417745 for instance with vm_state deleted and task_state None.
Nov 02 17:27:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:27:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHwJlMvX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:27:47 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:27:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:27:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:27:47 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:27:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:27:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:27:47 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:27:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f04b513-12f3-4f10-a394-361c48e3cfe8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:27:47 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a03d03a-a084-4164-a3e9-a1af0bb7bd7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1] added
Nov 02 17:27:47 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.077s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[745721e8-e7d1-40e8-88a2-4c5e7844499a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6de927-c2e0-4e08-8408-0bd9ec99ad26]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yHwJlMvX {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yHwJlMvX" returned: 0 in 0.137s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee2cdf9-9de2-467a-8ea1-cdfe9ad8bb4e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yHwJlMvX'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a951f481-e968-412d-9b77-6d1f87cb1240]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9a6f55-b878-4a1f-a0e3-95aa08c65ef8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:27:48 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:27:48 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:27:48 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 17:27:48 user nova-compute[74980]: 
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[464e4805-d6ea-4d8e-9440-e95df317476d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1, portal: 172.16.0.220,3260]
Nov 02 17:27:48 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1, portal: 172.16.0.220,3260] successful.
Nov 02 17:27:48 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.058s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6fa450-e4e0-450e-9a5c-15a0b0ca5ad6]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7c4a60-2015-408f-ac49-11de8f2db2b5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:27:48 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:27:48 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.484s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2e932d-52d1-4204-b44f-cb76ec2ab9d3]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:48 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:27:49 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:27:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHwJlMvX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:27:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.516s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:27:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] <== connect_volume: return (1518ms) {'type': 'block', 'scsi_wwn': '26535343061356634', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:27:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535343061356634', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:27:49 user nova-compute[74980]: DEBUG nova.objects.instance [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lazy-loading 'flavor' on Instance uuid 08309ef4-cf53-47b0-8960-01aba8903030 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:27:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:27:49 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:27:49 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:27:49 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:27:49 user nova-compute[74980]:   <serial>e82ef809-3d48-410b-830a-39125caea1f1</serial>
Nov 02 17:27:49 user nova-compute[74980]: </disk>
Nov 02 17:27:49 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:27:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:27:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:27:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] No VIF found with MAC fa:16:3e:c6:19:cf, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:27:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c1924606-558e-47e6-bfe7-d0bd937d489b tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "08309ef4-cf53-47b0-8960-01aba8903030" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.908s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:27:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:27:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:27:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:27:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:51 user nova-compute[74980]: INFO nova.compute.manager [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Rescuing
Nov 02 17:27:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:27:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquired lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:27:51 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:27:51 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Updating instance_info_cache with network_info: [{"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:27:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Releasing lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:27:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-cdcbd3da-8d91-4ee7-a883-5cc764817ebc req-379c437b-fbc3-40c9-bcac-103eb3213bd4 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-vif-unplugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-cdcbd3da-8d91-4ee7-a883-5cc764817ebc req-379c437b-fbc3-40c9-bcac-103eb3213bd4 service nova] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-cdcbd3da-8d91-4ee7-a883-5cc764817ebc req-379c437b-fbc3-40c9-bcac-103eb3213bd4 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-cdcbd3da-8d91-4ee7-a883-5cc764817ebc req-379c437b-fbc3-40c9-bcac-103eb3213bd4 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-cdcbd3da-8d91-4ee7-a883-5cc764817ebc req-379c437b-fbc3-40c9-bcac-103eb3213bd4 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] No waiting events found dispatching network-vif-unplugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:27:52 user nova-compute[74980]: WARNING nova.compute.manager [req-cdcbd3da-8d91-4ee7-a883-5cc764817ebc req-379c437b-fbc3-40c9-bcac-103eb3213bd4 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received unexpected event network-vif-unplugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc for instance with vm_state active and task_state rescuing.
Nov 02 17:27:52 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Instance destroyed successfully.
Nov 02 17:27:52 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Attempting a stable device rescue
Nov 02 17:27:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74980) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 17:27:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Instance directory exists: not creating {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 17:27:52 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Creating image(s)
Nov 02 17:27:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "/opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "/opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "/opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:52 user nova-compute[74980]: DEBUG nova.objects.instance [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lazy-loading 'trusted_certs' on Instance uuid 08309ef4-cf53-47b0-8960-01aba8903030 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:27:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3.part --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "92537376-b06d-4d0f-8ed4-1bc120d080fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:53 user nova-compute[74980]: INFO nova.compute.manager [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Terminating instance
Nov 02 17:27:53 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:27:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3.part --force-share --output=json" returned: 0 in 0.222s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.images [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] d2d7b3bb-1e06-40d3-a94c-0ccaf9ea4c20 was qcow2, converting to raw {{(pid=74980) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3.part /opt/stack/data/nova/instances/_base/7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3.converted {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3.part /opt/stack/data/nova/instances/_base/7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3.converted" returned: 0 in 0.270s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3.converted --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-e560213f-1bdb-4528-8b83-4c78ee3c1831 req-cd3f7090-264a-4c2f-a812-f1bdeacfc673 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e560213f-1bdb-4528-8b83-4c78ee3c1831 req-cd3f7090-264a-4c2f-a812-f1bdeacfc673 service nova] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e560213f-1bdb-4528-8b83-4c78ee3c1831 req-cd3f7090-264a-4c2f-a812-f1bdeacfc673 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e560213f-1bdb-4528-8b83-4c78ee3c1831 req-cd3f7090-264a-4c2f-a812-f1bdeacfc673 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-e560213f-1bdb-4528-8b83-4c78ee3c1831 req-cd3f7090-264a-4c2f-a812-f1bdeacfc673 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] No waiting events found dispatching network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:27:54 user nova-compute[74980]: WARNING nova.compute.manager [req-e560213f-1bdb-4528-8b83-4c78ee3c1831 req-cd3f7090-264a-4c2f-a812-f1bdeacfc673 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received unexpected event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc for instance with vm_state active and task_state rescuing.
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-e560213f-1bdb-4528-8b83-4c78ee3c1831 req-cd3f7090-264a-4c2f-a812-f1bdeacfc673 service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Received event network-vif-unplugged-c9faccea-2597-44e1-9c1e-fb360771d4f2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e560213f-1bdb-4528-8b83-4c78ee3c1831 req-cd3f7090-264a-4c2f-a812-f1bdeacfc673 service nova] Acquiring lock "92537376-b06d-4d0f-8ed4-1bc120d080fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e560213f-1bdb-4528-8b83-4c78ee3c1831 req-cd3f7090-264a-4c2f-a812-f1bdeacfc673 service nova] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e560213f-1bdb-4528-8b83-4c78ee3c1831 req-cd3f7090-264a-4c2f-a812-f1bdeacfc673 service nova] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-e560213f-1bdb-4528-8b83-4c78ee3c1831 req-cd3f7090-264a-4c2f-a812-f1bdeacfc673 service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] No waiting events found dispatching network-vif-unplugged-c9faccea-2597-44e1-9c1e-fb360771d4f2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-e560213f-1bdb-4528-8b83-4c78ee3c1831 req-cd3f7090-264a-4c2f-a812-f1bdeacfc673 service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Received event network-vif-unplugged-c9faccea-2597-44e1-9c1e-fb360771d4f2 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.744s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3 --force-share --output=json" returned: 0 in 0.191s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3,backing_fmt=raw /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.rescue {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:54 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Instance destroyed successfully.
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.objects.instance [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lazy-loading 'resources' on Instance uuid 92537376-b06d-4d0f-8ed4-1bc120d080fa {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3,backing_fmt=raw /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.rescue" returned: 0 in 0.052s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.objects.instance [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lazy-loading 'migration_context' on Instance uuid 08309ef4-cf53-47b0-8960-01aba8903030 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-282379696',display_name='tempest-TestServerVolumeAttachmentScenario-server-282379696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-282379696',id=18,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNo8yZv4iN4Q4ci8XtFwAzUXsA0aYX267UX7ji2N1VKKJ7SGWxH+ZVOSjeRr9xYc2y7srN+RPpwd5zkbNqxvs7VsdbBYnX3rBwnfRAxCsFv0bK2bMx4syE/XHALOERIuQQ==',key_name='tempest-keypair-1723110345',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:23:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bc86ed5ca134f9190da6755ca033390',ramdisk_id='',reservation_id='r-p1w7qfan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-540307316',owner_user_name='tempest-TestServerVolumeAttachmentScenario-540307316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:23:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee158ffa58d34048962d6b6b788a1fe3',uuid=92537376-b06d-4d0f-8ed4-1bc120d080fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "address": "fa:16:3e:fb:1d:72", "network": {"id": "01828aab-5bfd-42d5-a90c-b21706d46887", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1553292420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc86ed5ca134f9190da6755ca033390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9faccea-25", "ovs_interfaceid": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Converting VIF {"id": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "address": "fa:16:3e:fb:1d:72", "network": {"id": "01828aab-5bfd-42d5-a90c-b21706d46887", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1553292420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bc86ed5ca134f9190da6755ca033390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9faccea-25", "ovs_interfaceid": "c9faccea-2597-44e1-9c1e-fb360771d4f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:1d:72,bridge_name='br-int',has_traffic_filtering=True,id=c9faccea-2597-44e1-9c1e-fb360771d4f2,network=Network(01828aab-5bfd-42d5-a90c-b21706d46887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9faccea-25') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG os_vif [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:1d:72,bridge_name='br-int',has_traffic_filtering=True,id=c9faccea-2597-44e1-9c1e-fb360771d4f2,network=Network(01828aab-5bfd-42d5-a90c-b21706d46887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9faccea-25') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.objects.base [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Object Instance<08309ef4-cf53-47b0-8960-01aba8903030> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Start _get_guest_xml network_info=[{"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "vif_mac": "fa:16:3e:c6:19:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd2d7b3bb-1e06-40d3-a94c-0ccaf9ea4c20', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHwJlMvX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '08309ef4-cf53-47b0-8960-01aba8903030', 'attached_at': '', 'detached_at': '', 'volume_id': 'e82ef809-3d48-410b-830a-39125caea1f1', 'serial': 'e82ef809-3d48-410b-830a-39125caea1f1'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '44d082c6-8688-4b4a-af4b-7d125893f5fe', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.objects.instance [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lazy-loading 'resources' on Instance uuid 08309ef4-cf53-47b0-8960-01aba8903030 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9faccea-25, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.objects.base [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Object Instance<08309ef4-cf53-47b0-8960-01aba8903030> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.objects.instance [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lazy-loading 'numa_topology' on Instance uuid 08309ef4-cf53-47b0-8960-01aba8903030 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0b9bde9-35ba-495f-b4f5-9cae55f57c11) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.objects.base [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Object Instance<08309ef4-cf53-47b0-8960-01aba8903030> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:27:54 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:27:54 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:27:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:54 user nova-compute[74980]: INFO os_vif [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:1d:72,bridge_name='br-int',has_traffic_filtering=True,id=c9faccea-2597-44e1-9c1e-fb360771d4f2,network=Network(01828aab-5bfd-42d5-a90c-b21706d46887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9faccea-25')
Nov 02 17:27:54 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Deleting instance files /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa_del
Nov 02 17:27:54 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Deletion of /opt/stack/data/nova/instances/92537376-b06d-4d0f-8ed4-1bc120d080fa_del complete
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.objects.instance [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lazy-loading 'vcpu_model' on Instance uuid 08309ef4-cf53-47b0-8960-01aba8903030 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.objects.base [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Object Instance<08309ef4-cf53-47b0-8960-01aba8903030> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHwJlMvX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:27:54 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:27:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:27:54 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:27:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:27:54 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:54 user nova-compute[74980]: INFO nova.compute.manager [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b55b66e-7dc5-4d12-8b02-f21f86101e9d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = yHwJlMvX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 02 17:27:54 user nova-compute[74980]: node.name = iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1
Nov 02 17:27:54 user nova-compute[74980]: node.tpgt = -1
Nov 02 17:27:54 user nova-compute[74980]: node.startup = automatic
Nov 02 17:27:54 user nova-compute[74980]: node.leading_login = No
Nov 02 17:27:54 user nova-compute[74980]: iface.iscsi_ifacename = default
Nov 02 17:27:54 user nova-compute[74980]: iface.net_ifacename = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.ipaddress = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.prefix_len = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.hwaddress = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.transport_name = tcp
Nov 02 17:27:54 user nova-compute[74980]: iface.initiatorname = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.state = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.vlan_id = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.vlan_priority = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.vlan_state = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.iface_num = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.mtu = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.port = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.bootproto = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.subnet_mask = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.gateway = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.dhcp_alt_client_id_state = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.dhcp_alt_client_id = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.dhcp_dns = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.dhcp_learn_iqn = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.dhcp_req_vendor_id_state = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.dhcp_vendor_id_state = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.dhcp_vendor_id = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.dhcp_slp_da = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.fragmentation = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.gratuitous_arp = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.incoming_forwarding = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.tos_state = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.tos = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.ttl = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.delayed_ack = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.tcp_nagle = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.tcp_wsf_state = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.tcp_wsf = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.tcp_timer_scale = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.tcp_timestamp = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.redirect = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.def_task_mgmt_timeout = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.header_digest = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.data_digest = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.immediate_data = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.initial_r2t = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.data_seq_inorder = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.data_pdu_inorder = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.erl = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.max_receive_data_len = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.first_burst_len = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.max_outstanding_r2t = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.max_burst_len = 0
Nov 02 17:27:54 user nova-compute[74980]: iface.chap_auth = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.bidi_chap = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.strict_login_compliance = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.discovery_auth = <empty>
Nov 02 17:27:54 user nova-compute[74980]: iface.discovery_logout = <empty>
Nov 02 17:27:54 user nova-compute[74980]: node.discovery_address = <empty>
Nov 02 17:27:54 user nova-compute[74980]: node.discovery_port = 0
Nov 02 17:27:54 user nova-compute[74980]: node.discovery_type = static
Nov 02 17:27:54 user nova-compute[74980]: node.session.initial_cmdsn = 0
Nov 02 17:27:54 user nova-compute[74980]: node.session.initial_login_retry_max = 8
Nov 02 17:27:54 user nova-compute[74980]: node.session.xmit_thread_priority = -20
Nov 02 17:27:54 user nova-compute[74980]: node.session.cmds_max = 128
Nov 02 17:27:54 user nova-compute[74980]: node.session.queue_depth = 32
Nov 02 17:27:54 user nova-compute[74980]: node.session.nr_sessions = 1
Nov 02 17:27:54 user nova-compute[74980]: node.session.auth.authmethod = CHAP
Nov 02 17:27:54 user nova-compute[74980]: node.session.auth.username = yHwJlMvX
Nov 02 17:27:54 user nova-compute[74980]: node.session.auth.password = ***
Nov 02 17:27:54 user nova-compute[74980]: node.session.auth.username_in = <empty>
Nov 02 17:27:54 user nova-compute[74980]: node.session.auth.password_in = <empty>
Nov 02 17:27:54 user nova-compute[74980]: node.session.auth.chap_algs = MD5
Nov 02 17:27:54 user nova-compute[74980]: node.session.timeo.replacement_timeout = 120
Nov 02 17:27:54 user nova-compute[74980]: node.session.err_timeo.abort_timeout = 15
Nov 02 17:27:54 user nova-compute[74980]: node.session.err_timeo.lu_reset_timeout = 30
Nov 02 17:27:54 user nova-compute[74980]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 02 17:27:54 user nova-compute[74980]: node.session.err_timeo.host_reset_timeout = 60
Nov 02 17:27:54 user nova-compute[74980]: node.session.iscsi.FastAbort = Yes
Nov 02 17:27:54 user nova-compute[74980]: node.session.iscsi.InitialR2T = No
Nov 02 17:27:54 user nova-compute[74980]: node.session.iscsi.ImmediateData = Yes
Nov 02 17:27:54 user nova-compute[74980]: node.session.iscsi.FirstBurstLength = 262144
Nov 02 17:27:54 user nova-compute[74980]: node.session.iscsi.MaxBurstLength = 16776192
Nov 02 17:27:54 user nova-compute[74980]: node.session.iscsi.DefaultTime2Retain = 0
Nov 02 17:27:54 user nova-compute[74980]: node.session.iscsi.DefaultTime2Wait = 2
Nov 02 17:27:54 user nova-compute[74980]: node.session.iscsi.MaxConnections = 1
Nov 02 17:27:54 user nova-compute[74980]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 02 17:27:54 user nova-compute[74980]: node.session.iscsi.ERL = 0
Nov 02 17:27:54 user nova-compute[74980]: node.session.scan = manual
Nov 02 17:27:54 user nova-compute[74980]: node.session.reopen_max = 0
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].address = 172.16.0.220
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].port = 3260
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].startup = manual
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].tcp.window_size = 524288
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].tcp.type_of_service = 0
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].timeo.logout_timeout = 15
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].timeo.login_timeout = 15
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].timeo.auth_timeout = 45
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].timeo.noop_out_interval = 5
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].timeo.noop_out_timeout = 5
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].iscsi.HeaderDigest = None
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].iscsi.DataDigest = None
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].iscsi.IFMarker = No
Nov 02 17:27:54 user nova-compute[74980]: node.conn[0].iscsi.OFMarker = No
Nov 02 17:27:54 user nova-compute[74980]: # END RECORD
Nov 02 17:27:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f940b345-215d-4f32-904e-16635e77faf9]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ee4724-d9cf-405c-bd7c-6203295b71f1]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yHwJlMvX {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yHwJlMvX" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[39eb79cd-42b4-416d-b30b-734256d974aa]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yHwJlMvX'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c8dbc6-f2f7-4b03-a63d-da713a8e20fd]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eea823c-4115-4f5f-94fc-97856965caf3]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:27:55 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:27:55 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.156s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] HCTL ('33', '0', '0', 0) found on session 24 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffa7549-4290-42b5-8221-9cd0c87cf8a5]: (4, ('0 0 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Searching for a device in session 24 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHwJlMvX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.188s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] <== connect_volume: return (190ms) {'type': 'block', 'scsi_wwn': '26535343061356634', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535343061356634', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:23:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1380814959',display_name='tempest-ServerStableDeviceRescueTest-server-1380814959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1380814959',id=19,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbrZDVDF9WyskaiAHzOeYQPSBGf4ej2VA+399a6ly1594uUr7g7/LcK5OWhmyhR11uj6Xtpiag80/HJmX16EEfFuhlDjN9qlotT6SxweN3ezOBWJHHLcUs9aH5CmfDGyw==',key_name='tempest-keypair-763038001',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:23:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fdd7d89a7e24ebab57bc95cc888fdf1',ramdisk_id='',reservation_id='r-nodh1jeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-101974758',owner_user_name='tempest-ServerStableDeviceRescueTest-101974758-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2213678ccb5047c5a679917c61a1bc69',uuid=08309ef4-cf53-47b0-8960-01aba8903030,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "vif_mac": "fa:16:3e:c6:19:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Converting VIF {"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "vif_mac": "fa:16:3e:c6:19:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:19:cf,bridge_name='br-int',has_traffic_filtering=True,id=fe9b054a-bbfc-457c-86bf-dede3bb2c8dc,network=Network(2ee0006d-76b0-42e6-b47f-ab9804e4c021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9b054a-bb') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG nova.objects.instance [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lazy-loading 'pci_devices' on Instance uuid 08309ef4-cf53-47b0-8960-01aba8903030 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG nova.objects.base [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Object Instance<08309ef4-cf53-47b0-8960-01aba8903030> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:27:55 user nova-compute[74980]:   <uuid>08309ef4-cf53-47b0-8960-01aba8903030</uuid>
Nov 02 17:27:55 user nova-compute[74980]:   <name>instance-00000013</name>
Nov 02 17:27:55 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:27:55 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:27:55 user nova-compute[74980]:   <metadata>
Nov 02 17:27:55 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:27:55 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:27:55 user nova-compute[74980]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1380814959</nova:name>
Nov 02 17:27:55 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:27:54</nova:creationTime>
Nov 02 17:27:55 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:27:55 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:27:55 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:27:55 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:27:55 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:27:55 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:27:55 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:27:55 user nova-compute[74980]:       <nova:owner>
Nov 02 17:27:55 user nova-compute[74980]:         <nova:user uuid="2213678ccb5047c5a679917c61a1bc69">tempest-ServerStableDeviceRescueTest-101974758-project-member</nova:user>
Nov 02 17:27:55 user nova-compute[74980]:         <nova:project uuid="0fdd7d89a7e24ebab57bc95cc888fdf1">tempest-ServerStableDeviceRescueTest-101974758</nova:project>
Nov 02 17:27:55 user nova-compute[74980]:       </nova:owner>
Nov 02 17:27:55 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:27:55 user nova-compute[74980]:       <nova:ports>
Nov 02 17:27:55 user nova-compute[74980]:         <nova:port uuid="fe9b054a-bbfc-457c-86bf-dede3bb2c8dc">
Nov 02 17:27:55 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 17:27:55 user nova-compute[74980]:         </nova:port>
Nov 02 17:27:55 user nova-compute[74980]:       </nova:ports>
Nov 02 17:27:55 user nova-compute[74980]:     </nova:instance>
Nov 02 17:27:55 user nova-compute[74980]:   </metadata>
Nov 02 17:27:55 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:27:55 user nova-compute[74980]:     <system>
Nov 02 17:27:55 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:27:55 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:27:55 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:27:55 user nova-compute[74980]:       <entry name="serial">08309ef4-cf53-47b0-8960-01aba8903030</entry>
Nov 02 17:27:55 user nova-compute[74980]:       <entry name="uuid">08309ef4-cf53-47b0-8960-01aba8903030</entry>
Nov 02 17:27:55 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:27:55 user nova-compute[74980]:     </system>
Nov 02 17:27:55 user nova-compute[74980]:   </sysinfo>
Nov 02 17:27:55 user nova-compute[74980]:   <os>
Nov 02 17:27:55 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:27:55 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:27:55 user nova-compute[74980]:   </os>
Nov 02 17:27:55 user nova-compute[74980]:   <features>
Nov 02 17:27:55 user nova-compute[74980]:     <acpi/>
Nov 02 17:27:55 user nova-compute[74980]:     <apic/>
Nov 02 17:27:55 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:27:55 user nova-compute[74980]:   </features>
Nov 02 17:27:55 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:27:55 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:27:55 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:27:55 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:27:55 user nova-compute[74980]:   </clock>
Nov 02 17:27:55 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:27:55 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:27:55 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:27:55 user nova-compute[74980]:   </cpu>
Nov 02 17:27:55 user nova-compute[74980]:   <devices>
Nov 02 17:27:55 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:27:55 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:27:55 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk"/>
Nov 02 17:27:55 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:27:55 user nova-compute[74980]:     </disk>
Nov 02 17:27:55 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:27:55 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:27:55 user nova-compute[74980]:       <source dev="/dev/sdb"/>
Nov 02 17:27:55 user nova-compute[74980]:       <target dev="vdb" bus="virtio"/>
Nov 02 17:27:55 user nova-compute[74980]:       <serial>e82ef809-3d48-410b-830a-39125caea1f1</serial>
Nov 02 17:27:55 user nova-compute[74980]:     </disk>
Nov 02 17:27:55 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:27:55 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:27:55 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.rescue"/>
Nov 02 17:27:55 user nova-compute[74980]:       <target dev="vdc" bus="virtio"/>
Nov 02 17:27:55 user nova-compute[74980]:       <boot order="1"/>
Nov 02 17:27:55 user nova-compute[74980]:     </disk>
Nov 02 17:27:55 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:27:55 user nova-compute[74980]:       <mac address="fa:16:3e:c6:19:cf"/>
Nov 02 17:27:55 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:27:55 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:27:55 user nova-compute[74980]:       <target dev="tapfe9b054a-bb"/>
Nov 02 17:27:55 user nova-compute[74980]:     </interface>
Nov 02 17:27:55 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:27:55 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/console.log" append="off"/>
Nov 02 17:27:55 user nova-compute[74980]:     </serial>
Nov 02 17:27:55 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:27:55 user nova-compute[74980]:     <video>
Nov 02 17:27:55 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:27:55 user nova-compute[74980]:     </video>
Nov 02 17:27:55 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:27:55 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:27:55 user nova-compute[74980]:     </rng>
Nov 02 17:27:55 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:27:55 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:27:55 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:27:55 user nova-compute[74980]:     </memballoon>
Nov 02 17:27:55 user nova-compute[74980]:   </devices>
Nov 02 17:27:55 user nova-compute[74980]: </domain>
Nov 02 17:27:55 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:27:55 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Instance destroyed successfully.
Nov 02 17:27:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] No VIF found with MAC fa:16:3e:c6:19:cf, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:27:55 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Took 0.88 seconds to deallocate network for instance.
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:56 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:27:56 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:27:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:56 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Deleted allocations for instance 92537376-b06d-4d0f-8ed4-1bc120d080fa
Nov 02 17:27:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1c73990c-0409-4943-838b-5c38b163f07e tempest-TestServerVolumeAttachmentScenario-540307316 tempest-TestServerVolumeAttachmentScenario-540307316-project-member] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.480s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-07a4ec79-b634-40a1-9fe1-4d6f394978be req-51878589-3b03-4be8-bed2-3a2043f5fbd8 service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Received event network-vif-plugged-c9faccea-2597-44e1-9c1e-fb360771d4f2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-07a4ec79-b634-40a1-9fe1-4d6f394978be req-51878589-3b03-4be8-bed2-3a2043f5fbd8 service nova] Acquiring lock "92537376-b06d-4d0f-8ed4-1bc120d080fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-07a4ec79-b634-40a1-9fe1-4d6f394978be req-51878589-3b03-4be8-bed2-3a2043f5fbd8 service nova] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-07a4ec79-b634-40a1-9fe1-4d6f394978be req-51878589-3b03-4be8-bed2-3a2043f5fbd8 service nova] Lock "92537376-b06d-4d0f-8ed4-1bc120d080fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-07a4ec79-b634-40a1-9fe1-4d6f394978be req-51878589-3b03-4be8-bed2-3a2043f5fbd8 service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] No waiting events found dispatching network-vif-plugged-c9faccea-2597-44e1-9c1e-fb360771d4f2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:27:56 user nova-compute[74980]: WARNING nova.compute.manager [req-07a4ec79-b634-40a1-9fe1-4d6f394978be req-51878589-3b03-4be8-bed2-3a2043f5fbd8 service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Received unexpected event network-vif-plugged-c9faccea-2597-44e1-9c1e-fb360771d4f2 for instance with vm_state deleted and task_state None.
Nov 02 17:27:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-07a4ec79-b634-40a1-9fe1-4d6f394978be req-51878589-3b03-4be8-bed2-3a2043f5fbd8 service nova] [instance: 92537376-b06d-4d0f-8ed4-1bc120d080fa] Received event network-vif-deleted-c9faccea-2597-44e1-9c1e-fb360771d4f2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-40b1cf95-f582-4842-9390-0697d2b37f3a req-f866bb4d-bb19-400e-b760-5e528f087050 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-40b1cf95-f582-4842-9390-0697d2b37f3a req-f866bb4d-bb19-400e-b760-5e528f087050 service nova] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-40b1cf95-f582-4842-9390-0697d2b37f3a req-f866bb4d-bb19-400e-b760-5e528f087050 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-40b1cf95-f582-4842-9390-0697d2b37f3a req-f866bb4d-bb19-400e-b760-5e528f087050 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-40b1cf95-f582-4842-9390-0697d2b37f3a req-f866bb4d-bb19-400e-b760-5e528f087050 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] No waiting events found dispatching network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:27:58 user nova-compute[74980]: WARNING nova.compute.manager [req-40b1cf95-f582-4842-9390-0697d2b37f3a req-f866bb4d-bb19-400e-b760-5e528f087050 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received unexpected event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc for instance with vm_state active and task_state rescuing.
Nov 02 17:27:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-40b1cf95-f582-4842-9390-0697d2b37f3a req-f866bb4d-bb19-400e-b760-5e528f087050 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:27:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-40b1cf95-f582-4842-9390-0697d2b37f3a req-f866bb4d-bb19-400e-b760-5e528f087050 service nova] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-40b1cf95-f582-4842-9390-0697d2b37f3a req-f866bb4d-bb19-400e-b760-5e528f087050 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-40b1cf95-f582-4842-9390-0697d2b37f3a req-f866bb4d-bb19-400e-b760-5e528f087050 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-40b1cf95-f582-4842-9390-0697d2b37f3a req-f866bb4d-bb19-400e-b760-5e528f087050 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] No waiting events found dispatching network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:27:58 user nova-compute[74980]: WARNING nova.compute.manager [req-40b1cf95-f582-4842-9390-0697d2b37f3a req-f866bb4d-bb19-400e-b760-5e528f087050 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received unexpected event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc for instance with vm_state active and task_state rescuing.
Nov 02 17:27:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Acquiring lock "07bc020d-9394-4327-9c90-9902b7256bf9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "07bc020d-9394-4327-9c90-9902b7256bf9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:58 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lazy-loading 'flavor' on Instance uuid 07bc020d-9394-4327-9c90-9902b7256bf9 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:27:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "07bc020d-9394-4327-9c90-9902b7256bf9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Acquiring lock "07bc020d-9394-4327-9c90-9902b7256bf9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "07bc020d-9394-4327-9c90-9902b7256bf9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:27:59 user nova-compute[74980]: INFO nova.compute.manager [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Attaching volume 7d5476cf-3d43-41fb-b5c9-417f44309fda to /dev/vdb
Nov 02 17:27:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG os_brick.utils [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad96c32-a9d3-44ae-be31-151b0ef02eec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa147c2-1ac4-489f-9707-78cba69f5300]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4258d86c-f035-4d6d-8345-7908751f57dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeed2bb-1b1e-4d0d-a2f9-41039f058b0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:27:59 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:27:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b67fd6-bc2e-43f5-810c-ab281e3b4cca]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG os_brick.utils [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Updating existing volume attachment record: 7bc76694-2f5b-417e-b301-d21cf730f01d {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2598e914-0c67-4c8d-b9bd-9906ea6fccec tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:27:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:02 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:28:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:28:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 17:28:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] There are 0 instances to clean {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 17:28:04 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:28:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:28:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:28:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:28:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:28:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:28:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:28:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:28:08 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:28:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:28:09 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:28:09 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:28:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:28:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:28:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 17:28:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:28:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:28:10 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:28:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:28:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updating instance_info_cache with network_info: [{"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:28:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:28:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:28:11 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:28:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:28:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:28:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:28:11 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:28:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:28:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:13 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:28:13 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:28:13 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8348MB free_disk=25.310379028320312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:28:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:28:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:28:13 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 08309ef4-cf53-47b0-8960-01aba8903030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 07bc020d-9394-4327-9c90-9902b7256bf9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing inventories for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating ProviderTree inventory for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating inventory in ProviderTree for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing aggregate associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, aggregates: None {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing trait associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.765s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:28:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:19 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:28:19 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74980) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 17:28:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:28:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcJFEkDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:28:21 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:28:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:28:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:28:21 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:28:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:28:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:28:21 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:28:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f1ed88-8744-4aad-b8c5-1a115421caa0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:28:21 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:28:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d1e57a-69d7-46e9-9921-4a87bd57e143]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda] added
Nov 02 17:28:22 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[94653466-f2f7-40d2-a5fe-bc7ff5606a82]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbffa0a1-6e86-4f28-a773-979346aad1af]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcJFEkDm {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcJFEkDm" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[476ea790-abee-4d8d-876e-32317b35df88]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tcJFEkDm'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f00694c-9aef-4dc7-92a2-b9e6b3d2ad36]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd050bb9-6b5b-4111-a9c4-e7acb860ae1e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:28:22 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:28:22 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[721922da-743b-419f-aae4-4a8882d6a1c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda, portal: 172.16.0.220,3260]
Nov 02 17:28:22 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda, portal: 172.16.0.220,3260] successful.
Nov 02 17:28:22 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5966c4b5-e56c-45b4-8d48-d644f8a02534]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3819fd06-0a70-4b78-bcb6-90c427bac034]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:28:22 user nova-compute[74980]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda (non-flash)
Nov 02 17:28:22 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:28:22 user nova-compute[74980]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda (non-flash)
Nov 02 17:28:22 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7100450-b280-4568-a5f7-44929ee3f657]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:28:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcJFEkDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:28:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:28:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23565613765643737', 'path': '/dev/sdc'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:28:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565613765643737', 'path': '/dev/sdc'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:28:23 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lazy-loading 'flavor' on Instance uuid 07bc020d-9394-4327-9c90-9902b7256bf9 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:28:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:28:23 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:28:23 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:28:23 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:28:23 user nova-compute[74980]:   <serial>7d5476cf-3d43-41fb-b5c9-417f44309fda</serial>
Nov 02 17:28:23 user nova-compute[74980]: </disk>
Nov 02 17:28:23 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:28:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:28:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:28:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] No VIF found with MAC fa:16:3e:11:c5:b4, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:28:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0cb7b47-e99c-4bcf-881a-98d83861a21e tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "07bc020d-9394-4327-9c90-9902b7256bf9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.872s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Acquiring lock "07bc020d-9394-4327-9c90-9902b7256bf9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "07bc020d-9394-4327-9c90-9902b7256bf9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Acquiring lock "07bc020d-9394-4327-9c90-9902b7256bf9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "07bc020d-9394-4327-9c90-9902b7256bf9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "07bc020d-9394-4327-9c90-9902b7256bf9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:28:24 user nova-compute[74980]: INFO nova.compute.manager [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Terminating instance
Nov 02 17:28:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-7ecd1e84-55bb-437e-a56b-2f21c8c80c35 req-6e9d0b7a-dd3e-4d78-9295-93593f802026 service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Received event network-vif-unplugged-3f505851-98d3-4b75-b946-c3ed7e4267e2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7ecd1e84-55bb-437e-a56b-2f21c8c80c35 req-6e9d0b7a-dd3e-4d78-9295-93593f802026 service nova] Acquiring lock "07bc020d-9394-4327-9c90-9902b7256bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7ecd1e84-55bb-437e-a56b-2f21c8c80c35 req-6e9d0b7a-dd3e-4d78-9295-93593f802026 service nova] Lock "07bc020d-9394-4327-9c90-9902b7256bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7ecd1e84-55bb-437e-a56b-2f21c8c80c35 req-6e9d0b7a-dd3e-4d78-9295-93593f802026 service nova] Lock "07bc020d-9394-4327-9c90-9902b7256bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-7ecd1e84-55bb-437e-a56b-2f21c8c80c35 req-6e9d0b7a-dd3e-4d78-9295-93593f802026 service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] No waiting events found dispatching network-vif-unplugged-3f505851-98d3-4b75-b946-c3ed7e4267e2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-7ecd1e84-55bb-437e-a56b-2f21c8c80c35 req-6e9d0b7a-dd3e-4d78-9295-93593f802026 service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Received event network-vif-unplugged-3f505851-98d3-4b75-b946-c3ed7e4267e2 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:28:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:25 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Instance destroyed successfully.
Nov 02 17:28:25 user nova-compute[74980]: DEBUG nova.objects.instance [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lazy-loading 'resources' on Instance uuid 07bc020d-9394-4327-9c90-9902b7256bf9 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:26:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1251564298',display_name='tempest-DeleteServersTestJSON-server-1251564298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1251564298',id=21,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:26:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='caae5e1d54624270920015819e250435',ramdisk_id='',reservation_id='r-kdyygfq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-510258544',owner_user_name='tempest-DeleteServersTestJSON-510258544-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:26:09Z,user_data=None,user_id='b75cd0a07a404094b74c73e9ced8f5f4',uuid=07bc020d-9394-4327-9c90-9902b7256bf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "address": "fa:16:3e:11:c5:b4", "network": {"id": "6a7dc076-5437-429f-a011-a41212b7807f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-595587795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caae5e1d54624270920015819e250435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f505851-98", "ovs_interfaceid": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Converting VIF {"id": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "address": "fa:16:3e:11:c5:b4", "network": {"id": "6a7dc076-5437-429f-a011-a41212b7807f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-595587795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caae5e1d54624270920015819e250435", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f505851-98", "ovs_interfaceid": "3f505851-98d3-4b75-b946-c3ed7e4267e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=3f505851-98d3-4b75-b946-c3ed7e4267e2,network=Network(6a7dc076-5437-429f-a011-a41212b7807f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f505851-98') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_vif [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=3f505851-98d3-4b75-b946-c3ed7e4267e2,network=Network(6a7dc076-5437-429f-a011-a41212b7807f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f505851-98') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f505851-98, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ef88990-9cc6-4faa-be6b-3178d7295cd5) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:28:25 user nova-compute[74980]: INFO os_vif [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=3f505851-98d3-4b75-b946-c3ed7e4267e2,network=Network(6a7dc076-5437-429f-a011-a41212b7807f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f505851-98')
Nov 02 17:28:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcJFEkDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:28:25 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd997b27-6fb0-4f29-8fcc-f00b2d5c4601]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:28:25 user nova-compute[74980]: No targets found.
Nov 02 17:28:25 user nova-compute[74980]: iSNS:
Nov 02 17:28:25 user nova-compute[74980]: No targets found.
Nov 02 17:28:25 user nova-compute[74980]: STATIC:
Nov 02 17:28:25 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1
Nov 02 17:28:25 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:28:25 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:28:25 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda
Nov 02 17:28:25 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:28:25 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:28:25 user nova-compute[74980]: FIRMWARE:
Nov 02 17:28:25 user nova-compute[74980]: No targets found.
Nov 02 17:28:25 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:28:25 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:28:25 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7893046-8486-4047-9347-95eaf6cd85dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[743fef8e-15f9-4fd5-8c13-b40379be4908]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:28:25 user nova-compute[74980]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda (non-flash)
Nov 02 17:28:25 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:28:25 user nova-compute[74980]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda (non-flash)
Nov 02 17:28:25 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b41f1750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda'): ({'sdc'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Removing single pathed devices sdc {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95d1253-b8ce-4e8b-b0eb-5bd28a3a5399]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2880a1-758c-415e-ada6-8b8d2c4be240]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Flushing IO for device /dev/sdc {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8952e7-97a5-41a7-9e78-9a6c3f9636d4]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a51c601-3961-4e55-9aea-96407d505221]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aa488c-f6fe-4539-b2a5-3819fb5f60e6]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a060ff79-0cc6-4c43-ac5c-280e8e77f2c2]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda, portal: 172.16.0.220,3260]
Nov 02 17:28:25 user nova-compute[74980]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda, portal: 172.16.0.220,3260] successful.
Nov 02 17:28:25 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5476cf-3d43-41fb-b5c9-417f44309fda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e42ad17-979e-4022-9996-83d6ba6f005b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] <== disconnect_volume: return (397ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:28:25 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Deleting instance files /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9_del
Nov 02 17:28:25 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Deletion of /opt/stack/data/nova/instances/07bc020d-9394-4327-9c90-9902b7256bf9_del complete
Nov 02 17:28:25 user nova-compute[74980]: INFO nova.compute.manager [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Took 1.41 seconds to destroy the instance on the hypervisor.
Nov 02 17:28:25 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:28:25 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:28:26 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:28:26 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Took 0.58 seconds to deallocate network for instance.
Nov 02 17:28:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-48d83953-b560-44c3-9c39-c5aa40ced539 req-e7d8e6ac-53ea-4e65-8376-17351012b96f service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Received event network-vif-plugged-3f505851-98d3-4b75-b946-c3ed7e4267e2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:28:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-48d83953-b560-44c3-9c39-c5aa40ced539 req-e7d8e6ac-53ea-4e65-8376-17351012b96f service nova] Acquiring lock "07bc020d-9394-4327-9c90-9902b7256bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:28:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-48d83953-b560-44c3-9c39-c5aa40ced539 req-e7d8e6ac-53ea-4e65-8376-17351012b96f service nova] Lock "07bc020d-9394-4327-9c90-9902b7256bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:28:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-48d83953-b560-44c3-9c39-c5aa40ced539 req-e7d8e6ac-53ea-4e65-8376-17351012b96f service nova] Lock "07bc020d-9394-4327-9c90-9902b7256bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:28:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-48d83953-b560-44c3-9c39-c5aa40ced539 req-e7d8e6ac-53ea-4e65-8376-17351012b96f service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] No waiting events found dispatching network-vif-plugged-3f505851-98d3-4b75-b946-c3ed7e4267e2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:28:26 user nova-compute[74980]: WARNING nova.compute.manager [req-48d83953-b560-44c3-9c39-c5aa40ced539 req-e7d8e6ac-53ea-4e65-8376-17351012b96f service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Received unexpected event network-vif-plugged-3f505851-98d3-4b75-b946-c3ed7e4267e2 for instance with vm_state active and task_state deleting.
Nov 02 17:28:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-48d83953-b560-44c3-9c39-c5aa40ced539 req-e7d8e6ac-53ea-4e65-8376-17351012b96f service nova] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Received event network-vif-deleted-3f505851-98d3-4b75-b946-c3ed7e4267e2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:28:27 user nova-compute[74980]: INFO nova.compute.manager [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] [instance: 07bc020d-9394-4327-9c90-9902b7256bf9] Took 1.12 seconds to detach 1 volumes for instance.
Nov 02 17:28:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:28:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:28:27 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:28:27 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:28:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:28:27 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Deleted allocations for instance 07bc020d-9394-4327-9c90-9902b7256bf9
Nov 02 17:28:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6b18fd15-0403-474a-a48f-6a38e2a727b5 tempest-DeleteServersTestJSON-510258544 tempest-DeleteServersTestJSON-510258544-project-member] Lock "07bc020d-9394-4327-9c90-9902b7256bf9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.615s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:28:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:28:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:28:34 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:28:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:28:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:28:34 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:28:34 user nova-compute[74980]: INFO nova.compute.claims [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Claim successful on node user
Nov 02 17:28:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG nova.network.neutron [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:28:35 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:28:35 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:28:35 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Creating image(s)
Nov 02 17:28:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "/opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "/opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "/opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.032s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG nova.policy [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a979e164900348beaab104704c92b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b889d98476584bb1b18080bfa0664810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.210s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk 1073741824" returned: 0 in 0.046s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:28:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:36 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:28:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:28:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:28:36 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Cannot resize image /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:28:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:28:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Ensure instance console log exists: /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:28:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:28:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:28:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:28:36 user nova-compute[74980]: DEBUG nova.network.neutron [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Successfully created port: 22c5f565-6c8a-4bea-9958-500859dab34d {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:28:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:37 user nova-compute[74980]: DEBUG nova.network.neutron [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Successfully updated port: 22c5f565-6c8a-4bea-9958-500859dab34d {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:28:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "refresh_cache-845a016d-9f39-4fae-9e89-0ecebb63c9f8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:28:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquired lock "refresh_cache-845a016d-9f39-4fae-9e89-0ecebb63c9f8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:28:37 user nova-compute[74980]: DEBUG nova.network.neutron [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:28:37 user nova-compute[74980]: DEBUG nova.compute.manager [req-afddab3b-b967-498e-85a9-2f68c0201b8a req-0dd46efd-e06b-46cd-acb6-5eefbacc58b8 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Received event network-changed-22c5f565-6c8a-4bea-9958-500859dab34d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:28:37 user nova-compute[74980]: DEBUG nova.compute.manager [req-afddab3b-b967-498e-85a9-2f68c0201b8a req-0dd46efd-e06b-46cd-acb6-5eefbacc58b8 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Refreshing instance network info cache due to event network-changed-22c5f565-6c8a-4bea-9958-500859dab34d. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:28:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-afddab3b-b967-498e-85a9-2f68c0201b8a req-0dd46efd-e06b-46cd-acb6-5eefbacc58b8 service nova] Acquiring lock "refresh_cache-845a016d-9f39-4fae-9e89-0ecebb63c9f8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:28:37 user nova-compute[74980]: DEBUG nova.network.neutron [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.network.neutron [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Updating instance_info_cache with network_info: [{"id": "22c5f565-6c8a-4bea-9958-500859dab34d", "address": "fa:16:3e:33:5e:ae", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c5f565-6c", "ovs_interfaceid": "22c5f565-6c8a-4bea-9958-500859dab34d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Releasing lock "refresh_cache-845a016d-9f39-4fae-9e89-0ecebb63c9f8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Instance network_info: |[{"id": "22c5f565-6c8a-4bea-9958-500859dab34d", "address": "fa:16:3e:33:5e:ae", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c5f565-6c", "ovs_interfaceid": "22c5f565-6c8a-4bea-9958-500859dab34d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-afddab3b-b967-498e-85a9-2f68c0201b8a req-0dd46efd-e06b-46cd-acb6-5eefbacc58b8 service nova] Acquired lock "refresh_cache-845a016d-9f39-4fae-9e89-0ecebb63c9f8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.network.neutron [req-afddab3b-b967-498e-85a9-2f68c0201b8a req-0dd46efd-e06b-46cd-acb6-5eefbacc58b8 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Refreshing network info cache for port 22c5f565-6c8a-4bea-9958-500859dab34d {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Start _get_guest_xml network_info=[{"id": "22c5f565-6c8a-4bea-9958-500859dab34d", "address": "fa:16:3e:33:5e:ae", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c5f565-6c", "ovs_interfaceid": "22c5f565-6c8a-4bea-9958-500859dab34d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:28:38 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:28:38 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:28:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2030664930',display_name='tempest-AttachVolumeNegativeTest-server-2030664930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2030664930',id=22,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvCwL2t1yDX3cRs04uwl9Ru2OGtmi4oYvtizXy7OQk3DUaNKFDu/c7VsOwMqfljn+pBXyySNud6s39S6NPOyIKYScSD7Fmd011cWGSM3rjwuuWDwT6DYiFEHp1IwZ40zQ==',key_name='tempest-keypair-346318422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b889d98476584bb1b18080bfa0664810',ramdisk_id='',reservation_id='r-0wmup3mz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1956142060',owner_user_name='tempest-AttachVolumeNegativeTest-1956142060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:28:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a979e164900348beaab104704c92b722',uuid=845a016d-9f39-4fae-9e89-0ecebb63c9f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22c5f565-6c8a-4bea-9958-500859dab34d", "address": "fa:16:3e:33:5e:ae", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c5f565-6c", "ovs_interfaceid": "22c5f565-6c8a-4bea-9958-500859dab34d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converting VIF {"id": "22c5f565-6c8a-4bea-9958-500859dab34d", "address": "fa:16:3e:33:5e:ae", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c5f565-6c", "ovs_interfaceid": "22c5f565-6c8a-4bea-9958-500859dab34d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:5e:ae,bridge_name='br-int',has_traffic_filtering=True,id=22c5f565-6c8a-4bea-9958-500859dab34d,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22c5f565-6c') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'pci_devices' on Instance uuid 845a016d-9f39-4fae-9e89-0ecebb63c9f8 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:28:38 user nova-compute[74980]:   <uuid>845a016d-9f39-4fae-9e89-0ecebb63c9f8</uuid>
Nov 02 17:28:38 user nova-compute[74980]:   <name>instance-00000016</name>
Nov 02 17:28:38 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:28:38 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:28:38 user nova-compute[74980]:   <metadata>
Nov 02 17:28:38 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:28:38 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:28:38 user nova-compute[74980]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2030664930</nova:name>
Nov 02 17:28:38 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:28:38</nova:creationTime>
Nov 02 17:28:38 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:28:38 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:28:38 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:28:38 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:28:38 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:28:38 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:28:38 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:28:38 user nova-compute[74980]:       <nova:owner>
Nov 02 17:28:38 user nova-compute[74980]:         <nova:user uuid="a979e164900348beaab104704c92b722">tempest-AttachVolumeNegativeTest-1956142060-project-member</nova:user>
Nov 02 17:28:38 user nova-compute[74980]:         <nova:project uuid="b889d98476584bb1b18080bfa0664810">tempest-AttachVolumeNegativeTest-1956142060</nova:project>
Nov 02 17:28:38 user nova-compute[74980]:       </nova:owner>
Nov 02 17:28:38 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:28:38 user nova-compute[74980]:       <nova:ports>
Nov 02 17:28:38 user nova-compute[74980]:         <nova:port uuid="22c5f565-6c8a-4bea-9958-500859dab34d">
Nov 02 17:28:38 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 17:28:38 user nova-compute[74980]:         </nova:port>
Nov 02 17:28:38 user nova-compute[74980]:       </nova:ports>
Nov 02 17:28:38 user nova-compute[74980]:     </nova:instance>
Nov 02 17:28:38 user nova-compute[74980]:   </metadata>
Nov 02 17:28:38 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:28:38 user nova-compute[74980]:     <system>
Nov 02 17:28:38 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:28:38 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:28:38 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:28:38 user nova-compute[74980]:       <entry name="serial">845a016d-9f39-4fae-9e89-0ecebb63c9f8</entry>
Nov 02 17:28:38 user nova-compute[74980]:       <entry name="uuid">845a016d-9f39-4fae-9e89-0ecebb63c9f8</entry>
Nov 02 17:28:38 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:28:38 user nova-compute[74980]:     </system>
Nov 02 17:28:38 user nova-compute[74980]:   </sysinfo>
Nov 02 17:28:38 user nova-compute[74980]:   <os>
Nov 02 17:28:38 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:28:38 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:28:38 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:28:38 user nova-compute[74980]:   </os>
Nov 02 17:28:38 user nova-compute[74980]:   <features>
Nov 02 17:28:38 user nova-compute[74980]:     <acpi/>
Nov 02 17:28:38 user nova-compute[74980]:     <apic/>
Nov 02 17:28:38 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:28:38 user nova-compute[74980]:   </features>
Nov 02 17:28:38 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:28:38 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:28:38 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:28:38 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:28:38 user nova-compute[74980]:   </clock>
Nov 02 17:28:38 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:28:38 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:28:38 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:28:38 user nova-compute[74980]:   </cpu>
Nov 02 17:28:38 user nova-compute[74980]:   <devices>
Nov 02 17:28:38 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:28:38 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:28:38 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk"/>
Nov 02 17:28:38 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:28:38 user nova-compute[74980]:     </disk>
Nov 02 17:28:38 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:28:38 user nova-compute[74980]:       <mac address="fa:16:3e:33:5e:ae"/>
Nov 02 17:28:38 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:28:38 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:28:38 user nova-compute[74980]:       <target dev="tap22c5f565-6c"/>
Nov 02 17:28:38 user nova-compute[74980]:     </interface>
Nov 02 17:28:38 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:28:38 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/console.log" append="off"/>
Nov 02 17:28:38 user nova-compute[74980]:     </serial>
Nov 02 17:28:38 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:28:38 user nova-compute[74980]:     <video>
Nov 02 17:28:38 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:28:38 user nova-compute[74980]:     </video>
Nov 02 17:28:38 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:28:38 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:28:38 user nova-compute[74980]:     </rng>
Nov 02 17:28:38 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:28:38 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:28:38 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:28:38 user nova-compute[74980]:     </memballoon>
Nov 02 17:28:38 user nova-compute[74980]:   </devices>
Nov 02 17:28:38 user nova-compute[74980]: </domain>
Nov 02 17:28:38 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:28:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2030664930',display_name='tempest-AttachVolumeNegativeTest-server-2030664930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2030664930',id=22,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvCwL2t1yDX3cRs04uwl9Ru2OGtmi4oYvtizXy7OQk3DUaNKFDu/c7VsOwMqfljn+pBXyySNud6s39S6NPOyIKYScSD7Fmd011cWGSM3rjwuuWDwT6DYiFEHp1IwZ40zQ==',key_name='tempest-keypair-346318422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b889d98476584bb1b18080bfa0664810',ramdisk_id='',reservation_id='r-0wmup3mz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1956142060',owner_user_name='tempest-AttachVolumeNegativeTest-1956142060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:28:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a979e164900348beaab104704c92b722',uuid=845a016d-9f39-4fae-9e89-0ecebb63c9f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22c5f565-6c8a-4bea-9958-500859dab34d", "address": "fa:16:3e:33:5e:ae", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c5f565-6c", "ovs_interfaceid": "22c5f565-6c8a-4bea-9958-500859dab34d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converting VIF {"id": "22c5f565-6c8a-4bea-9958-500859dab34d", "address": "fa:16:3e:33:5e:ae", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c5f565-6c", "ovs_interfaceid": "22c5f565-6c8a-4bea-9958-500859dab34d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:5e:ae,bridge_name='br-int',has_traffic_filtering=True,id=22c5f565-6c8a-4bea-9958-500859dab34d,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22c5f565-6c') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG os_vif [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:5e:ae,bridge_name='br-int',has_traffic_filtering=True,id=22c5f565-6c8a-4bea-9958-500859dab34d,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22c5f565-6c') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5452f5a2-ba3a-55d8-801b-be09c0c9d0c2', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22c5f565-6c, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22c5f565-6c, col_values=(('qos', UUID('c1a5beaf-70ba-4042-bc6d-4e178183a26e')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22c5f565-6c, col_values=(('external_ids', {'iface-id': '22c5f565-6c8a-4bea-9958-500859dab34d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:5e:ae', 'vm-uuid': '845a016d-9f39-4fae-9e89-0ecebb63c9f8'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:38 user nova-compute[74980]: INFO os_vif [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:5e:ae,bridge_name='br-int',has_traffic_filtering=True,id=22c5f565-6c8a-4bea-9958-500859dab34d,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22c5f565-6c')
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No VIF found with MAC fa:16:3e:33:5e:ae, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.network.neutron [req-afddab3b-b967-498e-85a9-2f68c0201b8a req-0dd46efd-e06b-46cd-acb6-5eefbacc58b8 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Updated VIF entry in instance network info cache for port 22c5f565-6c8a-4bea-9958-500859dab34d. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG nova.network.neutron [req-afddab3b-b967-498e-85a9-2f68c0201b8a req-0dd46efd-e06b-46cd-acb6-5eefbacc58b8 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Updating instance_info_cache with network_info: [{"id": "22c5f565-6c8a-4bea-9958-500859dab34d", "address": "fa:16:3e:33:5e:ae", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c5f565-6c", "ovs_interfaceid": "22c5f565-6c8a-4bea-9958-500859dab34d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:28:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-afddab3b-b967-498e-85a9-2f68c0201b8a req-0dd46efd-e06b-46cd-acb6-5eefbacc58b8 service nova] Releasing lock "refresh_cache-845a016d-9f39-4fae-9e89-0ecebb63c9f8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:28:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:40 user nova-compute[74980]: DEBUG nova.compute.manager [req-6076fa77-8085-4ce2-be72-f24e7b5279ae req-c0a7ce82-51a7-49de-8354-ad07815fc5d7 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Received event network-vif-plugged-22c5f565-6c8a-4bea-9958-500859dab34d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:28:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6076fa77-8085-4ce2-be72-f24e7b5279ae req-c0a7ce82-51a7-49de-8354-ad07815fc5d7 service nova] Acquiring lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:28:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6076fa77-8085-4ce2-be72-f24e7b5279ae req-c0a7ce82-51a7-49de-8354-ad07815fc5d7 service nova] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:28:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6076fa77-8085-4ce2-be72-f24e7b5279ae req-c0a7ce82-51a7-49de-8354-ad07815fc5d7 service nova] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:28:40 user nova-compute[74980]: DEBUG nova.compute.manager [req-6076fa77-8085-4ce2-be72-f24e7b5279ae req-c0a7ce82-51a7-49de-8354-ad07815fc5d7 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] No waiting events found dispatching network-vif-plugged-22c5f565-6c8a-4bea-9958-500859dab34d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:28:40 user nova-compute[74980]: WARNING nova.compute.manager [req-6076fa77-8085-4ce2-be72-f24e7b5279ae req-c0a7ce82-51a7-49de-8354-ad07815fc5d7 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Received unexpected event network-vif-plugged-22c5f565-6c8a-4bea-9958-500859dab34d for instance with vm_state building and task_state spawning.
Nov 02 17:28:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:28:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:28:42 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Instance spawned successfully.
Nov 02 17:28:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:28:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:28:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:28:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:28:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:28:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:28:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:28:42 user nova-compute[74980]: INFO nova.compute.manager [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Took 6.73 seconds to spawn the instance on the hypervisor.
Nov 02 17:28:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:28:42 user nova-compute[74980]: INFO nova.compute.manager [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Took 7.40 seconds to build instance.
Nov 02 17:28:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b48e4255-d48a-4bd7-9839-7e3956a88da0 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.515s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:28:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-8c6ee50a-e975-452e-99be-12cd739fea31 req-a6e35656-8422-495b-9ebd-315460a79fd4 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Received event network-vif-plugged-22c5f565-6c8a-4bea-9958-500859dab34d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:28:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8c6ee50a-e975-452e-99be-12cd739fea31 req-a6e35656-8422-495b-9ebd-315460a79fd4 service nova] Acquiring lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:28:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8c6ee50a-e975-452e-99be-12cd739fea31 req-a6e35656-8422-495b-9ebd-315460a79fd4 service nova] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:28:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8c6ee50a-e975-452e-99be-12cd739fea31 req-a6e35656-8422-495b-9ebd-315460a79fd4 service nova] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:28:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-8c6ee50a-e975-452e-99be-12cd739fea31 req-a6e35656-8422-495b-9ebd-315460a79fd4 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] No waiting events found dispatching network-vif-plugged-22c5f565-6c8a-4bea-9958-500859dab34d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:28:42 user nova-compute[74980]: WARNING nova.compute.manager [req-8c6ee50a-e975-452e-99be-12cd739fea31 req-a6e35656-8422-495b-9ebd-315460a79fd4 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Received unexpected event network-vif-plugged-22c5f565-6c8a-4bea-9958-500859dab34d for instance with vm_state active and task_state None.
Nov 02 17:28:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:28:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:29:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:29:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:29:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:09 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:29:09 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:29:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:29:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:29:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:29:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:29:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:29:10 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:29:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:29:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:29:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:29:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:29:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:29:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:29:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:29:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:29:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:29:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:29:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:29:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:29:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:29:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:29:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:29:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:29:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:29:12 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:29:12 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:29:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8334MB free_disk=25.295726776123047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:29:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:29:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:29:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:29:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:29:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 08309ef4-cf53-47b0-8960-01aba8903030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:29:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 845a016d-9f39-4fae-9e89-0ecebb63c9f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:29:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:29:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:29:12 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:29:12 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:29:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:29:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.366s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:29:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:13 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:29:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:29:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:29:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:29:14 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:29:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:15 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Updating instance_info_cache with network_info: [{"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:29:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:29:15 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:29:15 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:29:15 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:29:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:15 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:29:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:29:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:29:40 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:29:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:29:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:29:40 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:29:40 user nova-compute[74980]: INFO nova.compute.claims [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Claim successful on node user
Nov 02 17:29:41 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG nova.network.neutron [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:29:41 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:29:41 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG nova.policy [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f7818185f98430399f7f2fe9465217c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca163fc9523f4f83bd2efba0ec7e468d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:29:41 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Creating image(s)
Nov 02 17:29:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "/opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "/opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "/opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.208s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.200s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:29:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk 1073741824" returned: 0 in 0.045s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG nova.network.neutron [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Successfully created port: f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.188s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:29:42 user nova-compute[74980]: INFO nova.compute.manager [None req-8b5877b8-207e-4ad2-8f92-2d2490a2790e tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Unrescuing
Nov 02 17:29:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b5877b8-207e-4ad2-8f92-2d2490a2790e tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b5877b8-207e-4ad2-8f92-2d2490a2790e tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquired lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8b5877b8-207e-4ad2-8f92-2d2490a2790e tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Cannot resize image /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Ensure instance console log exists: /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:29:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8b5877b8-207e-4ad2-8f92-2d2490a2790e tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Updating instance_info_cache with network_info: [{"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8b5877b8-207e-4ad2-8f92-2d2490a2790e tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Releasing lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG nova.objects.instance [None req-8b5877b8-207e-4ad2-8f92-2d2490a2790e tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lazy-loading 'flavor' on Instance uuid 08309ef4-cf53-47b0-8960-01aba8903030 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG nova.network.neutron [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Successfully updated port: f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquired lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG nova.network.neutron [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG nova.compute.manager [req-45bafc47-31cb-48f2-b980-b0de0df40802 req-b115660c-1e27-48c5-907f-775513c76fb4 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-changed-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG nova.compute.manager [req-45bafc47-31cb-48f2-b980-b0de0df40802 req-b115660c-1e27-48c5-907f-775513c76fb4 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Refreshing instance network info cache due to event network-changed-f5e8978e-28b1-419e-a745-0a784521ee3d. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-45bafc47-31cb-48f2-b980-b0de0df40802 req-b115660c-1e27-48c5-907f-775513c76fb4 service nova] Acquiring lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG nova.network.neutron [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG nova.compute.manager [req-93d1ea6f-2544-4b72-844d-cea7c4e88421 req-1c2cc4e2-99b3-4788-8beb-5984eefb58f9 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-changed-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG nova.compute.manager [req-93d1ea6f-2544-4b72-844d-cea7c4e88421 req-1c2cc4e2-99b3-4788-8beb-5984eefb58f9 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Refreshing instance network info cache due to event network-changed-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-93d1ea6f-2544-4b72-844d-cea7c4e88421 req-1c2cc4e2-99b3-4788-8beb-5984eefb58f9 service nova] Acquiring lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-93d1ea6f-2544-4b72-844d-cea7c4e88421 req-1c2cc4e2-99b3-4788-8beb-5984eefb58f9 service nova] Acquired lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:29:43 user nova-compute[74980]: DEBUG nova.network.neutron [req-93d1ea6f-2544-4b72-844d-cea7c4e88421 req-1c2cc4e2-99b3-4788-8beb-5984eefb58f9 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Refreshing network info cache for port fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:29:44 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Instance destroyed successfully.
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.network.neutron [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating instance_info_cache with network_info: [{"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Releasing lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Instance network_info: |[{"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-45bafc47-31cb-48f2-b980-b0de0df40802 req-b115660c-1e27-48c5-907f-775513c76fb4 service nova] Acquired lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.network.neutron [req-45bafc47-31cb-48f2-b980-b0de0df40802 req-b115660c-1e27-48c5-907f-775513c76fb4 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Refreshing network info cache for port f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Start _get_guest_xml network_info=[{"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:29:44 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:29:44 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1460645799',display_name='tempest-ServerActionsTestOtherB-server-1460645799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1460645799',id=23,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDC1zazFsVcK8cRSvh0A9JDxfLAmb3MmWE+O0wv7/MERQOOzJbF5AG6ze84hXy646Ak4C6ld6XkTeszBqKFoffMRNgW/kfbra+jqQgZdpkDkqH9hu6Bzizhbp6Bezooetw==',key_name='tempest-keypair-1765002056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca163fc9523f4f83bd2efba0ec7e468d',ramdisk_id='',reservation_id='r-1djtdfew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-879907014',owner_user_name='tempest-ServerActionsTestOtherB-879907014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f7818185f98430399f7f2fe9465217c',uuid=6319a96b-1499-4d79-8ffe-df25fab1c6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converting VIF {"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.objects.instance [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lazy-loading 'pci_devices' on Instance uuid 6319a96b-1499-4d79-8ffe-df25fab1c6d8 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:29:44 user nova-compute[74980]:   <uuid>6319a96b-1499-4d79-8ffe-df25fab1c6d8</uuid>
Nov 02 17:29:44 user nova-compute[74980]:   <name>instance-00000017</name>
Nov 02 17:29:44 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:29:44 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:29:44 user nova-compute[74980]:   <metadata>
Nov 02 17:29:44 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:29:44 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:29:44 user nova-compute[74980]:       <nova:name>tempest-ServerActionsTestOtherB-server-1460645799</nova:name>
Nov 02 17:29:44 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:29:44</nova:creationTime>
Nov 02 17:29:44 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:29:44 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:29:44 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:29:44 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:29:44 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:29:44 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:29:44 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:29:44 user nova-compute[74980]:       <nova:owner>
Nov 02 17:29:44 user nova-compute[74980]:         <nova:user uuid="8f7818185f98430399f7f2fe9465217c">tempest-ServerActionsTestOtherB-879907014-project-member</nova:user>
Nov 02 17:29:44 user nova-compute[74980]:         <nova:project uuid="ca163fc9523f4f83bd2efba0ec7e468d">tempest-ServerActionsTestOtherB-879907014</nova:project>
Nov 02 17:29:44 user nova-compute[74980]:       </nova:owner>
Nov 02 17:29:44 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:29:44 user nova-compute[74980]:       <nova:ports>
Nov 02 17:29:44 user nova-compute[74980]:         <nova:port uuid="f5e8978e-28b1-419e-a745-0a784521ee3d">
Nov 02 17:29:44 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 17:29:44 user nova-compute[74980]:         </nova:port>
Nov 02 17:29:44 user nova-compute[74980]:       </nova:ports>
Nov 02 17:29:44 user nova-compute[74980]:     </nova:instance>
Nov 02 17:29:44 user nova-compute[74980]:   </metadata>
Nov 02 17:29:44 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:29:44 user nova-compute[74980]:     <system>
Nov 02 17:29:44 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:29:44 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:29:44 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:29:44 user nova-compute[74980]:       <entry name="serial">6319a96b-1499-4d79-8ffe-df25fab1c6d8</entry>
Nov 02 17:29:44 user nova-compute[74980]:       <entry name="uuid">6319a96b-1499-4d79-8ffe-df25fab1c6d8</entry>
Nov 02 17:29:44 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:29:44 user nova-compute[74980]:     </system>
Nov 02 17:29:44 user nova-compute[74980]:   </sysinfo>
Nov 02 17:29:44 user nova-compute[74980]:   <os>
Nov 02 17:29:44 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:29:44 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:29:44 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:29:44 user nova-compute[74980]:   </os>
Nov 02 17:29:44 user nova-compute[74980]:   <features>
Nov 02 17:29:44 user nova-compute[74980]:     <acpi/>
Nov 02 17:29:44 user nova-compute[74980]:     <apic/>
Nov 02 17:29:44 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:29:44 user nova-compute[74980]:   </features>
Nov 02 17:29:44 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:29:44 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:29:44 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:29:44 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:29:44 user nova-compute[74980]:   </clock>
Nov 02 17:29:44 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:29:44 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:29:44 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:29:44 user nova-compute[74980]:   </cpu>
Nov 02 17:29:44 user nova-compute[74980]:   <devices>
Nov 02 17:29:44 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:29:44 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:29:44 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk"/>
Nov 02 17:29:44 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:29:44 user nova-compute[74980]:     </disk>
Nov 02 17:29:44 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:29:44 user nova-compute[74980]:       <mac address="fa:16:3e:1e:4f:61"/>
Nov 02 17:29:44 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:29:44 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:29:44 user nova-compute[74980]:       <target dev="tapf5e8978e-28"/>
Nov 02 17:29:44 user nova-compute[74980]:     </interface>
Nov 02 17:29:44 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:29:44 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/console.log" append="off"/>
Nov 02 17:29:44 user nova-compute[74980]:     </serial>
Nov 02 17:29:44 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:29:44 user nova-compute[74980]:     <video>
Nov 02 17:29:44 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:29:44 user nova-compute[74980]:     </video>
Nov 02 17:29:44 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:29:44 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:29:44 user nova-compute[74980]:     </rng>
Nov 02 17:29:44 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:29:44 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:29:44 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:29:44 user nova-compute[74980]:     </memballoon>
Nov 02 17:29:44 user nova-compute[74980]:   </devices>
Nov 02 17:29:44 user nova-compute[74980]: </domain>
Nov 02 17:29:44 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1460645799',display_name='tempest-ServerActionsTestOtherB-server-1460645799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1460645799',id=23,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDC1zazFsVcK8cRSvh0A9JDxfLAmb3MmWE+O0wv7/MERQOOzJbF5AG6ze84hXy646Ak4C6ld6XkTeszBqKFoffMRNgW/kfbra+jqQgZdpkDkqH9hu6Bzizhbp6Bezooetw==',key_name='tempest-keypair-1765002056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca163fc9523f4f83bd2efba0ec7e468d',ramdisk_id='',reservation_id='r-1djtdfew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-879907014',owner_user_name='tempest-ServerActionsTestOtherB-879907014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f7818185f98430399f7f2fe9465217c',uuid=6319a96b-1499-4d79-8ffe-df25fab1c6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converting VIF {"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG os_vif [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '436a0bc9-b2bc-5fdd-a52b-5f200b506cee', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5e8978e-28, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5e8978e-28, col_values=(('qos', UUID('3e2619c3-f7c7-4e62-b8c3-6cdbbaadeb4c')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5e8978e-28, col_values=(('external_ids', {'iface-id': 'f5e8978e-28b1-419e-a745-0a784521ee3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:4f:61', 'vm-uuid': '6319a96b-1499-4d79-8ffe-df25fab1c6d8'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:44 user nova-compute[74980]: INFO os_vif [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28')
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] No VIF found with MAC fa:16:3e:1e:4f:61, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.network.neutron [req-93d1ea6f-2544-4b72-844d-cea7c4e88421 req-1c2cc4e2-99b3-4788-8beb-5984eefb58f9 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Updated VIF entry in instance network info cache for port fe9b054a-bbfc-457c-86bf-dede3bb2c8dc. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.network.neutron [req-93d1ea6f-2544-4b72-844d-cea7c4e88421 req-1c2cc4e2-99b3-4788-8beb-5984eefb58f9 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Updating instance_info_cache with network_info: [{"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-93d1ea6f-2544-4b72-844d-cea7c4e88421 req-1c2cc4e2-99b3-4788-8beb-5984eefb58f9 service nova] Releasing lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.network.neutron [req-45bafc47-31cb-48f2-b980-b0de0df40802 req-b115660c-1e27-48c5-907f-775513c76fb4 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updated VIF entry in instance network info cache for port f5e8978e-28b1-419e-a745-0a784521ee3d. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG nova.network.neutron [req-45bafc47-31cb-48f2-b980-b0de0df40802 req-b115660c-1e27-48c5-907f-775513c76fb4 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating instance_info_cache with network_info: [{"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:29:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-45bafc47-31cb-48f2-b980-b0de0df40802 req-b115660c-1e27-48c5-907f-775513c76fb4 service nova] Releasing lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:29:45 user nova-compute[74980]: DEBUG nova.compute.manager [req-ef612a4e-f3f3-4b5a-881d-f2d39ea5f42e req-d00fdf99-1762-439f-9102-6afa6adf1259 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-vif-unplugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:29:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ef612a4e-f3f3-4b5a-881d-f2d39ea5f42e req-d00fdf99-1762-439f-9102-6afa6adf1259 service nova] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:29:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ef612a4e-f3f3-4b5a-881d-f2d39ea5f42e req-d00fdf99-1762-439f-9102-6afa6adf1259 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:29:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ef612a4e-f3f3-4b5a-881d-f2d39ea5f42e req-d00fdf99-1762-439f-9102-6afa6adf1259 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:29:45 user nova-compute[74980]: DEBUG nova.compute.manager [req-ef612a4e-f3f3-4b5a-881d-f2d39ea5f42e req-d00fdf99-1762-439f-9102-6afa6adf1259 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] No waiting events found dispatching network-vif-unplugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:29:45 user nova-compute[74980]: WARNING nova.compute.manager [req-ef612a4e-f3f3-4b5a-881d-f2d39ea5f42e req-d00fdf99-1762-439f-9102-6afa6adf1259 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received unexpected event network-vif-unplugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:29:45 user nova-compute[74980]: DEBUG nova.compute.manager [req-ef612a4e-f3f3-4b5a-881d-f2d39ea5f42e req-d00fdf99-1762-439f-9102-6afa6adf1259 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:29:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ef612a4e-f3f3-4b5a-881d-f2d39ea5f42e req-d00fdf99-1762-439f-9102-6afa6adf1259 service nova] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:29:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ef612a4e-f3f3-4b5a-881d-f2d39ea5f42e req-d00fdf99-1762-439f-9102-6afa6adf1259 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:29:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ef612a4e-f3f3-4b5a-881d-f2d39ea5f42e req-d00fdf99-1762-439f-9102-6afa6adf1259 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:29:45 user nova-compute[74980]: DEBUG nova.compute.manager [req-ef612a4e-f3f3-4b5a-881d-f2d39ea5f42e req-d00fdf99-1762-439f-9102-6afa6adf1259 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] No waiting events found dispatching network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:29:45 user nova-compute[74980]: WARNING nova.compute.manager [req-ef612a4e-f3f3-4b5a-881d-f2d39ea5f42e req-d00fdf99-1762-439f-9102-6afa6adf1259 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received unexpected event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:29:45 user nova-compute[74980]: DEBUG nova.compute.manager [req-85eca6e7-5ccd-417e-956f-029644da27f3 req-32007e1e-4056-4090-82f9-15ea55555278 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-changed-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:29:45 user nova-compute[74980]: DEBUG nova.compute.manager [req-85eca6e7-5ccd-417e-956f-029644da27f3 req-32007e1e-4056-4090-82f9-15ea55555278 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Refreshing instance network info cache due to event network-changed-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:29:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-85eca6e7-5ccd-417e-956f-029644da27f3 req-32007e1e-4056-4090-82f9-15ea55555278 service nova] Acquiring lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:29:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-85eca6e7-5ccd-417e-956f-029644da27f3 req-32007e1e-4056-4090-82f9-15ea55555278 service nova] Acquired lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:29:45 user nova-compute[74980]: DEBUG nova.network.neutron [req-85eca6e7-5ccd-417e-956f-029644da27f3 req-32007e1e-4056-4090-82f9-15ea55555278 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Refreshing network info cache for port fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:29:46 user nova-compute[74980]: DEBUG nova.network.neutron [req-85eca6e7-5ccd-417e-956f-029644da27f3 req-32007e1e-4056-4090-82f9-15ea55555278 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Updated VIF entry in instance network info cache for port fe9b054a-bbfc-457c-86bf-dede3bb2c8dc. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:29:46 user nova-compute[74980]: DEBUG nova.network.neutron [req-85eca6e7-5ccd-417e-956f-029644da27f3 req-32007e1e-4056-4090-82f9-15ea55555278 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Updating instance_info_cache with network_info: [{"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:29:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-85eca6e7-5ccd-417e-956f-029644da27f3 req-32007e1e-4056-4090-82f9-15ea55555278 service nova] Releasing lock "refresh_cache-08309ef4-cf53-47b0-8960-01aba8903030" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:29:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-e34654d2-bd93-48eb-b331-73c42f742adb req-c3ee8a5b-aa42-417e-a2ca-bd7edb7b828d service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e34654d2-bd93-48eb-b331-73c42f742adb req-c3ee8a5b-aa42-417e-a2ca-bd7edb7b828d service nova] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e34654d2-bd93-48eb-b331-73c42f742adb req-c3ee8a5b-aa42-417e-a2ca-bd7edb7b828d service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e34654d2-bd93-48eb-b331-73c42f742adb req-c3ee8a5b-aa42-417e-a2ca-bd7edb7b828d service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-e34654d2-bd93-48eb-b331-73c42f742adb req-c3ee8a5b-aa42-417e-a2ca-bd7edb7b828d service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] No waiting events found dispatching network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:29:47 user nova-compute[74980]: WARNING nova.compute.manager [req-e34654d2-bd93-48eb-b331-73c42f742adb req-c3ee8a5b-aa42-417e-a2ca-bd7edb7b828d service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received unexpected event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d for instance with vm_state building and task_state spawning.
Nov 02 17:29:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-0f16d1d7-68d1-4e77-b5da-dde96bcadf0b req-44440450-4cb1-4d88-922c-aa9f734119e6 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f16d1d7-68d1-4e77-b5da-dde96bcadf0b req-44440450-4cb1-4d88-922c-aa9f734119e6 service nova] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f16d1d7-68d1-4e77-b5da-dde96bcadf0b req-44440450-4cb1-4d88-922c-aa9f734119e6 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f16d1d7-68d1-4e77-b5da-dde96bcadf0b req-44440450-4cb1-4d88-922c-aa9f734119e6 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-0f16d1d7-68d1-4e77-b5da-dde96bcadf0b req-44440450-4cb1-4d88-922c-aa9f734119e6 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] No waiting events found dispatching network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:29:47 user nova-compute[74980]: WARNING nova.compute.manager [req-0f16d1d7-68d1-4e77-b5da-dde96bcadf0b req-44440450-4cb1-4d88-922c-aa9f734119e6 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received unexpected event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:29:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-0f16d1d7-68d1-4e77-b5da-dde96bcadf0b req-44440450-4cb1-4d88-922c-aa9f734119e6 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f16d1d7-68d1-4e77-b5da-dde96bcadf0b req-44440450-4cb1-4d88-922c-aa9f734119e6 service nova] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f16d1d7-68d1-4e77-b5da-dde96bcadf0b req-44440450-4cb1-4d88-922c-aa9f734119e6 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0f16d1d7-68d1-4e77-b5da-dde96bcadf0b req-44440450-4cb1-4d88-922c-aa9f734119e6 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:29:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-0f16d1d7-68d1-4e77-b5da-dde96bcadf0b req-44440450-4cb1-4d88-922c-aa9f734119e6 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] No waiting events found dispatching network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:29:47 user nova-compute[74980]: WARNING nova.compute.manager [req-0f16d1d7-68d1-4e77-b5da-dde96bcadf0b req-44440450-4cb1-4d88-922c-aa9f734119e6 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received unexpected event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:29:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-4c40e095-3bb2-4072-a2b0-efd1ff275f43 req-2549a6b2-87f1-462f-a578-cbfe45e899da service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:29:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4c40e095-3bb2-4072-a2b0-efd1ff275f43 req-2549a6b2-87f1-462f-a578-cbfe45e899da service nova] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:29:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4c40e095-3bb2-4072-a2b0-efd1ff275f43 req-2549a6b2-87f1-462f-a578-cbfe45e899da service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:29:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4c40e095-3bb2-4072-a2b0-efd1ff275f43 req-2549a6b2-87f1-462f-a578-cbfe45e899da service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:29:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-4c40e095-3bb2-4072-a2b0-efd1ff275f43 req-2549a6b2-87f1-462f-a578-cbfe45e899da service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] No waiting events found dispatching network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:29:49 user nova-compute[74980]: WARNING nova.compute.manager [req-4c40e095-3bb2-4072-a2b0-efd1ff275f43 req-2549a6b2-87f1-462f-a578-cbfe45e899da service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received unexpected event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d for instance with vm_state building and task_state spawning.
Nov 02 17:29:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8b5877b8-207e-4ad2-8f92-2d2490a2790e tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:29:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:29:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:29:49 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Instance spawned successfully.
Nov 02 17:29:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:29:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:29:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:29:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:29:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:29:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:29:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:29:49 user nova-compute[74980]: INFO nova.compute.manager [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Took 7.80 seconds to spawn the instance on the hypervisor.
Nov 02 17:29:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:29:49 user nova-compute[74980]: INFO nova.compute.manager [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Took 8.46 seconds to build instance.
Nov 02 17:29:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-da90a835-c3b3-449e-b512-b88d5de06a53 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.572s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:29:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:29:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "66da6804-057c-4806-b036-d246768c498d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:30:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "66da6804-057c-4806-b036-d246768c498d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:30:01 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:30:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:30:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:30:01 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:30:01 user nova-compute[74980]: INFO nova.compute.claims [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Claim successful on node user
Nov 02 17:30:02 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:30:02 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:30:02 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:30:02 user nova-compute[74980]: INFO nova.virt.block_device [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Booting with volume a3b9a62f-0fd4-479d-88d9-5b39a58635fb at /dev/vda
Nov 02 17:30:02 user nova-compute[74980]: DEBUG nova.policy [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e61d486aa0bf4b1fb4332aabfa5dafd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb10da584734aedb3d08879a4ffc2b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG os_brick.utils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2298e5-620b-422c-82b6-8cfe85d39b55]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5158eb71-e53f-45d0-afb4-e62a71c4c06b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0761f1a8-1e09-49ba-8b64-f0bb6fdbb13a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3458f841-a283-417c-b06b-fbd7f5374150]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:30:02 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:30:02 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9db6ed-e514-411f-8d28-29b90a468f3c]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG os_brick.utils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:30:02 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Updating existing volume attachment record: f25eb503-0e58-40be-9066-527a8bb9d513 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:30:03 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Successfully created port: 8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:30:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:30:03 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Successfully updated port: 8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:30:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:30:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquired lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:30:03 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:30:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-557bbde8-85c4-4ec2-bc74-e8f264c6384e req-99299ec4-862e-43ef-b456-859d3d6f3567 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received event network-changed-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:30:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-557bbde8-85c4-4ec2-bc74-e8f264c6384e req-99299ec4-862e-43ef-b456-859d3d6f3567 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Refreshing instance network info cache due to event network-changed-8f1cd067-6e00-4d28-9879-a8f775d31fa8. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:30:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-557bbde8-85c4-4ec2-bc74-e8f264c6384e req-99299ec4-862e-43ef-b456-859d3d6f3567 service nova] Acquiring lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:30:03 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:30:04 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Updating instance_info_cache with network_info: [{"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:30:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Releasing lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:30:04 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Instance network_info: |[{"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:30:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-557bbde8-85c4-4ec2-bc74-e8f264c6384e req-99299ec4-862e-43ef-b456-859d3d6f3567 service nova] Acquired lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:30:04 user nova-compute[74980]: DEBUG nova.network.neutron [req-557bbde8-85c4-4ec2-bc74-e8f264c6384e req-99299ec4-862e-43ef-b456-859d3d6f3567 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Refreshing network info cache for port 8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:30:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:04 user nova-compute[74980]: DEBUG nova.network.neutron [req-557bbde8-85c4-4ec2-bc74-e8f264c6384e req-99299ec4-862e-43ef-b456-859d3d6f3567 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Updated VIF entry in instance network info cache for port 8f1cd067-6e00-4d28-9879-a8f775d31fa8. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:30:04 user nova-compute[74980]: DEBUG nova.network.neutron [req-557bbde8-85c4-4ec2-bc74-e8f264c6384e req-99299ec4-862e-43ef-b456-859d3d6f3567 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Updating instance_info_cache with network_info: [{"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:30:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-557bbde8-85c4-4ec2-bc74-e8f264c6384e req-99299ec4-862e-43ef-b456-859d3d6f3567 service nova] Releasing lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:30:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:07 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:30:08 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:30:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:30:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:30:12 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:30:12 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:30:12 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:30:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:30:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:30:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:30:12 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:30:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:30:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:14 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:30:14 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:30:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8373MB free_disk=25.25591278076172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 08309ef4-cf53-47b0-8960-01aba8903030 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 845a016d-9f39-4fae-9e89-0ecebb63c9f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6319a96b-1499-4d79-8ffe-df25fab1c6d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 66da6804-057c-4806-b036-d246768c498d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:30:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:30:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:30:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "08309ef4-cf53-47b0-8960-01aba8903030" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:30:15 user nova-compute[74980]: INFO nova.compute.manager [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Detaching volume e82ef809-3d48-410b-830a-39125caea1f1
Nov 02 17:30:15 user nova-compute[74980]: INFO nova.virt.block_device [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Attempting to driver detach volume e82ef809-3d48-410b-830a-39125caea1f1 from mountpoint /dev/vdb
Nov 02 17:30:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Attempting to detach device vdb from instance 08309ef4-cf53-47b0-8960-01aba8903030 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:30:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:30:15 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:30:15 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:30:15 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:30:15 user nova-compute[74980]:   <serial>e82ef809-3d48-410b-830a-39125caea1f1</serial>
Nov 02 17:30:15 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:30:15 user nova-compute[74980]: </disk>
Nov 02 17:30:15 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:30:15 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Successfully detached device vdb from instance 08309ef4-cf53-47b0-8960-01aba8903030 from the persistent domain config.
Nov 02 17:30:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 08309ef4-cf53-47b0-8960-01aba8903030 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:30:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:30:15 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:30:15 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:30:15 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:30:15 user nova-compute[74980]:   <serial>e82ef809-3d48-410b-830a-39125caea1f1</serial>
Nov 02 17:30:15 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:30:15 user nova-compute[74980]: </disk>
Nov 02 17:30:15 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:30:15 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:30:15 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:30:15 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Didn't find any instances for network info cache update. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 17:30:15 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:30:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 08309ef4-cf53-47b0-8960-01aba8903030 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:30:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:30:21 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Creating image(s)
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Ensure instance console log exists: /opt/stack/data/nova/instances/66da6804-057c-4806-b036-d246768c498d/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Start _get_guest_xml network_info=[{"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdHmzSgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66da6804-057c-4806-b036-d246768c498d', 'attached_at': '', 'detached_at': '', 'volume_id': 'a3b9a62f-0fd4-479d-88d9-5b39a58635fb', 'serial': 'a3b9a62f-0fd4-479d-88d9-5b39a58635fb'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'f25eb503-0e58-40be-9066-527a8bb9d513', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:30:21 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:30:21 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdHmzSgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:30:21 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:30:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:30:21 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:30:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:30:21 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[433ef11a-63c9-4989-915d-057a76da2b62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:30:21 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14b1ead-b7fe-411a-adca-8c4a02056f9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb] added
Nov 02 17:30:21 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[16948b07-a4fe-4659-acce-a2ae5970a42d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[272ecfdc-bad8-4eab-b18d-4975cc3f35a1]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdHmzSgU {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdHmzSgU" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ecf5fd-bf84-422c-9091-d143a0edc029]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xdHmzSgU'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f0f302-3dd9-4f9c-890e-be866f945198]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dfe106-94a3-48e8-b412-85e42661e806]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:30:21 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:30:21 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:30:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --login" returned: 0 in 0.246s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[347de0f4-90ad-461f-bf1c-68b71680de6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260]
Nov 02 17:30:22 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260] successful.
Nov 02 17:30:22 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e4ff5c-ddaa-47af-8480-9c6b874373a2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb8f38f-d061-422f-b386-d654361dc970]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:30:22 user nova-compute[74980]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:30:22 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:30:22 user nova-compute[74980]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:30:22 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.474s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[58696478-01cd-404f-8527-cb293af85d42]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdHmzSgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:30:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.508s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] <== connect_volume: return (1510ms) {'type': 'block', 'scsi_wwn': '26333646561373133', 'path': '/dev/sdc'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333646561373133', 'path': '/dev/sdc'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-757507002',display_name='tempest-ServerActionsTestOtherA-server-757507002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-757507002',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLnMhbM0oba6rJcByxBYQLlndi5MHkt5CHpXxfq+RJdLBsoLWmSnT0vVaxYrrZ06wl3cBC9G1WoMy7HQ9vT9DdZBt3/Q/q1q9MknpNsiMnCx1tDgUx7vQwwWmQat63Hng==',key_name='tempest-keypair-1476871667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb10da584734aedb3d08879a4ffc2b2',ramdisk_id='',reservation_id='r-7b5n7s8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-50427258',owner_user_name='tempest-ServerActionsTestOtherA-50427258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:30:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e61d486aa0bf4b1fb4332aabfa5dafd7',uuid=66da6804-057c-4806-b036-d246768c498d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converting VIF {"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=8f1cd067-6e00-4d28-9879-a8f775d31fa8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cd067-6e') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG nova.objects.instance [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lazy-loading 'pci_devices' on Instance uuid 66da6804-057c-4806-b036-d246768c498d {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:30:23 user nova-compute[74980]:   <uuid>66da6804-057c-4806-b036-d246768c498d</uuid>
Nov 02 17:30:23 user nova-compute[74980]:   <name>instance-00000018</name>
Nov 02 17:30:23 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:30:23 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:30:23 user nova-compute[74980]:   <metadata>
Nov 02 17:30:23 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:30:23 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:30:23 user nova-compute[74980]:       <nova:name>tempest-ServerActionsTestOtherA-server-757507002</nova:name>
Nov 02 17:30:23 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:30:21</nova:creationTime>
Nov 02 17:30:23 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:30:23 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:30:23 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:30:23 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:30:23 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:30:23 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:30:23 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:30:23 user nova-compute[74980]:       <nova:owner>
Nov 02 17:30:23 user nova-compute[74980]:         <nova:user uuid="e61d486aa0bf4b1fb4332aabfa5dafd7">tempest-ServerActionsTestOtherA-50427258-project-member</nova:user>
Nov 02 17:30:23 user nova-compute[74980]:         <nova:project uuid="7bb10da584734aedb3d08879a4ffc2b2">tempest-ServerActionsTestOtherA-50427258</nova:project>
Nov 02 17:30:23 user nova-compute[74980]:       </nova:owner>
Nov 02 17:30:23 user nova-compute[74980]:       <nova:ports>
Nov 02 17:30:23 user nova-compute[74980]:         <nova:port uuid="8f1cd067-6e00-4d28-9879-a8f775d31fa8">
Nov 02 17:30:23 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 17:30:23 user nova-compute[74980]:         </nova:port>
Nov 02 17:30:23 user nova-compute[74980]:       </nova:ports>
Nov 02 17:30:23 user nova-compute[74980]:     </nova:instance>
Nov 02 17:30:23 user nova-compute[74980]:   </metadata>
Nov 02 17:30:23 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:30:23 user nova-compute[74980]:     <system>
Nov 02 17:30:23 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:30:23 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:30:23 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:30:23 user nova-compute[74980]:       <entry name="serial">66da6804-057c-4806-b036-d246768c498d</entry>
Nov 02 17:30:23 user nova-compute[74980]:       <entry name="uuid">66da6804-057c-4806-b036-d246768c498d</entry>
Nov 02 17:30:23 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:30:23 user nova-compute[74980]:     </system>
Nov 02 17:30:23 user nova-compute[74980]:   </sysinfo>
Nov 02 17:30:23 user nova-compute[74980]:   <os>
Nov 02 17:30:23 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:30:23 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:30:23 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:30:23 user nova-compute[74980]:   </os>
Nov 02 17:30:23 user nova-compute[74980]:   <features>
Nov 02 17:30:23 user nova-compute[74980]:     <acpi/>
Nov 02 17:30:23 user nova-compute[74980]:     <apic/>
Nov 02 17:30:23 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:30:23 user nova-compute[74980]:   </features>
Nov 02 17:30:23 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:30:23 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:30:23 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:30:23 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:30:23 user nova-compute[74980]:   </clock>
Nov 02 17:30:23 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:30:23 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:30:23 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:30:23 user nova-compute[74980]:   </cpu>
Nov 02 17:30:23 user nova-compute[74980]:   <devices>
Nov 02 17:30:23 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:30:23 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:30:23 user nova-compute[74980]:       <source dev="/dev/sdc"/>
Nov 02 17:30:23 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:30:23 user nova-compute[74980]:       <serial>a3b9a62f-0fd4-479d-88d9-5b39a58635fb</serial>
Nov 02 17:30:23 user nova-compute[74980]:     </disk>
Nov 02 17:30:23 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:30:23 user nova-compute[74980]:       <mac address="fa:16:3e:da:a2:82"/>
Nov 02 17:30:23 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:30:23 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:30:23 user nova-compute[74980]:       <target dev="tap8f1cd067-6e"/>
Nov 02 17:30:23 user nova-compute[74980]:     </interface>
Nov 02 17:30:23 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:30:23 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/66da6804-057c-4806-b036-d246768c498d/console.log" append="off"/>
Nov 02 17:30:23 user nova-compute[74980]:     </serial>
Nov 02 17:30:23 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:30:23 user nova-compute[74980]:     <video>
Nov 02 17:30:23 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:30:23 user nova-compute[74980]:     </video>
Nov 02 17:30:23 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:30:23 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:30:23 user nova-compute[74980]:     </rng>
Nov 02 17:30:23 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:30:23 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:30:23 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:30:23 user nova-compute[74980]:     </memballoon>
Nov 02 17:30:23 user nova-compute[74980]:   </devices>
Nov 02 17:30:23 user nova-compute[74980]: </domain>
Nov 02 17:30:23 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-757507002',display_name='tempest-ServerActionsTestOtherA-server-757507002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-757507002',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLnMhbM0oba6rJcByxBYQLlndi5MHkt5CHpXxfq+RJdLBsoLWmSnT0vVaxYrrZ06wl3cBC9G1WoMy7HQ9vT9DdZBt3/Q/q1q9MknpNsiMnCx1tDgUx7vQwwWmQat63Hng==',key_name='tempest-keypair-1476871667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bb10da584734aedb3d08879a4ffc2b2',ramdisk_id='',reservation_id='r-7b5n7s8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-50427258',owner_user_name='tempest-ServerActionsTestOtherA-50427258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:30:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e61d486aa0bf4b1fb4332aabfa5dafd7',uuid=66da6804-057c-4806-b036-d246768c498d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converting VIF {"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=8f1cd067-6e00-4d28-9879-a8f775d31fa8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cd067-6e') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG os_vif [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=8f1cd067-6e00-4d28-9879-a8f775d31fa8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cd067-6e') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7547397c-dccf-5c4a-b203-d3616bfe75c4', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f1cd067-6e, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f1cd067-6e, col_values=(('qos', UUID('394d1b6e-e629-4185-bcd2-7b454efce850')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f1cd067-6e, col_values=(('external_ids', {'iface-id': '8f1cd067-6e00-4d28-9879-a8f775d31fa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:a2:82', 'vm-uuid': '66da6804-057c-4806-b036-d246768c498d'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:23 user nova-compute[74980]: INFO os_vif [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=8f1cd067-6e00-4d28-9879-a8f775d31fa8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cd067-6e')
Nov 02 17:30:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:30:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] No VIF found with MAC fa:16:3e:da:a2:82, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:30:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-a7b9054f-a51f-4f8f-a55b-55122031b738 req-1984b4c3-89bd-445c-a37d-f6d3af4e9c0f service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received event network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:30:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a7b9054f-a51f-4f8f-a55b-55122031b738 req-1984b4c3-89bd-445c-a37d-f6d3af4e9c0f service nova] Acquiring lock "66da6804-057c-4806-b036-d246768c498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:30:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a7b9054f-a51f-4f8f-a55b-55122031b738 req-1984b4c3-89bd-445c-a37d-f6d3af4e9c0f service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:30:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a7b9054f-a51f-4f8f-a55b-55122031b738 req-1984b4c3-89bd-445c-a37d-f6d3af4e9c0f service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:30:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-a7b9054f-a51f-4f8f-a55b-55122031b738 req-1984b4c3-89bd-445c-a37d-f6d3af4e9c0f service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] No waiting events found dispatching network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:30:24 user nova-compute[74980]: WARNING nova.compute.manager [req-a7b9054f-a51f-4f8f-a55b-55122031b738 req-1984b4c3-89bd-445c-a37d-f6d3af4e9c0f service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received unexpected event network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 for instance with vm_state building and task_state spawning.
Nov 02 17:30:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-6dcffbbc-7aaf-451f-8076-3d7ee2ade9c0 req-ac7c4680-9238-4c71-baf4-86ea61837745 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Received event network-changed-22c5f565-6c8a-4bea-9958-500859dab34d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:30:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-6dcffbbc-7aaf-451f-8076-3d7ee2ade9c0 req-ac7c4680-9238-4c71-baf4-86ea61837745 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Refreshing instance network info cache due to event network-changed-22c5f565-6c8a-4bea-9958-500859dab34d. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:30:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6dcffbbc-7aaf-451f-8076-3d7ee2ade9c0 req-ac7c4680-9238-4c71-baf4-86ea61837745 service nova] Acquiring lock "refresh_cache-845a016d-9f39-4fae-9e89-0ecebb63c9f8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:30:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6dcffbbc-7aaf-451f-8076-3d7ee2ade9c0 req-ac7c4680-9238-4c71-baf4-86ea61837745 service nova] Acquired lock "refresh_cache-845a016d-9f39-4fae-9e89-0ecebb63c9f8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:30:26 user nova-compute[74980]: DEBUG nova.network.neutron [req-6dcffbbc-7aaf-451f-8076-3d7ee2ade9c0 req-ac7c4680-9238-4c71-baf4-86ea61837745 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Refreshing network info cache for port 22c5f565-6c8a-4bea-9958-500859dab34d {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:30:27 user nova-compute[74980]: DEBUG nova.compute.manager [req-278992e6-4324-4a3d-80f6-e427c6dfbd33 req-1d64e29d-a4ee-4d21-9b43-6270f52603dd service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received event network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:30:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-278992e6-4324-4a3d-80f6-e427c6dfbd33 req-1d64e29d-a4ee-4d21-9b43-6270f52603dd service nova] Acquiring lock "66da6804-057c-4806-b036-d246768c498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:30:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-278992e6-4324-4a3d-80f6-e427c6dfbd33 req-1d64e29d-a4ee-4d21-9b43-6270f52603dd service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:30:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-278992e6-4324-4a3d-80f6-e427c6dfbd33 req-1d64e29d-a4ee-4d21-9b43-6270f52603dd service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:30:27 user nova-compute[74980]: DEBUG nova.compute.manager [req-278992e6-4324-4a3d-80f6-e427c6dfbd33 req-1d64e29d-a4ee-4d21-9b43-6270f52603dd service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] No waiting events found dispatching network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:30:27 user nova-compute[74980]: WARNING nova.compute.manager [req-278992e6-4324-4a3d-80f6-e427c6dfbd33 req-1d64e29d-a4ee-4d21-9b43-6270f52603dd service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received unexpected event network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 for instance with vm_state building and task_state spawning.
Nov 02 17:30:27 user nova-compute[74980]: DEBUG nova.network.neutron [req-6dcffbbc-7aaf-451f-8076-3d7ee2ade9c0 req-ac7c4680-9238-4c71-baf4-86ea61837745 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Updated VIF entry in instance network info cache for port 22c5f565-6c8a-4bea-9958-500859dab34d. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:30:27 user nova-compute[74980]: DEBUG nova.network.neutron [req-6dcffbbc-7aaf-451f-8076-3d7ee2ade9c0 req-ac7c4680-9238-4c71-baf4-86ea61837745 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Updating instance_info_cache with network_info: [{"id": "22c5f565-6c8a-4bea-9958-500859dab34d", "address": "fa:16:3e:33:5e:ae", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c5f565-6c", "ovs_interfaceid": "22c5f565-6c8a-4bea-9958-500859dab34d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:30:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6dcffbbc-7aaf-451f-8076-3d7ee2ade9c0 req-ac7c4680-9238-4c71-baf4-86ea61837745 service nova] Releasing lock "refresh_cache-845a016d-9f39-4fae-9e89-0ecebb63c9f8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:30:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:30:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:30:27 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 66da6804-057c-4806-b036-d246768c498d] Instance spawned successfully.
Nov 02 17:30:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:30:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:30:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:30:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:30:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:30:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:30:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:30:27 user nova-compute[74980]: INFO nova.compute.manager [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 02 17:30:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:30:27 user nova-compute[74980]: INFO nova.compute.manager [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Took 25.99 seconds to build instance.
Nov 02 17:30:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a13cf83d-955c-4293-8f95-b2d34c5c728a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "66da6804-057c-4806-b036-d246768c498d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.122s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:30:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:30:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:30:33 user nova-compute[74980]: DEBUG nova.objects.instance [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'flavor' on Instance uuid 845a016d-9f39-4fae-9e89-0ecebb63c9f8 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:30:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.170s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:30:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:30:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:30:33 user nova-compute[74980]: INFO nova.compute.manager [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Attaching volume 6d6334de-98c8-46a4-9996-939d0d1d9b74 to /dev/vdb
Nov 02 17:30:34 user nova-compute[74980]: DEBUG os_brick.utils [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a4acd9-9069-4b97-99c2-0652eb933057]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87a86b5-f692-4bfe-a676-c2a587240257]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17c757c-f23d-473a-8e69-efd69e08a4ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0758393-4cd7-4435-b59c-59f37a3d3508]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:30:34 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:30:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53a0b98-d404-4325-bdf1-93156c90376f]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG os_brick.utils [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Updating existing volume attachment record: dd85cf78-c999-42cb-8cb8-efb45d336de3 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:30:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:36 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 08309ef4-cf53-47b0-8960-01aba8903030 is timed out.
Nov 02 17:30:36 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Successfully detached device vdb from instance 08309ef4-cf53-47b0-8960-01aba8903030 from the live domain config.
Nov 02 17:30:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHwJlMvX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:30:36 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[73191e6e-9882-4db8-81bf-811a31e3e764]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:30:36 user nova-compute[74980]: No targets found.
Nov 02 17:30:36 user nova-compute[74980]: iSNS:
Nov 02 17:30:36 user nova-compute[74980]: No targets found.
Nov 02 17:30:36 user nova-compute[74980]: STATIC:
Nov 02 17:30:36 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb
Nov 02 17:30:36 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:30:36 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:30:36 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1
Nov 02 17:30:36 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:30:36 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:30:36 user nova-compute[74980]: FIRMWARE:
Nov 02 17:30:36 user nova-compute[74980]: No targets found.
Nov 02 17:30:36 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:30:36 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:30:36 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f273e52a-f678-44e2-bad6-9b5c23adf1ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88494f3-e543-409c-93ab-f6c72722628b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:30:36 user nova-compute[74980]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:30:36 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 (non-flash)
Nov 02 17:30:36 user nova-compute[74980]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:30:36 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b46ad870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9fda56-8006-42aa-8d67-4a4ca069ccc7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e989cb3e-0216-4712-b109-33e8494fff40]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a6ba05-3039-4117-94c6-d8325b5286d3]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00e7e0a-08a4-4fe1-8d3a-02e66c78095f]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18f4e1e-0067-4c1c-89fd-9bbb913a8b00]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7e197f-caa3-45a5-b085-197c1dbb7a75]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1, portal: 172.16.0.220,3260]
Nov 02 17:30:36 user nova-compute[74980]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1, portal: 172.16.0.220,3260] successful.
Nov 02 17:30:36 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e82ef809-3d48-410b-830a-39125caea1f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cb6b09-d4c1-421f-ad96-9b424c0862ea]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] <== disconnect_volume: return (325ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:30:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:30:37 user nova-compute[74980]: DEBUG nova.objects.instance [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lazy-loading 'flavor' on Instance uuid 08309ef4-cf53-47b0-8960-01aba8903030 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:30:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3446bd5c-f2b4-4175-b4d3-a35f9776968a tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "08309ef4-cf53-47b0-8960-01aba8903030" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.922s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:30:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:30:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJWuNnOR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:30:54 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:30:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:30:54 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:30:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:30:54 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc868bf-d2c2-4cb9-a795-5d9b21d43363]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:30:54 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcec447-e5d6-4390-af25-9236c5d3c94a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74] added
Nov 02 17:30:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b51296-3f57-4f1c-be8e-82468f8f0849]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe1eeef-abea-4a0c-bf12-d57026da77f4]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJWuNnOR {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJWuNnOR" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c896e8-0eb6-47aa-a899-a771de4f1c54]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qJWuNnOR'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05a707f-cd54-4964-80ae-675024ac308a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7442536d-a1b2-4c2a-b1e0-9e1605438db6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:30:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:30:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:30:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acf4d10-8ec4-4fce-9008-38c078b63345]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74, portal: 172.16.0.220,3260]
Nov 02 17:30:55 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74, portal: 172.16.0.220,3260] successful.
Nov 02 17:30:55 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8a8341-19e1-414d-b0db-a150fb5ab5c8]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[38db8552-8835-4faf-b769-ebaef267b07b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:30:55 user nova-compute[74980]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 (non-flash)
Nov 02 17:30:55 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:30:55 user nova-compute[74980]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 (non-flash)
Nov 02 17:30:55 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[854958ae-3d09-4ab1-a469-e14f251f01dd]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:30:55 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:30:56 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:30:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJWuNnOR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:30:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:30:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26462356364346565', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:30:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462356364346565', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:30:56 user nova-compute[74980]: DEBUG nova.objects.instance [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'flavor' on Instance uuid 845a016d-9f39-4fae-9e89-0ecebb63c9f8 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:30:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:30:56 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:30:56 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:30:56 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:30:56 user nova-compute[74980]:   <serial>6d6334de-98c8-46a4-9996-939d0d1d9b74</serial>
Nov 02 17:30:56 user nova-compute[74980]: </disk>
Nov 02 17:30:56 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:30:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:30:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:30:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] No VIF found with MAC fa:16:3e:33:5e:ae, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:30:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d186ff13-6329-4d8f-a190-a0dc8509fe35 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:30:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:30:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:30:58 user nova-compute[74980]: INFO nova.compute.manager [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Detaching volume 6d6334de-98c8-46a4-9996-939d0d1d9b74
Nov 02 17:30:58 user nova-compute[74980]: INFO nova.virt.block_device [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Attempting to driver detach volume 6d6334de-98c8-46a4-9996-939d0d1d9b74 from mountpoint /dev/vdb
Nov 02 17:30:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Attempting to detach device vdb from instance 845a016d-9f39-4fae-9e89-0ecebb63c9f8 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:30:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:30:58 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:30:58 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:30:58 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:30:58 user nova-compute[74980]:   <serial>6d6334de-98c8-46a4-9996-939d0d1d9b74</serial>
Nov 02 17:30:58 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:30:58 user nova-compute[74980]: </disk>
Nov 02 17:30:58 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:30:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:58 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Successfully detached device vdb from instance 845a016d-9f39-4fae-9e89-0ecebb63c9f8 from the persistent domain config.
Nov 02 17:30:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 845a016d-9f39-4fae-9e89-0ecebb63c9f8 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:30:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:30:58 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:30:58 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:30:58 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:30:58 user nova-compute[74980]:   <serial>6d6334de-98c8-46a4-9996-939d0d1d9b74</serial>
Nov 02 17:30:58 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:30:58 user nova-compute[74980]: </disk>
Nov 02 17:30:58 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:30:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 845a016d-9f39-4fae-9e89-0ecebb63c9f8 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:30:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:30:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:31:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "08309ef4-cf53-47b0-8960-01aba8903030" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:06 user nova-compute[74980]: INFO nova.compute.manager [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Terminating instance
Nov 02 17:31:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:31:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-59ce5ba2-e3eb-427a-8468-cd84a25e89cf req-39cc53d4-b3da-4716-aa46-1a790934eebc service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-vif-unplugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-59ce5ba2-e3eb-427a-8468-cd84a25e89cf req-39cc53d4-b3da-4716-aa46-1a790934eebc service nova] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-59ce5ba2-e3eb-427a-8468-cd84a25e89cf req-39cc53d4-b3da-4716-aa46-1a790934eebc service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-59ce5ba2-e3eb-427a-8468-cd84a25e89cf req-39cc53d4-b3da-4716-aa46-1a790934eebc service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-59ce5ba2-e3eb-427a-8468-cd84a25e89cf req-39cc53d4-b3da-4716-aa46-1a790934eebc service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] No waiting events found dispatching network-vif-unplugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:31:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-59ce5ba2-e3eb-427a-8468-cd84a25e89cf req-39cc53d4-b3da-4716-aa46-1a790934eebc service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-vif-unplugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:31:07 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Instance destroyed successfully.
Nov 02 17:31:07 user nova-compute[74980]: DEBUG nova.objects.instance [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lazy-loading 'resources' on Instance uuid 08309ef4-cf53-47b0-8960-01aba8903030 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:23:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1380814959',display_name='tempest-ServerStableDeviceRescueTest-server-1380814959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1380814959',id=19,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbrZDVDF9WyskaiAHzOeYQPSBGf4ej2VA+399a6ly1594uUr7g7/LcK5OWhmyhR11uj6Xtpiag80/HJmX16EEfFuhlDjN9qlotT6SxweN3ezOBWJHHLcUs9aH5CmfDGyw==',key_name='tempest-keypair-763038001',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:27:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fdd7d89a7e24ebab57bc95cc888fdf1',ramdisk_id='',reservation_id='r-nodh1jeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-101974758',owner_user_name='tempest-ServerStableDeviceRescueTest-101974758-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:29:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2213678ccb5047c5a679917c61a1bc69',uuid=08309ef4-cf53-47b0-8960-01aba8903030,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Converting VIF {"id": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "address": "fa:16:3e:c6:19:cf", "network": {"id": "2ee0006d-76b0-42e6-b47f-ab9804e4c021", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-56567986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fdd7d89a7e24ebab57bc95cc888fdf1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9b054a-bb", "ovs_interfaceid": "fe9b054a-bbfc-457c-86bf-dede3bb2c8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:19:cf,bridge_name='br-int',has_traffic_filtering=True,id=fe9b054a-bbfc-457c-86bf-dede3bb2c8dc,network=Network(2ee0006d-76b0-42e6-b47f-ab9804e4c021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9b054a-bb') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG os_vif [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:19:cf,bridge_name='br-int',has_traffic_filtering=True,id=fe9b054a-bbfc-457c-86bf-dede3bb2c8dc,network=Network(2ee0006d-76b0-42e6-b47f-ab9804e4c021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9b054a-bb') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe9b054a-bb, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b337c90e-8332-4e72-a1cd-f0985047af8f) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:07 user nova-compute[74980]: INFO os_vif [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:19:cf,bridge_name='br-int',has_traffic_filtering=True,id=fe9b054a-bbfc-457c-86bf-dede3bb2c8dc,network=Network(2ee0006d-76b0-42e6-b47f-ab9804e4c021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9b054a-bb')
Nov 02 17:31:07 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Deleting instance files /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030_del
Nov 02 17:31:07 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Deletion of /opt/stack/data/nova/instances/08309ef4-cf53-47b0-8960-01aba8903030_del complete
Nov 02 17:31:07 user nova-compute[74980]: INFO nova.compute.manager [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 02 17:31:07 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:31:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:08 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:31:08 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:31:08 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Took 1.40 seconds to deallocate network for instance.
Nov 02 17:31:08 user nova-compute[74980]: DEBUG nova.compute.manager [req-6cde6be6-aca3-4c9a-98ee-842eb5d7b02b req-3f0694e5-41ae-4846-889d-459e243c7749 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6cde6be6-aca3-4c9a-98ee-842eb5d7b02b req-3f0694e5-41ae-4846-889d-459e243c7749 service nova] Acquiring lock "08309ef4-cf53-47b0-8960-01aba8903030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6cde6be6-aca3-4c9a-98ee-842eb5d7b02b req-3f0694e5-41ae-4846-889d-459e243c7749 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6cde6be6-aca3-4c9a-98ee-842eb5d7b02b req-3f0694e5-41ae-4846-889d-459e243c7749 service nova] Lock "08309ef4-cf53-47b0-8960-01aba8903030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:08 user nova-compute[74980]: DEBUG nova.compute.manager [req-6cde6be6-aca3-4c9a-98ee-842eb5d7b02b req-3f0694e5-41ae-4846-889d-459e243c7749 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] No waiting events found dispatching network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:31:08 user nova-compute[74980]: WARNING nova.compute.manager [req-6cde6be6-aca3-4c9a-98ee-842eb5d7b02b req-3f0694e5-41ae-4846-889d-459e243c7749 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received unexpected event network-vif-plugged-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc for instance with vm_state active and task_state deleting.
Nov 02 17:31:08 user nova-compute[74980]: DEBUG nova.compute.manager [req-6cde6be6-aca3-4c9a-98ee-842eb5d7b02b req-3f0694e5-41ae-4846-889d-459e243c7749 service nova] [instance: 08309ef4-cf53-47b0-8960-01aba8903030] Received event network-vif-deleted-fe9b054a-bbfc-457c-86bf-dede3bb2c8dc {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:08 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:31:08 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:31:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:09 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Deleted allocations for instance 08309ef4-cf53-47b0-8960-01aba8903030
Nov 02 17:31:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-71a664f1-5e06-4463-969e-4f3f7d67c6e2 tempest-ServerStableDeviceRescueTest-101974758 tempest-ServerStableDeviceRescueTest-101974758-project-member] Lock "08309ef4-cf53-47b0-8960-01aba8903030" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.978s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:12 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:31:12 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:31:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:12 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:31:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:12 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:31:12 user nova-compute[74980]: INFO nova.compute.claims [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Claim successful on node user
Nov 02 17:31:12 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:31:12 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:31:13 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:31:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG nova.policy [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46cbf858998242a1a5d8b14b0e56cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1b48d7070548bdae52f005ce12d606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:31:13 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Creating image(s)
Nov 02 17:31:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "/opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "/opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "a1fb95080e4142a4f989cb5f269e62c5ba5514d0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "a1fb95080e4142a4f989cb5f269e62c5ba5514d0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0.part --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0.part --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG nova.virt.images [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] 13d514af-9a16-4b69-bb3d-c97adc69a481 was qcow2, converting to raw {{(pid=74980) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0.part /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0.converted {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:13 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Successfully created port: 28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0.part /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0.converted" returned: 0 in 0.419s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0.converted --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "a1fb95080e4142a4f989cb5f269e62c5ba5514d0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.248s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Successfully updated port: 28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0 --force-share --output=json" returned: 0 in 0.190s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "a1fb95080e4142a4f989cb5f269e62c5ba5514d0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "a1fb95080e4142a4f989cb5f269e62c5ba5514d0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquired lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-34e6b9d2-4d83-4e33-81c2-2611ba00de68 req-b9376646-6d8f-4cdf-9127-5df4b04846a2 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received event network-changed-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-34e6b9d2-4d83-4e33-81c2-2611ba00de68 req-b9376646-6d8f-4cdf-9127-5df4b04846a2 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Refreshing instance network info cache due to event network-changed-28b668aa-b083-474c-bc08-9bd96a7ea7ff. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-34e6b9d2-4d83-4e33-81c2-2611ba00de68 req-b9376646-6d8f-4cdf-9127-5df4b04846a2 service nova] Acquiring lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0 --force-share --output=json" returned: 0 in 0.196s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0,backing_fmt=raw /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0,backing_fmt=raw /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk 1073741824" returned: 0 in 0.047s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "a1fb95080e4142a4f989cb5f269e62c5ba5514d0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0 --force-share --output=json" returned: 0 in 0.168s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updating instance_info_cache with network_info: [{"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Releasing lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Instance network_info: |[{"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-34e6b9d2-4d83-4e33-81c2-2611ba00de68 req-b9376646-6d8f-4cdf-9127-5df4b04846a2 service nova] Acquired lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.network.neutron [req-34e6b9d2-4d83-4e33-81c2-2611ba00de68 req-b9376646-6d8f-4cdf-9127-5df4b04846a2 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Refreshing network info cache for port 28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Cannot resize image /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Ensure instance console log exists: /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Start _get_guest_xml network_info=[{"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:31:09Z,direct_url=<?>,disk_format='qcow2',id=13d514af-9a16-4b69-bb3d-c97adc69a481,min_disk=0,min_ram=0,name='tempest-scenario-img--2104011276',owner='ad1b48d7070548bdae52f005ce12d606',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:31:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '13d514af-9a16-4b69-bb3d-c97adc69a481'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:31:15 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:31:15 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:31:09Z,direct_url=<?>,disk_format='qcow2',id=13d514af-9a16-4b69-bb3d-c97adc69a481,min_disk=0,min_ram=0,name='tempest-scenario-img--2104011276',owner='ad1b48d7070548bdae52f005ce12d606',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:31:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-710681487',display_name='tempest-TestMinimumBasicScenario-server-710681487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-710681487',id=25,image_ref='13d514af-9a16-4b69-bb3d-c97adc69a481',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0577uFfOT8cUN6BtfQwlMQpRR/j74a2V6qrBANqwx4s/9epUKXZYsUi41B9mVFJjJCL5YkxgjxKwmbak1uGe6YArtVcvzacA13o+c0rtgXDMSTQ4iyD7+g4drcVrU92Q==',key_name='tempest-TestMinimumBasicScenario-1334816697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad1b48d7070548bdae52f005ce12d606',ramdisk_id='',reservation_id='r-df01e7ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13d514af-9a16-4b69-bb3d-c97adc69a481',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-487832598',owner_user_name='tempest-TestMinimumBasicScenario-487832598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:31:13Z,user_data=None,user_id='46cbf858998242a1a5d8b14b0e56cace',uuid=dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converting VIF {"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:6c:9c,bridge_name='br-int',has_traffic_filtering=True,id=28b668aa-b083-474c-bc08-9bd96a7ea7ff,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b668aa-b0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.objects.instance [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lazy-loading 'pci_devices' on Instance uuid dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:31:15 user nova-compute[74980]:   <uuid>dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275</uuid>
Nov 02 17:31:15 user nova-compute[74980]:   <name>instance-00000019</name>
Nov 02 17:31:15 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:31:15 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:31:15 user nova-compute[74980]:   <metadata>
Nov 02 17:31:15 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:31:15 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:31:15 user nova-compute[74980]:       <nova:name>tempest-TestMinimumBasicScenario-server-710681487</nova:name>
Nov 02 17:31:15 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:31:15</nova:creationTime>
Nov 02 17:31:15 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:31:15 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:31:15 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:31:15 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:31:15 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:31:15 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:31:15 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:31:15 user nova-compute[74980]:       <nova:owner>
Nov 02 17:31:15 user nova-compute[74980]:         <nova:user uuid="46cbf858998242a1a5d8b14b0e56cace">tempest-TestMinimumBasicScenario-487832598-project-member</nova:user>
Nov 02 17:31:15 user nova-compute[74980]:         <nova:project uuid="ad1b48d7070548bdae52f005ce12d606">tempest-TestMinimumBasicScenario-487832598</nova:project>
Nov 02 17:31:15 user nova-compute[74980]:       </nova:owner>
Nov 02 17:31:15 user nova-compute[74980]:       <nova:root type="image" uuid="13d514af-9a16-4b69-bb3d-c97adc69a481"/>
Nov 02 17:31:15 user nova-compute[74980]:       <nova:ports>
Nov 02 17:31:15 user nova-compute[74980]:         <nova:port uuid="28b668aa-b083-474c-bc08-9bd96a7ea7ff">
Nov 02 17:31:15 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 17:31:15 user nova-compute[74980]:         </nova:port>
Nov 02 17:31:15 user nova-compute[74980]:       </nova:ports>
Nov 02 17:31:15 user nova-compute[74980]:     </nova:instance>
Nov 02 17:31:15 user nova-compute[74980]:   </metadata>
Nov 02 17:31:15 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:31:15 user nova-compute[74980]:     <system>
Nov 02 17:31:15 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:31:15 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:31:15 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:31:15 user nova-compute[74980]:       <entry name="serial">dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275</entry>
Nov 02 17:31:15 user nova-compute[74980]:       <entry name="uuid">dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275</entry>
Nov 02 17:31:15 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:31:15 user nova-compute[74980]:     </system>
Nov 02 17:31:15 user nova-compute[74980]:   </sysinfo>
Nov 02 17:31:15 user nova-compute[74980]:   <os>
Nov 02 17:31:15 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:31:15 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:31:15 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:31:15 user nova-compute[74980]:   </os>
Nov 02 17:31:15 user nova-compute[74980]:   <features>
Nov 02 17:31:15 user nova-compute[74980]:     <acpi/>
Nov 02 17:31:15 user nova-compute[74980]:     <apic/>
Nov 02 17:31:15 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:31:15 user nova-compute[74980]:   </features>
Nov 02 17:31:15 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:31:15 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:31:15 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:31:15 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:31:15 user nova-compute[74980]:   </clock>
Nov 02 17:31:15 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:31:15 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:31:15 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:31:15 user nova-compute[74980]:   </cpu>
Nov 02 17:31:15 user nova-compute[74980]:   <devices>
Nov 02 17:31:15 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:31:15 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:31:15 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk"/>
Nov 02 17:31:15 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:31:15 user nova-compute[74980]:     </disk>
Nov 02 17:31:15 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:31:15 user nova-compute[74980]:       <mac address="fa:16:3e:d8:6c:9c"/>
Nov 02 17:31:15 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:31:15 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:31:15 user nova-compute[74980]:       <target dev="tap28b668aa-b0"/>
Nov 02 17:31:15 user nova-compute[74980]:     </interface>
Nov 02 17:31:15 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:31:15 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/console.log" append="off"/>
Nov 02 17:31:15 user nova-compute[74980]:     </serial>
Nov 02 17:31:15 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:31:15 user nova-compute[74980]:     <video>
Nov 02 17:31:15 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:31:15 user nova-compute[74980]:     </video>
Nov 02 17:31:15 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:31:15 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:31:15 user nova-compute[74980]:     </rng>
Nov 02 17:31:15 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:31:15 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:31:15 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:31:15 user nova-compute[74980]:     </memballoon>
Nov 02 17:31:15 user nova-compute[74980]:   </devices>
Nov 02 17:31:15 user nova-compute[74980]: </domain>
Nov 02 17:31:15 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-710681487',display_name='tempest-TestMinimumBasicScenario-server-710681487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-710681487',id=25,image_ref='13d514af-9a16-4b69-bb3d-c97adc69a481',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0577uFfOT8cUN6BtfQwlMQpRR/j74a2V6qrBANqwx4s/9epUKXZYsUi41B9mVFJjJCL5YkxgjxKwmbak1uGe6YArtVcvzacA13o+c0rtgXDMSTQ4iyD7+g4drcVrU92Q==',key_name='tempest-TestMinimumBasicScenario-1334816697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad1b48d7070548bdae52f005ce12d606',ramdisk_id='',reservation_id='r-df01e7ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13d514af-9a16-4b69-bb3d-c97adc69a481',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-487832598',owner_user_name='tempest-TestMinimumBasicScenario-487832598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:31:13Z,user_data=None,user_id='46cbf858998242a1a5d8b14b0e56cace',uuid=dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converting VIF {"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:6c:9c,bridge_name='br-int',has_traffic_filtering=True,id=28b668aa-b083-474c-bc08-9bd96a7ea7ff,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b668aa-b0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG os_vif [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:6c:9c,bridge_name='br-int',has_traffic_filtering=True,id=28b668aa-b083-474c-bc08-9bd96a7ea7ff,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b668aa-b0') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd29ba7d1-8f58-5bbc-99f6-69095abcea57', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28b668aa-b0, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28b668aa-b0, col_values=(('qos', UUID('488e1266-f937-4fe0-8f10-1f257c7e38eb')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28b668aa-b0, col_values=(('external_ids', {'iface-id': '28b668aa-b083-474c-bc08-9bd96a7ea7ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:6c:9c', 'vm-uuid': 'dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:15 user nova-compute[74980]: INFO os_vif [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:6c:9c,bridge_name='br-int',has_traffic_filtering=True,id=28b668aa-b083-474c-bc08-9bd96a7ea7ff,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b668aa-b0')
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] No VIF found with MAC fa:16:3e:d8:6c:9c, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.network.neutron [req-34e6b9d2-4d83-4e33-81c2-2611ba00de68 req-b9376646-6d8f-4cdf-9127-5df4b04846a2 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updated VIF entry in instance network info cache for port 28b668aa-b083-474c-bc08-9bd96a7ea7ff. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG nova.network.neutron [req-34e6b9d2-4d83-4e33-81c2-2611ba00de68 req-b9376646-6d8f-4cdf-9127-5df4b04846a2 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updating instance_info_cache with network_info: [{"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-34e6b9d2-4d83-4e33-81c2-2611ba00de68 req-b9376646-6d8f-4cdf-9127-5df4b04846a2 service nova] Releasing lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:19 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 845a016d-9f39-4fae-9e89-0ecebb63c9f8 is timed out.
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-11dc25de-90b1-40af-8445-0f56372776a1 req-c8b1b32a-63c2-49df-92ef-b1bb5bb72cd1 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received event network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-11dc25de-90b1-40af-8445-0f56372776a1 req-c8b1b32a-63c2-49df-92ef-b1bb5bb72cd1 service nova] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-11dc25de-90b1-40af-8445-0f56372776a1 req-c8b1b32a-63c2-49df-92ef-b1bb5bb72cd1 service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-11dc25de-90b1-40af-8445-0f56372776a1 req-c8b1b32a-63c2-49df-92ef-b1bb5bb72cd1 service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-11dc25de-90b1-40af-8445-0f56372776a1 req-c8b1b32a-63c2-49df-92ef-b1bb5bb72cd1 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] No waiting events found dispatching network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:31:19 user nova-compute[74980]: WARNING nova.compute.manager [req-11dc25de-90b1-40af-8445-0f56372776a1 req-c8b1b32a-63c2-49df-92ef-b1bb5bb72cd1 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received unexpected event network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff for instance with vm_state building and task_state spawning.
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-a679c1fd-628b-4860-b7a1-d7f12a0a5866 req-a84342db-d481-4982-82d3-605176e1d960 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received event network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a679c1fd-628b-4860-b7a1-d7f12a0a5866 req-a84342db-d481-4982-82d3-605176e1d960 service nova] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a679c1fd-628b-4860-b7a1-d7f12a0a5866 req-a84342db-d481-4982-82d3-605176e1d960 service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a679c1fd-628b-4860-b7a1-d7f12a0a5866 req-a84342db-d481-4982-82d3-605176e1d960 service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-a679c1fd-628b-4860-b7a1-d7f12a0a5866 req-a84342db-d481-4982-82d3-605176e1d960 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] No waiting events found dispatching network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:31:19 user nova-compute[74980]: WARNING nova.compute.manager [req-a679c1fd-628b-4860-b7a1-d7f12a0a5866 req-a84342db-d481-4982-82d3-605176e1d960 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received unexpected event network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff for instance with vm_state building and task_state spawning.
Nov 02 17:31:19 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Successfully detached device vdb from instance 845a016d-9f39-4fae-9e89-0ecebb63c9f8 from the live domain config.
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJWuNnOR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:31:19 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:31:19 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Instance spawned successfully.
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:19 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:31:19 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8413MB free_disk=25.313522338867188GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f7217f-d795-481e-b15f-f08315bd4b1a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:31:19 user nova-compute[74980]: No targets found.
Nov 02 17:31:19 user nova-compute[74980]: iSNS:
Nov 02 17:31:19 user nova-compute[74980]: No targets found.
Nov 02 17:31:19 user nova-compute[74980]: STATIC:
Nov 02 17:31:19 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb
Nov 02 17:31:19 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:31:19 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:31:19 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74
Nov 02 17:31:19 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:31:19 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:31:19 user nova-compute[74980]: FIRMWARE:
Nov 02 17:31:19 user nova-compute[74980]: No targets found.
Nov 02 17:31:19 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:31:19 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:31:19 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[250127ab-3f58-41c6-9136-3c8c9f3664c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[535fb4b1-055c-4114-8e53-fc0852836633]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:31:19 user nova-compute[74980]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 (non-flash)
Nov 02 17:31:19 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:31:19 user nova-compute[74980]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 (non-flash)
Nov 02 17:31:19 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b4445f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c42c792-27c7-40c4-8c8e-59cbb7c6e4c5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:19 user nova-compute[74980]: INFO nova.compute.manager [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Took 6.21 seconds to spawn the instance on the hypervisor.
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9f5ebc-888a-4cfc-b767-24dc5f8543e9]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 845a016d-9f39-4fae-9e89-0ecebb63c9f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6319a96b-1499-4d79-8ffe-df25fab1c6d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 66da6804-057c-4806-b036-d246768c498d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5390fafa-accd-4b38-aeba-b1bb9f6a7532]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8515de-5328-4c17-b935-b6e28988a20d]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf50e56-bf1f-4412-9358-9003529ac109]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:31:19 user nova-compute[74980]: INFO nova.compute.manager [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Took 6.96 seconds to build instance.
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f6cb6fc-23a4-40ea-846d-dfcde016c8e9 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.066s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c6da31-242c-4ae0-92f2-02eb982646c1]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74, portal: 172.16.0.220,3260]
Nov 02 17:31:19 user nova-compute[74980]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74, portal: 172.16.0.220,3260] successful.
Nov 02 17:31:19 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d6334de-98c8-46a4-9996-939d0d1d9b74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[282f1335-92b5-4497-ba01-578e8180151c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] <== disconnect_volume: return (328ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:31:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:20 user nova-compute[74980]: DEBUG nova.objects.instance [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'flavor' on Instance uuid 845a016d-9f39-4fae-9e89-0ecebb63c9f8 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:31:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f73d0a6d-d2d3-42e5-97fd-9f7bc1086b24 tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.428s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:20 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:31:20 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:31:20 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:31:20 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 17:31:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:31:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:31:20 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:31:20 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:31:21 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updating instance_info_cache with network_info: [{"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:31:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:31:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:31:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:31:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "976ebe93-f218-49ed-b2e1-6440559cb3d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "976ebe93-f218-49ed-b2e1-6440559cb3d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:31:26 user nova-compute[74980]: INFO nova.compute.claims [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Claim successful on node user
Nov 02 17:31:26 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:31:26 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:31:26 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG nova.policy [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5675b52cc3114389b0195f6a300c3620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c992cd1419d42e9aeeb103900e8b136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:31:26 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Creating image(s)
Nov 02 17:31:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "/opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "/opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "/opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.207s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/disk 1073741824" returned: 0 in 0.068s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Successfully created port: 0123576d-c4a2-49aa-b030-6d33eaf3d634 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Cannot resize image /opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Ensure instance console log exists: /opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Successfully updated port: 0123576d-c4a2-49aa-b030-6d33eaf3d634 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "refresh_cache-976ebe93-f218-49ed-b2e1-6440559cb3d3" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquired lock "refresh_cache-976ebe93-f218-49ed-b2e1-6440559cb3d3" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.compute.manager [req-704450d7-35c2-472c-a977-af12bde32ae9 req-82341207-4a82-4aa2-84a6-c575c3905bb5 service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Received event network-changed-0123576d-c4a2-49aa-b030-6d33eaf3d634 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.compute.manager [req-704450d7-35c2-472c-a977-af12bde32ae9 req-82341207-4a82-4aa2-84a6-c575c3905bb5 service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Refreshing instance network info cache due to event network-changed-0123576d-c4a2-49aa-b030-6d33eaf3d634. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-704450d7-35c2-472c-a977-af12bde32ae9 req-82341207-4a82-4aa2-84a6-c575c3905bb5 service nova] Acquiring lock "refresh_cache-976ebe93-f218-49ed-b2e1-6440559cb3d3" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Updating instance_info_cache with network_info: [{"id": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "address": "fa:16:3e:3d:9b:f7", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0123576d-c4", "ovs_interfaceid": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Releasing lock "refresh_cache-976ebe93-f218-49ed-b2e1-6440559cb3d3" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Instance network_info: |[{"id": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "address": "fa:16:3e:3d:9b:f7", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0123576d-c4", "ovs_interfaceid": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-704450d7-35c2-472c-a977-af12bde32ae9 req-82341207-4a82-4aa2-84a6-c575c3905bb5 service nova] Acquired lock "refresh_cache-976ebe93-f218-49ed-b2e1-6440559cb3d3" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.network.neutron [req-704450d7-35c2-472c-a977-af12bde32ae9 req-82341207-4a82-4aa2-84a6-c575c3905bb5 service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Refreshing network info cache for port 0123576d-c4a2-49aa-b030-6d33eaf3d634 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Start _get_guest_xml network_info=[{"id": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "address": "fa:16:3e:3d:9b:f7", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0123576d-c4", "ovs_interfaceid": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:31:28 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:31:28 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:31:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-912221055',display_name='tempest-VolumesActionsTest-instance-912221055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-912221055',id=26,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c992cd1419d42e9aeeb103900e8b136',ramdisk_id='',reservation_id='r-35wivy9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-782476121',owner_user_name='tempest-VolumesActionsTest-782476121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:31:27Z,user_data=None,user_id='5675b52cc3114389b0195f6a300c3620',uuid=976ebe93-f218-49ed-b2e1-6440559cb3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "address": "fa:16:3e:3d:9b:f7", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0123576d-c4", "ovs_interfaceid": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Converting VIF {"id": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "address": "fa:16:3e:3d:9b:f7", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0123576d-c4", "ovs_interfaceid": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9b:f7,bridge_name='br-int',has_traffic_filtering=True,id=0123576d-c4a2-49aa-b030-6d33eaf3d634,network=Network(d15bb169-1025-4bd1-8bc8-5df04514f280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0123576d-c4') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.objects.instance [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lazy-loading 'pci_devices' on Instance uuid 976ebe93-f218-49ed-b2e1-6440559cb3d3 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:31:28 user nova-compute[74980]:   <uuid>976ebe93-f218-49ed-b2e1-6440559cb3d3</uuid>
Nov 02 17:31:28 user nova-compute[74980]:   <name>instance-0000001a</name>
Nov 02 17:31:28 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:31:28 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:31:28 user nova-compute[74980]:   <metadata>
Nov 02 17:31:28 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:31:28 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:31:28 user nova-compute[74980]:       <nova:name>tempest-VolumesActionsTest-instance-912221055</nova:name>
Nov 02 17:31:28 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:31:28</nova:creationTime>
Nov 02 17:31:28 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:31:28 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:31:28 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:31:28 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:31:28 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:31:28 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:31:28 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:31:28 user nova-compute[74980]:       <nova:owner>
Nov 02 17:31:28 user nova-compute[74980]:         <nova:user uuid="5675b52cc3114389b0195f6a300c3620">tempest-VolumesActionsTest-782476121-project-member</nova:user>
Nov 02 17:31:28 user nova-compute[74980]:         <nova:project uuid="6c992cd1419d42e9aeeb103900e8b136">tempest-VolumesActionsTest-782476121</nova:project>
Nov 02 17:31:28 user nova-compute[74980]:       </nova:owner>
Nov 02 17:31:28 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:31:28 user nova-compute[74980]:       <nova:ports>
Nov 02 17:31:28 user nova-compute[74980]:         <nova:port uuid="0123576d-c4a2-49aa-b030-6d33eaf3d634">
Nov 02 17:31:28 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 17:31:28 user nova-compute[74980]:         </nova:port>
Nov 02 17:31:28 user nova-compute[74980]:       </nova:ports>
Nov 02 17:31:28 user nova-compute[74980]:     </nova:instance>
Nov 02 17:31:28 user nova-compute[74980]:   </metadata>
Nov 02 17:31:28 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:31:28 user nova-compute[74980]:     <system>
Nov 02 17:31:28 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:31:28 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:31:28 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:31:28 user nova-compute[74980]:       <entry name="serial">976ebe93-f218-49ed-b2e1-6440559cb3d3</entry>
Nov 02 17:31:28 user nova-compute[74980]:       <entry name="uuid">976ebe93-f218-49ed-b2e1-6440559cb3d3</entry>
Nov 02 17:31:28 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:31:28 user nova-compute[74980]:     </system>
Nov 02 17:31:28 user nova-compute[74980]:   </sysinfo>
Nov 02 17:31:28 user nova-compute[74980]:   <os>
Nov 02 17:31:28 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:31:28 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:31:28 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:31:28 user nova-compute[74980]:   </os>
Nov 02 17:31:28 user nova-compute[74980]:   <features>
Nov 02 17:31:28 user nova-compute[74980]:     <acpi/>
Nov 02 17:31:28 user nova-compute[74980]:     <apic/>
Nov 02 17:31:28 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:31:28 user nova-compute[74980]:   </features>
Nov 02 17:31:28 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:31:28 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:31:28 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:31:28 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:31:28 user nova-compute[74980]:   </clock>
Nov 02 17:31:28 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:31:28 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:31:28 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:31:28 user nova-compute[74980]:   </cpu>
Nov 02 17:31:28 user nova-compute[74980]:   <devices>
Nov 02 17:31:28 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:31:28 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:31:28 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/disk"/>
Nov 02 17:31:28 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:31:28 user nova-compute[74980]:     </disk>
Nov 02 17:31:28 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:31:28 user nova-compute[74980]:       <mac address="fa:16:3e:3d:9b:f7"/>
Nov 02 17:31:28 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:31:28 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:31:28 user nova-compute[74980]:       <target dev="tap0123576d-c4"/>
Nov 02 17:31:28 user nova-compute[74980]:     </interface>
Nov 02 17:31:28 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:31:28 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/console.log" append="off"/>
Nov 02 17:31:28 user nova-compute[74980]:     </serial>
Nov 02 17:31:28 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:31:28 user nova-compute[74980]:     <video>
Nov 02 17:31:28 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:31:28 user nova-compute[74980]:     </video>
Nov 02 17:31:28 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:31:28 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:31:28 user nova-compute[74980]:     </rng>
Nov 02 17:31:28 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:31:28 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:31:28 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:31:28 user nova-compute[74980]:     </memballoon>
Nov 02 17:31:28 user nova-compute[74980]:   </devices>
Nov 02 17:31:28 user nova-compute[74980]: </domain>
Nov 02 17:31:28 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:31:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-912221055',display_name='tempest-VolumesActionsTest-instance-912221055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-912221055',id=26,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c992cd1419d42e9aeeb103900e8b136',ramdisk_id='',reservation_id='r-35wivy9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-782476121',owner_user_name='tempest-VolumesActionsTest-782476121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:31:27Z,user_data=None,user_id='5675b52cc3114389b0195f6a300c3620',uuid=976ebe93-f218-49ed-b2e1-6440559cb3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "address": "fa:16:3e:3d:9b:f7", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0123576d-c4", "ovs_interfaceid": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Converting VIF {"id": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "address": "fa:16:3e:3d:9b:f7", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0123576d-c4", "ovs_interfaceid": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9b:f7,bridge_name='br-int',has_traffic_filtering=True,id=0123576d-c4a2-49aa-b030-6d33eaf3d634,network=Network(d15bb169-1025-4bd1-8bc8-5df04514f280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0123576d-c4') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG os_vif [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9b:f7,bridge_name='br-int',has_traffic_filtering=True,id=0123576d-c4a2-49aa-b030-6d33eaf3d634,network=Network(d15bb169-1025-4bd1-8bc8-5df04514f280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0123576d-c4') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44644ac9-7a9c-5b8a-82db-e077a7752431', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0123576d-c4, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0123576d-c4, col_values=(('qos', UUID('b6f215ee-8218-475f-8834-392a30dbec7b')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0123576d-c4, col_values=(('external_ids', {'iface-id': '0123576d-c4a2-49aa-b030-6d33eaf3d634', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:9b:f7', 'vm-uuid': '976ebe93-f218-49ed-b2e1-6440559cb3d3'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:28 user nova-compute[74980]: INFO os_vif [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9b:f7,bridge_name='br-int',has_traffic_filtering=True,id=0123576d-c4a2-49aa-b030-6d33eaf3d634,network=Network(d15bb169-1025-4bd1-8bc8-5df04514f280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0123576d-c4')
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] No VIF found with MAC fa:16:3e:3d:9b:f7, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.network.neutron [req-704450d7-35c2-472c-a977-af12bde32ae9 req-82341207-4a82-4aa2-84a6-c575c3905bb5 service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Updated VIF entry in instance network info cache for port 0123576d-c4a2-49aa-b030-6d33eaf3d634. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG nova.network.neutron [req-704450d7-35c2-472c-a977-af12bde32ae9 req-82341207-4a82-4aa2-84a6-c575c3905bb5 service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Updating instance_info_cache with network_info: [{"id": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "address": "fa:16:3e:3d:9b:f7", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0123576d-c4", "ovs_interfaceid": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:31:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-704450d7-35c2-472c-a977-af12bde32ae9 req-82341207-4a82-4aa2-84a6-c575c3905bb5 service nova] Releasing lock "refresh_cache-976ebe93-f218-49ed-b2e1-6440559cb3d3" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:31:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-3493f152-9cc2-4fc2-b38a-8d200d45d3c0 req-ac0a6ac4-a183-4a2b-8833-4881a976783a service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Received event network-vif-plugged-0123576d-c4a2-49aa-b030-6d33eaf3d634 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3493f152-9cc2-4fc2-b38a-8d200d45d3c0 req-ac0a6ac4-a183-4a2b-8833-4881a976783a service nova] Acquiring lock "976ebe93-f218-49ed-b2e1-6440559cb3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3493f152-9cc2-4fc2-b38a-8d200d45d3c0 req-ac0a6ac4-a183-4a2b-8833-4881a976783a service nova] Lock "976ebe93-f218-49ed-b2e1-6440559cb3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3493f152-9cc2-4fc2-b38a-8d200d45d3c0 req-ac0a6ac4-a183-4a2b-8833-4881a976783a service nova] Lock "976ebe93-f218-49ed-b2e1-6440559cb3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-3493f152-9cc2-4fc2-b38a-8d200d45d3c0 req-ac0a6ac4-a183-4a2b-8833-4881a976783a service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] No waiting events found dispatching network-vif-plugged-0123576d-c4a2-49aa-b030-6d33eaf3d634 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:31:30 user nova-compute[74980]: WARNING nova.compute.manager [req-3493f152-9cc2-4fc2-b38a-8d200d45d3c0 req-ac0a6ac4-a183-4a2b-8833-4881a976783a service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Received unexpected event network-vif-plugged-0123576d-c4a2-49aa-b030-6d33eaf3d634 for instance with vm_state building and task_state spawning.
Nov 02 17:31:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:31 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:31:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:31:31 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Instance spawned successfully.
Nov 02 17:31:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:31:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:31:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:31:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:31:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:31:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:31:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:31:32 user nova-compute[74980]: INFO nova.compute.manager [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 02 17:31:32 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:31:32 user nova-compute[74980]: INFO nova.compute.manager [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Took 5.96 seconds to build instance.
Nov 02 17:31:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2da44be4-8254-4abc-ab3e-63dadd8ed6ea tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "976ebe93-f218-49ed-b2e1-6440559cb3d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.106s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:32 user nova-compute[74980]: DEBUG nova.compute.manager [req-27dcc98f-3099-4363-b269-f10eec7aac4e req-412169fd-8aed-4f9b-96f1-3bf867092b38 service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Received event network-vif-plugged-0123576d-c4a2-49aa-b030-6d33eaf3d634 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-27dcc98f-3099-4363-b269-f10eec7aac4e req-412169fd-8aed-4f9b-96f1-3bf867092b38 service nova] Acquiring lock "976ebe93-f218-49ed-b2e1-6440559cb3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-27dcc98f-3099-4363-b269-f10eec7aac4e req-412169fd-8aed-4f9b-96f1-3bf867092b38 service nova] Lock "976ebe93-f218-49ed-b2e1-6440559cb3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-27dcc98f-3099-4363-b269-f10eec7aac4e req-412169fd-8aed-4f9b-96f1-3bf867092b38 service nova] Lock "976ebe93-f218-49ed-b2e1-6440559cb3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:32 user nova-compute[74980]: DEBUG nova.compute.manager [req-27dcc98f-3099-4363-b269-f10eec7aac4e req-412169fd-8aed-4f9b-96f1-3bf867092b38 service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] No waiting events found dispatching network-vif-plugged-0123576d-c4a2-49aa-b030-6d33eaf3d634 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:31:32 user nova-compute[74980]: WARNING nova.compute.manager [req-27dcc98f-3099-4363-b269-f10eec7aac4e req-412169fd-8aed-4f9b-96f1-3bf867092b38 service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Received unexpected event network-vif-plugged-0123576d-c4a2-49aa-b030-6d33eaf3d634 for instance with vm_state active and task_state None.
Nov 02 17:31:32 user nova-compute[74980]: DEBUG nova.compute.manager [req-27dcc98f-3099-4363-b269-f10eec7aac4e req-412169fd-8aed-4f9b-96f1-3bf867092b38 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-changed-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:32 user nova-compute[74980]: DEBUG nova.compute.manager [req-27dcc98f-3099-4363-b269-f10eec7aac4e req-412169fd-8aed-4f9b-96f1-3bf867092b38 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Refreshing instance network info cache due to event network-changed-f5e8978e-28b1-419e-a745-0a784521ee3d. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:31:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-27dcc98f-3099-4363-b269-f10eec7aac4e req-412169fd-8aed-4f9b-96f1-3bf867092b38 service nova] Acquiring lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:31:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-27dcc98f-3099-4363-b269-f10eec7aac4e req-412169fd-8aed-4f9b-96f1-3bf867092b38 service nova] Acquired lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:31:32 user nova-compute[74980]: DEBUG nova.network.neutron [req-27dcc98f-3099-4363-b269-f10eec7aac4e req-412169fd-8aed-4f9b-96f1-3bf867092b38 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Refreshing network info cache for port f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:31:32 user nova-compute[74980]: DEBUG nova.network.neutron [req-27dcc98f-3099-4363-b269-f10eec7aac4e req-412169fd-8aed-4f9b-96f1-3bf867092b38 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updated VIF entry in instance network info cache for port f5e8978e-28b1-419e-a745-0a784521ee3d. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:31:32 user nova-compute[74980]: DEBUG nova.network.neutron [req-27dcc98f-3099-4363-b269-f10eec7aac4e req-412169fd-8aed-4f9b-96f1-3bf867092b38 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating instance_info_cache with network_info: [{"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:31:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-27dcc98f-3099-4363-b269-f10eec7aac4e req-412169fd-8aed-4f9b-96f1-3bf867092b38 service nova] Releasing lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:31:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:48 user nova-compute[74980]: INFO nova.compute.manager [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Terminating instance
Nov 02 17:31:48 user nova-compute[74980]: DEBUG nova.compute.manager [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:31:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-c71bea36-1e5d-42ae-af8c-ec3554e3bcfd req-5c388609-bdae-4fc4-ae43-cbbcea1a4838 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Received event network-vif-unplugged-22c5f565-6c8a-4bea-9958-500859dab34d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c71bea36-1e5d-42ae-af8c-ec3554e3bcfd req-5c388609-bdae-4fc4-ae43-cbbcea1a4838 service nova] Acquiring lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c71bea36-1e5d-42ae-af8c-ec3554e3bcfd req-5c388609-bdae-4fc4-ae43-cbbcea1a4838 service nova] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c71bea36-1e5d-42ae-af8c-ec3554e3bcfd req-5c388609-bdae-4fc4-ae43-cbbcea1a4838 service nova] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-c71bea36-1e5d-42ae-af8c-ec3554e3bcfd req-5c388609-bdae-4fc4-ae43-cbbcea1a4838 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] No waiting events found dispatching network-vif-unplugged-22c5f565-6c8a-4bea-9958-500859dab34d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-c71bea36-1e5d-42ae-af8c-ec3554e3bcfd req-5c388609-bdae-4fc4-ae43-cbbcea1a4838 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Received event network-vif-unplugged-22c5f565-6c8a-4bea-9958-500859dab34d for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:49 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Instance destroyed successfully.
Nov 02 17:31:49 user nova-compute[74980]: DEBUG nova.objects.instance [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lazy-loading 'resources' on Instance uuid 845a016d-9f39-4fae-9e89-0ecebb63c9f8 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:28:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2030664930',display_name='tempest-AttachVolumeNegativeTest-server-2030664930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2030664930',id=22,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvCwL2t1yDX3cRs04uwl9Ru2OGtmi4oYvtizXy7OQk3DUaNKFDu/c7VsOwMqfljn+pBXyySNud6s39S6NPOyIKYScSD7Fmd011cWGSM3rjwuuWDwT6DYiFEHp1IwZ40zQ==',key_name='tempest-keypair-346318422',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:28:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b889d98476584bb1b18080bfa0664810',ramdisk_id='',reservation_id='r-0wmup3mz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1956142060',owner_user_name='tempest-AttachVolumeNegativeTest-1956142060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:28:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a979e164900348beaab104704c92b722',uuid=845a016d-9f39-4fae-9e89-0ecebb63c9f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22c5f565-6c8a-4bea-9958-500859dab34d", "address": "fa:16:3e:33:5e:ae", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c5f565-6c", "ovs_interfaceid": "22c5f565-6c8a-4bea-9958-500859dab34d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converting VIF {"id": "22c5f565-6c8a-4bea-9958-500859dab34d", "address": "fa:16:3e:33:5e:ae", "network": {"id": "e365f8d2-7da3-4481-bb8a-055af0d195ab", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1361123777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b889d98476584bb1b18080bfa0664810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22c5f565-6c", "ovs_interfaceid": "22c5f565-6c8a-4bea-9958-500859dab34d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:5e:ae,bridge_name='br-int',has_traffic_filtering=True,id=22c5f565-6c8a-4bea-9958-500859dab34d,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22c5f565-6c') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG os_vif [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:5e:ae,bridge_name='br-int',has_traffic_filtering=True,id=22c5f565-6c8a-4bea-9958-500859dab34d,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22c5f565-6c') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22c5f565-6c, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1a5beaf-70ba-4042-bc6d-4e178183a26e) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:49 user nova-compute[74980]: INFO os_vif [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:5e:ae,bridge_name='br-int',has_traffic_filtering=True,id=22c5f565-6c8a-4bea-9958-500859dab34d,network=Network(e365f8d2-7da3-4481-bb8a-055af0d195ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22c5f565-6c')
Nov 02 17:31:49 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Deleting instance files /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8_del
Nov 02 17:31:49 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Deletion of /opt/stack/data/nova/instances/845a016d-9f39-4fae-9e89-0ecebb63c9f8_del complete
Nov 02 17:31:49 user nova-compute[74980]: INFO nova.compute.manager [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 02 17:31:49 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:31:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:50 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:31:50 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Took 1.22 seconds to deallocate network for instance.
Nov 02 17:31:50 user nova-compute[74980]: DEBUG nova.compute.manager [req-65ed5fa6-c46b-4814-8381-1b13fdbc35bd req-3401a87e-4641-4d44-aca8-7bb3268ad497 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Received event network-vif-deleted-22c5f565-6c8a-4bea-9958-500859dab34d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:50 user nova-compute[74980]: INFO nova.compute.manager [req-65ed5fa6-c46b-4814-8381-1b13fdbc35bd req-3401a87e-4641-4d44-aca8-7bb3268ad497 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Neutron deleted interface 22c5f565-6c8a-4bea-9958-500859dab34d; detaching it from the instance and deleting it from the info cache
Nov 02 17:31:50 user nova-compute[74980]: DEBUG nova.network.neutron [req-65ed5fa6-c46b-4814-8381-1b13fdbc35bd req-3401a87e-4641-4d44-aca8-7bb3268ad497 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:31:50 user nova-compute[74980]: DEBUG nova.compute.manager [req-65ed5fa6-c46b-4814-8381-1b13fdbc35bd req-3401a87e-4641-4d44-aca8-7bb3268ad497 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Detach interface failed, port_id=22c5f565-6c8a-4bea-9958-500859dab34d, reason: Instance 845a016d-9f39-4fae-9e89-0ecebb63c9f8 could not be found. {{(pid=74980) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 17:31:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:51 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:31:51 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:31:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-8fac1d9d-9611-4705-a54a-92671131b5c5 req-dc76bbe0-85cd-45a3-bfb5-714cb1715d20 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Received event network-vif-plugged-22c5f565-6c8a-4bea-9958-500859dab34d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8fac1d9d-9611-4705-a54a-92671131b5c5 req-dc76bbe0-85cd-45a3-bfb5-714cb1715d20 service nova] Acquiring lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8fac1d9d-9611-4705-a54a-92671131b5c5 req-dc76bbe0-85cd-45a3-bfb5-714cb1715d20 service nova] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8fac1d9d-9611-4705-a54a-92671131b5c5 req-dc76bbe0-85cd-45a3-bfb5-714cb1715d20 service nova] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-8fac1d9d-9611-4705-a54a-92671131b5c5 req-dc76bbe0-85cd-45a3-bfb5-714cb1715d20 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] No waiting events found dispatching network-vif-plugged-22c5f565-6c8a-4bea-9958-500859dab34d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:31:51 user nova-compute[74980]: WARNING nova.compute.manager [req-8fac1d9d-9611-4705-a54a-92671131b5c5 req-dc76bbe0-85cd-45a3-bfb5-714cb1715d20 service nova] [instance: 845a016d-9f39-4fae-9e89-0ecebb63c9f8] Received unexpected event network-vif-plugged-22c5f565-6c8a-4bea-9958-500859dab34d for instance with vm_state deleted and task_state None.
Nov 02 17:31:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:51 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Deleted allocations for instance 845a016d-9f39-4fae-9e89-0ecebb63c9f8
Nov 02 17:31:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-645b2397-904b-4547-8928-703a0dace58a tempest-AttachVolumeNegativeTest-1956142060 tempest-AttachVolumeNegativeTest-1956142060-project-member] Lock "845a016d-9f39-4fae-9e89-0ecebb63c9f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.502s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-d8b72699-3404-42b5-b6b9-fe11ec26ef10 req-7a396b29-6764-4d04-a10a-caa9ef0bddef service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Received event network-changed-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-d8b72699-3404-42b5-b6b9-fe11ec26ef10 req-7a396b29-6764-4d04-a10a-caa9ef0bddef service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Refreshing instance network info cache due to event network-changed-d48f410f-fd59-42c7-bf39-17ccc20ad6b8. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:31:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d8b72699-3404-42b5-b6b9-fe11ec26ef10 req-7a396b29-6764-4d04-a10a-caa9ef0bddef service nova] Acquiring lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:31:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d8b72699-3404-42b5-b6b9-fe11ec26ef10 req-7a396b29-6764-4d04-a10a-caa9ef0bddef service nova] Acquired lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:31:52 user nova-compute[74980]: DEBUG nova.network.neutron [req-d8b72699-3404-42b5-b6b9-fe11ec26ef10 req-7a396b29-6764-4d04-a10a-caa9ef0bddef service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Refreshing network info cache for port d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:31:53 user nova-compute[74980]: DEBUG nova.network.neutron [req-d8b72699-3404-42b5-b6b9-fe11ec26ef10 req-7a396b29-6764-4d04-a10a-caa9ef0bddef service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updated VIF entry in instance network info cache for port d48f410f-fd59-42c7-bf39-17ccc20ad6b8. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:31:53 user nova-compute[74980]: DEBUG nova.network.neutron [req-d8b72699-3404-42b5-b6b9-fe11ec26ef10 req-7a396b29-6764-4d04-a10a-caa9ef0bddef service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updating instance_info_cache with network_info: [{"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:31:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d8b72699-3404-42b5-b6b9-fe11ec26ef10 req-7a396b29-6764-4d04-a10a-caa9ef0bddef service nova] Releasing lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:31:54 user nova-compute[74980]: DEBUG nova.compute.manager [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Stashing vm_state: active {{(pid=74980) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 02 17:31:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:54 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:31:54 user nova-compute[74980]: INFO nova.compute.claims [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Claim successful on node user
Nov 02 17:31:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:54 user nova-compute[74980]: INFO nova.compute.resource_tracker [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Updating resource usage from migration 62a57d6c-41b0-41ff-98f5-463e1e14cd46
Nov 02 17:31:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:54 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:31:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-02b2a2b3-5697-4d1a-a37c-f5df667e1d68 req-132d4f3c-3500-4fa9-b873-38921c5108e9 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received event network-changed-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-02b2a2b3-5697-4d1a-a37c-f5df667e1d68 req-132d4f3c-3500-4fa9-b873-38921c5108e9 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Refreshing instance network info cache due to event network-changed-8f1cd067-6e00-4d28-9879-a8f775d31fa8. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:31:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-02b2a2b3-5697-4d1a-a37c-f5df667e1d68 req-132d4f3c-3500-4fa9-b873-38921c5108e9 service nova] Acquiring lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:31:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-02b2a2b3-5697-4d1a-a37c-f5df667e1d68 req-132d4f3c-3500-4fa9-b873-38921c5108e9 service nova] Acquired lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:31:54 user nova-compute[74980]: DEBUG nova.network.neutron [req-02b2a2b3-5697-4d1a-a37c-f5df667e1d68 req-132d4f3c-3500-4fa9-b873-38921c5108e9 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Refreshing network info cache for port 8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:31:54 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:31:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.331s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:54 user nova-compute[74980]: INFO nova.compute.manager [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Migrating
Nov 02 17:31:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:31:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:31:54 user nova-compute[74980]: INFO nova.compute.rpcapi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 02 17:31:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:31:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:31:55 user nova-compute[74980]: DEBUG nova.network.neutron [req-02b2a2b3-5697-4d1a-a37c-f5df667e1d68 req-132d4f3c-3500-4fa9-b873-38921c5108e9 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Updated VIF entry in instance network info cache for port 8f1cd067-6e00-4d28-9879-a8f775d31fa8. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:31:55 user nova-compute[74980]: DEBUG nova.network.neutron [req-02b2a2b3-5697-4d1a-a37c-f5df667e1d68 req-132d4f3c-3500-4fa9-b873-38921c5108e9 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Updating instance_info_cache with network_info: [{"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:31:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-02b2a2b3-5697-4d1a-a37c-f5df667e1d68 req-132d4f3c-3500-4fa9-b873-38921c5108e9 service nova] Releasing lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:31:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquired lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:31:55 user nova-compute[74980]: DEBUG nova.network.neutron [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:31:55 user nova-compute[74980]: DEBUG nova.network.neutron [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Updating instance_info_cache with network_info: [{"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:31:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Releasing lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:31:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Starting migrate_disk_and_power_off {{(pid=74980) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 02 17:31:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-e9284dcd-48f7-413f-a47e-e98983debe41 req-a09c096a-9be6-4577-b4d5-adfae27d5826 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received event network-vif-unplugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e9284dcd-48f7-413f-a47e-e98983debe41 req-a09c096a-9be6-4577-b4d5-adfae27d5826 service nova] Acquiring lock "66da6804-057c-4806-b036-d246768c498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e9284dcd-48f7-413f-a47e-e98983debe41 req-a09c096a-9be6-4577-b4d5-adfae27d5826 service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e9284dcd-48f7-413f-a47e-e98983debe41 req-a09c096a-9be6-4577-b4d5-adfae27d5826 service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-e9284dcd-48f7-413f-a47e-e98983debe41 req-a09c096a-9be6-4577-b4d5-adfae27d5826 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] No waiting events found dispatching network-vif-unplugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:31:56 user nova-compute[74980]: WARNING nova.compute.manager [req-e9284dcd-48f7-413f-a47e-e98983debe41 req-a09c096a-9be6-4577-b4d5-adfae27d5826 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received unexpected event network-vif-unplugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 for instance with vm_state active and task_state resize_migrating.
Nov 02 17:31:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:56 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 66da6804-057c-4806-b036-d246768c498d] Instance destroyed successfully.
Nov 02 17:31:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-757507002',display_name='tempest-ServerActionsTestOtherA-server-757507002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-757507002',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLnMhbM0oba6rJcByxBYQLlndi5MHkt5CHpXxfq+RJdLBsoLWmSnT0vVaxYrrZ06wl3cBC9G1WoMy7HQ9vT9DdZBt3/Q/q1q9MknpNsiMnCx1tDgUx7vQwwWmQat63Hng==',key_name='tempest-keypair-1476871667',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:30:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7bb10da584734aedb3d08879a4ffc2b2',ramdisk_id='',reservation_id='r-7b5n7s8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-50427258',owner_user_name='tempest-ServerActionsTestOtherA-50427258-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:31:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e61d486aa0bf4b1fb4332aabfa5dafd7',uuid=66da6804-057c-4806-b036-d246768c498d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1549045594-network", "vif_mac": "fa:16:3e:da:a2:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converting VIF {"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1549045594-network", "vif_mac": "fa:16:3e:da:a2:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=8f1cd067-6e00-4d28-9879-a8f775d31fa8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cd067-6e') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_vif [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=8f1cd067-6e00-4d28-9879-a8f775d31fa8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cd067-6e') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f1cd067-6e, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=394d1b6e-e629-4185-bcd2-7b454efce850) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:31:56 user nova-compute[74980]: INFO os_vif [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=8f1cd067-6e00-4d28-9879-a8f775d31fa8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cd067-6e')
Nov 02 17:31:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdHmzSgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:31:56 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d65399-e8a9-4eb7-8786-00d6b54e5955]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:31:56 user nova-compute[74980]: No targets found.
Nov 02 17:31:56 user nova-compute[74980]: iSNS:
Nov 02 17:31:56 user nova-compute[74980]: No targets found.
Nov 02 17:31:56 user nova-compute[74980]: STATIC:
Nov 02 17:31:56 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb
Nov 02 17:31:56 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:31:56 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:31:56 user nova-compute[74980]: FIRMWARE:
Nov 02 17:31:56 user nova-compute[74980]: No targets found.
Nov 02 17:31:56 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:31:56 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:31:56 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d4e31d-e2c6-497e-b859-e9d87acf7691]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[edde4337-8e05-4ac3-96b1-4d9a4eb42505]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:31:56 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:31:56 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b44456c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb'): ({'sdc'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Removing single pathed devices sdc {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[374373dc-c6b1-4b50-9a96-c992d8bbf256]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90c18aa-5af0-42d2-b88e-840c03b6d28b]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Flushing IO for device /dev/sdc {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ade00bf-823f-488c-824e-ed915d6a8317]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4c5f92-1c45-4840-a798-a647fe54236b]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b91a86cd', '/dev/disk/by-id/scsi-1SCST_BIOb91a86cd-c3dea713313a7d28', '/dev/disk/by-id/scsi-26333646561373133') {{(pid=86001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a8055d-3dc9-4790-b3f9-45b1a7035c9e]: (4, None) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e24b04a-bc95-4f22-98f9-63bd88c2b659]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f1f888-62b7-4381-9329-985aacfb90ee]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260]
Nov 02 17:31:56 user nova-compute[74980]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260] successful.
Nov 02 17:31:56 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[717812a3-6807-4371-ba75-434856fcedce]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] <== disconnect_volume: return (311ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:31:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:31:57 user nova-compute[74980]: DEBUG nova.network.neutron [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Port 8f1cd067-6e00-4d28-9879-a8f775d31fa8 binding to destination host user is already ACTIVE {{(pid=74980) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-71eaa5ad-a901-4d30-8185-872fc8084d8c req-532052ec-6daa-4c34-a18f-b306e56af251 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received event network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-71eaa5ad-a901-4d30-8185-872fc8084d8c req-532052ec-6daa-4c34-a18f-b306e56af251 service nova] Acquiring lock "66da6804-057c-4806-b036-d246768c498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-71eaa5ad-a901-4d30-8185-872fc8084d8c req-532052ec-6daa-4c34-a18f-b306e56af251 service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-71eaa5ad-a901-4d30-8185-872fc8084d8c req-532052ec-6daa-4c34-a18f-b306e56af251 service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-71eaa5ad-a901-4d30-8185-872fc8084d8c req-532052ec-6daa-4c34-a18f-b306e56af251 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] No waiting events found dispatching network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:31:58 user nova-compute[74980]: WARNING nova.compute.manager [req-71eaa5ad-a901-4d30-8185-872fc8084d8c req-532052ec-6daa-4c34-a18f-b306e56af251 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received unexpected event network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 for instance with vm_state active and task_state resize_migrated.
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "66da6804-057c-4806-b036-d246768c498d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "66da6804-057c-4806-b036-d246768c498d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "66da6804-057c-4806-b036-d246768c498d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquired lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG nova.network.neutron [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG nova.network.neutron [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Updating instance_info_cache with network_info: [{"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Releasing lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG os_brick.utils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31fb528-7b01-4430-ac7d-bf3374b481be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7d62ea-741a-4390-8063-d59b4d34b6c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0e8906-1e31-4b8f-a91d-21ad78c09b36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dd8723-56fa-4913-8811-f66481f0d1f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:31:58 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:31:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0113ab-80a6-46db-91f3-649877ac4e8e]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:31:58 user nova-compute[74980]: DEBUG os_brick.utils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:31:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:05 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:32:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:08 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:32:08 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:32:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:14 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:32:14 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:32:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:15 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:32:15 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:32:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:15 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:32:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:32:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:17 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:32:17 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:32:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8312MB free_disk=25.273719787597656GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "c6bfac8f-3834-4514-9a56-59c293ced966" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Applying migration context for instance 66da6804-057c-4806-b036-d246768c498d as it has an incoming, in-progress migration 62a57d6c-41b0-41ff-98f5-463e1e14cd46. Migration status is post-migrating {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 17:32:17 user nova-compute[74980]: INFO nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 66da6804-057c-4806-b036-d246768c498d] Updating resource usage from migration 62a57d6c-41b0-41ff-98f5-463e1e14cd46
Nov 02 17:32:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6319a96b-1499-4d79-8ffe-df25fab1c6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 976ebe93-f218-49ed-b2e1-6440559cb3d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Migration 62a57d6c-41b0-41ff-98f5-463e1e14cd46 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 66da6804-057c-4806-b036-d246768c498d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:32:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.322s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:32:18 user nova-compute[74980]: INFO nova.compute.claims [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Claim successful on node user
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Starting finish_migration {{(pid=74980) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Instance directory exists: not creating {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 17:32:18 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Creating image(s)
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Ensure instance console log exists: /opt/stack/data/nova/instances/66da6804-057c-4806-b036-d246768c498d/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Start _get_guest_xml network_info=[{"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1549045594-network", "vif_mac": "fa:16:3e:da:a2:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdHmzSgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '66da6804-057c-4806-b036-d246768c498d', 'attached_at': '2023-11-02T17:32:18.000000', 'detached_at': '', 'volume_id': 'a3b9a62f-0fd4-479d-88d9-5b39a58635fb', 'serial': 'a3b9a62f-0fd4-479d-88d9-5b39a58635fb'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'facf1fdf-ea11-4cdd-8a6d-73f041ef0ded', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:32:18 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:32:18 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdHmzSgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:32:18 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:32:18 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:32:18 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[400ffd76-b360-467e-88d0-67a9584677d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:32:18 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d48c242-a7bc-4f4f-86d5-b2d1de5c4fa0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb] added
Nov 02 17:32:18 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ae5139-f570-4aad-b61c-30302cd2ee24]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38ea025-fb4e-477c-b12a-87ef67ea2b58]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdHmzSgU {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdHmzSgU" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8515973e-5920-4d35-888b-09f5594e153b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xdHmzSgU'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6aea2b-6c27-4011-8ed7-09d8df52e67b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[520a6bd5-0374-4f6b-a0f0-bbcd34e69970]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:32:18 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:32:18 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:32:18 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 17:32:18 user nova-compute[74980]: 
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.094s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:32:18 user nova-compute[74980]: INFO nova.compute.claims [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Claim successful on node user
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1ae4f3-6174-48e9-bc1f-25ca9079d096]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260]
Nov 02 17:32:18 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260] successful.
Nov 02 17:32:18 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[89707423-7a09-4d4f-9906-5a395e869d68]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0fb5aa-61c5-4a70-bf4a-6452d6fc4779]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:32:18 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:32:18 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cdc742-dc1f-43ee-a5d5-c98a485e7e07]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.network.neutron [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdHmzSgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:32:18 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:32:18 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Creating image(s)
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "/opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "/opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.policy [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '985386b6880e4b07bdad162c7860d7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc26ef1932f1408c860b3b9edb4925a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:32:18 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.775s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.compute.manager [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.495s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.compute.manager [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.network.neutron [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:32:19 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.compute.manager [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.network.neutron [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Successfully created port: d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.policy [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '985386b6880e4b07bdad162c7860d7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc26ef1932f1408c860b3b9edb4925a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.compute.manager [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:32:19 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Creating image(s)
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "/opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "/opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "/opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.256s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26333646561373133', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333646561373133', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk 1073741824" returned: 0 in 0.087s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-757507002',display_name='tempest-ServerActionsTestOtherA-server-757507002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-757507002',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLnMhbM0oba6rJcByxBYQLlndi5MHkt5CHpXxfq+RJdLBsoLWmSnT0vVaxYrrZ06wl3cBC9G1WoMy7HQ9vT9DdZBt3/Q/q1q9MknpNsiMnCx1tDgUx7vQwwWmQat63Hng==',key_name='tempest-keypair-1476871667',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:30:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7bb10da584734aedb3d08879a4ffc2b2',ramdisk_id='',reservation_id='r-7b5n7s8x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-50427258',owner_user_name='tempest-ServerActionsTestOtherA-50427258-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:31:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e61d486aa0bf4b1fb4332aabfa5dafd7',uuid=66da6804-057c-4806-b036-d246768c498d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1549045594-network", "vif_mac": "fa:16:3e:da:a2:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converting VIF {"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1549045594-network", "vif_mac": "fa:16:3e:da:a2:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=8f1cd067-6e00-4d28-9879-a8f775d31fa8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cd067-6e') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:32:19 user nova-compute[74980]:   <uuid>66da6804-057c-4806-b036-d246768c498d</uuid>
Nov 02 17:32:19 user nova-compute[74980]:   <name>instance-00000018</name>
Nov 02 17:32:19 user nova-compute[74980]:   <memory>2097152</memory>
Nov 02 17:32:19 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:32:19 user nova-compute[74980]:   <metadata>
Nov 02 17:32:19 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:32:19 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:32:19 user nova-compute[74980]:       <nova:name>tempest-ServerActionsTestOtherA-server-757507002</nova:name>
Nov 02 17:32:19 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:32:18</nova:creationTime>
Nov 02 17:32:19 user nova-compute[74980]:       <nova:flavor name="m1.small">
Nov 02 17:32:19 user nova-compute[74980]:         <nova:memory>2048</nova:memory>
Nov 02 17:32:19 user nova-compute[74980]:         <nova:disk>20</nova:disk>
Nov 02 17:32:19 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:32:19 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:32:19 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:32:19 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:32:19 user nova-compute[74980]:       <nova:owner>
Nov 02 17:32:19 user nova-compute[74980]:         <nova:user uuid="e61d486aa0bf4b1fb4332aabfa5dafd7">tempest-ServerActionsTestOtherA-50427258-project-member</nova:user>
Nov 02 17:32:19 user nova-compute[74980]:         <nova:project uuid="7bb10da584734aedb3d08879a4ffc2b2">tempest-ServerActionsTestOtherA-50427258</nova:project>
Nov 02 17:32:19 user nova-compute[74980]:       </nova:owner>
Nov 02 17:32:19 user nova-compute[74980]:       <nova:ports>
Nov 02 17:32:19 user nova-compute[74980]:         <nova:port uuid="8f1cd067-6e00-4d28-9879-a8f775d31fa8">
Nov 02 17:32:19 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 17:32:19 user nova-compute[74980]:         </nova:port>
Nov 02 17:32:19 user nova-compute[74980]:       </nova:ports>
Nov 02 17:32:19 user nova-compute[74980]:     </nova:instance>
Nov 02 17:32:19 user nova-compute[74980]:   </metadata>
Nov 02 17:32:19 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:32:19 user nova-compute[74980]:     <system>
Nov 02 17:32:19 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:32:19 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:32:19 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:32:19 user nova-compute[74980]:       <entry name="serial">66da6804-057c-4806-b036-d246768c498d</entry>
Nov 02 17:32:19 user nova-compute[74980]:       <entry name="uuid">66da6804-057c-4806-b036-d246768c498d</entry>
Nov 02 17:32:19 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:32:19 user nova-compute[74980]:     </system>
Nov 02 17:32:19 user nova-compute[74980]:   </sysinfo>
Nov 02 17:32:19 user nova-compute[74980]:   <os>
Nov 02 17:32:19 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:32:19 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:32:19 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:32:19 user nova-compute[74980]:   </os>
Nov 02 17:32:19 user nova-compute[74980]:   <features>
Nov 02 17:32:19 user nova-compute[74980]:     <acpi/>
Nov 02 17:32:19 user nova-compute[74980]:     <apic/>
Nov 02 17:32:19 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:32:19 user nova-compute[74980]:   </features>
Nov 02 17:32:19 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:32:19 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:32:19 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:32:19 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:32:19 user nova-compute[74980]:   </clock>
Nov 02 17:32:19 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:32:19 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:32:19 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:32:19 user nova-compute[74980]:   </cpu>
Nov 02 17:32:19 user nova-compute[74980]:   <devices>
Nov 02 17:32:19 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:32:19 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:32:19 user nova-compute[74980]:       <source dev="/dev/sdb"/>
Nov 02 17:32:19 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:32:19 user nova-compute[74980]:       <serial>a3b9a62f-0fd4-479d-88d9-5b39a58635fb</serial>
Nov 02 17:32:19 user nova-compute[74980]:     </disk>
Nov 02 17:32:19 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:32:19 user nova-compute[74980]:       <mac address="fa:16:3e:da:a2:82"/>
Nov 02 17:32:19 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:32:19 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:32:19 user nova-compute[74980]:       <target dev="tap8f1cd067-6e"/>
Nov 02 17:32:19 user nova-compute[74980]:     </interface>
Nov 02 17:32:19 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:32:19 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/66da6804-057c-4806-b036-d246768c498d/console.log" append="off"/>
Nov 02 17:32:19 user nova-compute[74980]:     </serial>
Nov 02 17:32:19 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:32:19 user nova-compute[74980]:     <video>
Nov 02 17:32:19 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:32:19 user nova-compute[74980]:     </video>
Nov 02 17:32:19 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:32:19 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:32:19 user nova-compute[74980]:     </rng>
Nov 02 17:32:19 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:32:19 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:32:19 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:32:19 user nova-compute[74980]:     </memballoon>
Nov 02 17:32:19 user nova-compute[74980]:   </devices>
Nov 02 17:32:19 user nova-compute[74980]: </domain>
Nov 02 17:32:19 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-757507002',display_name='tempest-ServerActionsTestOtherA-server-757507002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-757507002',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLnMhbM0oba6rJcByxBYQLlndi5MHkt5CHpXxfq+RJdLBsoLWmSnT0vVaxYrrZ06wl3cBC9G1WoMy7HQ9vT9DdZBt3/Q/q1q9MknpNsiMnCx1tDgUx7vQwwWmQat63Hng==',key_name='tempest-keypair-1476871667',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:30:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7bb10da584734aedb3d08879a4ffc2b2',ramdisk_id='',reservation_id='r-7b5n7s8x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-50427258',owner_user_name='tempest-ServerActionsTestOtherA-50427258-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:31:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e61d486aa0bf4b1fb4332aabfa5dafd7',uuid=66da6804-057c-4806-b036-d246768c498d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1549045594-network", "vif_mac": "fa:16:3e:da:a2:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converting VIF {"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1549045594-network", "vif_mac": "fa:16:3e:da:a2:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=8f1cd067-6e00-4d28-9879-a8f775d31fa8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cd067-6e') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG os_vif [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=8f1cd067-6e00-4d28-9879-a8f775d31fa8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cd067-6e') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7547397c-dccf-5c4a-b203-d3616bfe75c4', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.206s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f1cd067-6e, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f1cd067-6e, col_values=(('qos', UUID('b3c57e5b-a763-429f-90b8-49af3269a5c9')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f1cd067-6e, col_values=(('external_ids', {'iface-id': '8f1cd067-6e00-4d28-9879-a8f775d31fa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:a2:82', 'vm-uuid': '66da6804-057c-4806-b036-d246768c498d'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:19 user nova-compute[74980]: INFO os_vif [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=8f1cd067-6e00-4d28-9879-a8f775d31fa8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cd067-6e')
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] No VIF found with MAC fa:16:3e:da:a2:82, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.199s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk 1073741824" returned: 0 in 0.054s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Cannot resize image /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Ensure instance console log exists: /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating instance_info_cache with network_info: [{"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Cannot resize image /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Ensure instance console log exists: /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG nova.network.neutron [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Successfully created port: ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG nova.network.neutron [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Successfully updated port: d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquired lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG nova.network.neutron [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG nova.compute.manager [req-7416368d-1d7c-4cf6-aae6-4b0ecb6fff59 req-35923a40-1fb1-4c0f-8168-8254fe01c9be service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received event network-changed-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG nova.compute.manager [req-7416368d-1d7c-4cf6-aae6-4b0ecb6fff59 req-35923a40-1fb1-4c0f-8168-8254fe01c9be service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Refreshing instance network info cache due to event network-changed-d882437d-9ae3-4508-8a6d-6429e692c104. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7416368d-1d7c-4cf6-aae6-4b0ecb6fff59 req-35923a40-1fb1-4c0f-8168-8254fe01c9be service nova] Acquiring lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:32:20 user nova-compute[74980]: DEBUG nova.network.neutron [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.compute.manager [req-2be9aa7f-557d-4f08-899c-43aea49247ed req-195722f0-f541-4a16-97bf-96d5b2fbdd29 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received event network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2be9aa7f-557d-4f08-899c-43aea49247ed req-195722f0-f541-4a16-97bf-96d5b2fbdd29 service nova] Acquiring lock "66da6804-057c-4806-b036-d246768c498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2be9aa7f-557d-4f08-899c-43aea49247ed req-195722f0-f541-4a16-97bf-96d5b2fbdd29 service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2be9aa7f-557d-4f08-899c-43aea49247ed req-195722f0-f541-4a16-97bf-96d5b2fbdd29 service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.compute.manager [req-2be9aa7f-557d-4f08-899c-43aea49247ed req-195722f0-f541-4a16-97bf-96d5b2fbdd29 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] No waiting events found dispatching network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:32:21 user nova-compute[74980]: WARNING nova.compute.manager [req-2be9aa7f-557d-4f08-899c-43aea49247ed req-195722f0-f541-4a16-97bf-96d5b2fbdd29 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received unexpected event network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 for instance with vm_state active and task_state resize_finish.
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.network.neutron [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Updating instance_info_cache with network_info: [{"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Releasing lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Instance network_info: |[{"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7416368d-1d7c-4cf6-aae6-4b0ecb6fff59 req-35923a40-1fb1-4c0f-8168-8254fe01c9be service nova] Acquired lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.network.neutron [req-7416368d-1d7c-4cf6-aae6-4b0ecb6fff59 req-35923a40-1fb1-4c0f-8168-8254fe01c9be service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Refreshing network info cache for port d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Start _get_guest_xml network_info=[{"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:32:21 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:32:21 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-376242262',display_name='tempest-ServerRescueNegativeTestJSON-server-376242262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-376242262',id=27,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc26ef1932f1408c860b3b9edb4925a4',ramdisk_id='',reservation_id='r-904k0hob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-86632079',owner_user_name='tempest-ServerRescueNegativeTestJSON-86632079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:32:19Z,user_data=None,user_id='985386b6880e4b07bdad162c7860d7a3',uuid=c6bfac8f-3834-4514-9a56-59c293ced966,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converting VIF {"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:18:6e,bridge_name='br-int',has_traffic_filtering=True,id=d882437d-9ae3-4508-8a6d-6429e692c104,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd882437d-9a') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.objects.instance [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'pci_devices' on Instance uuid c6bfac8f-3834-4514-9a56-59c293ced966 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:32:21 user nova-compute[74980]:   <uuid>c6bfac8f-3834-4514-9a56-59c293ced966</uuid>
Nov 02 17:32:21 user nova-compute[74980]:   <name>instance-0000001b</name>
Nov 02 17:32:21 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:32:21 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:32:21 user nova-compute[74980]:   <metadata>
Nov 02 17:32:21 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:32:21 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:32:21 user nova-compute[74980]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-376242262</nova:name>
Nov 02 17:32:21 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:32:21</nova:creationTime>
Nov 02 17:32:21 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:32:21 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:32:21 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:32:21 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:32:21 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:32:21 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:32:21 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:32:21 user nova-compute[74980]:       <nova:owner>
Nov 02 17:32:21 user nova-compute[74980]:         <nova:user uuid="985386b6880e4b07bdad162c7860d7a3">tempest-ServerRescueNegativeTestJSON-86632079-project-member</nova:user>
Nov 02 17:32:21 user nova-compute[74980]:         <nova:project uuid="dc26ef1932f1408c860b3b9edb4925a4">tempest-ServerRescueNegativeTestJSON-86632079</nova:project>
Nov 02 17:32:21 user nova-compute[74980]:       </nova:owner>
Nov 02 17:32:21 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:32:21 user nova-compute[74980]:       <nova:ports>
Nov 02 17:32:21 user nova-compute[74980]:         <nova:port uuid="d882437d-9ae3-4508-8a6d-6429e692c104">
Nov 02 17:32:21 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 17:32:21 user nova-compute[74980]:         </nova:port>
Nov 02 17:32:21 user nova-compute[74980]:       </nova:ports>
Nov 02 17:32:21 user nova-compute[74980]:     </nova:instance>
Nov 02 17:32:21 user nova-compute[74980]:   </metadata>
Nov 02 17:32:21 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:32:21 user nova-compute[74980]:     <system>
Nov 02 17:32:21 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:32:21 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:32:21 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:32:21 user nova-compute[74980]:       <entry name="serial">c6bfac8f-3834-4514-9a56-59c293ced966</entry>
Nov 02 17:32:21 user nova-compute[74980]:       <entry name="uuid">c6bfac8f-3834-4514-9a56-59c293ced966</entry>
Nov 02 17:32:21 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:32:21 user nova-compute[74980]:     </system>
Nov 02 17:32:21 user nova-compute[74980]:   </sysinfo>
Nov 02 17:32:21 user nova-compute[74980]:   <os>
Nov 02 17:32:21 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:32:21 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:32:21 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:32:21 user nova-compute[74980]:   </os>
Nov 02 17:32:21 user nova-compute[74980]:   <features>
Nov 02 17:32:21 user nova-compute[74980]:     <acpi/>
Nov 02 17:32:21 user nova-compute[74980]:     <apic/>
Nov 02 17:32:21 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:32:21 user nova-compute[74980]:   </features>
Nov 02 17:32:21 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:32:21 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:32:21 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:32:21 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:32:21 user nova-compute[74980]:   </clock>
Nov 02 17:32:21 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:32:21 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:32:21 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:32:21 user nova-compute[74980]:   </cpu>
Nov 02 17:32:21 user nova-compute[74980]:   <devices>
Nov 02 17:32:21 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:32:21 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:32:21 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk"/>
Nov 02 17:32:21 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:32:21 user nova-compute[74980]:     </disk>
Nov 02 17:32:21 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:32:21 user nova-compute[74980]:       <mac address="fa:16:3e:11:18:6e"/>
Nov 02 17:32:21 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:32:21 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:32:21 user nova-compute[74980]:       <target dev="tapd882437d-9a"/>
Nov 02 17:32:21 user nova-compute[74980]:     </interface>
Nov 02 17:32:21 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:32:21 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/console.log" append="off"/>
Nov 02 17:32:21 user nova-compute[74980]:     </serial>
Nov 02 17:32:21 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:32:21 user nova-compute[74980]:     <video>
Nov 02 17:32:21 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:32:21 user nova-compute[74980]:     </video>
Nov 02 17:32:21 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:32:21 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:32:21 user nova-compute[74980]:     </rng>
Nov 02 17:32:21 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:32:21 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:32:21 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:32:21 user nova-compute[74980]:     </memballoon>
Nov 02 17:32:21 user nova-compute[74980]:   </devices>
Nov 02 17:32:21 user nova-compute[74980]: </domain>
Nov 02 17:32:21 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-376242262',display_name='tempest-ServerRescueNegativeTestJSON-server-376242262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-376242262',id=27,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc26ef1932f1408c860b3b9edb4925a4',ramdisk_id='',reservation_id='r-904k0hob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-86632079',owner_user_name='tempest-ServerRescueNegativeTestJSON-86632079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:32:19Z,user_data=None,user_id='985386b6880e4b07bdad162c7860d7a3',uuid=c6bfac8f-3834-4514-9a56-59c293ced966,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converting VIF {"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:18:6e,bridge_name='br-int',has_traffic_filtering=True,id=d882437d-9ae3-4508-8a6d-6429e692c104,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd882437d-9a') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG os_vif [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:18:6e,bridge_name='br-int',has_traffic_filtering=True,id=d882437d-9ae3-4508-8a6d-6429e692c104,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd882437d-9a') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5d9997c-4080-51bc-ae4b-ab33b492fe8d', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd882437d-9a, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd882437d-9a, col_values=(('qos', UUID('51cfd1eb-72e2-453f-85f7-453800c63ecb')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd882437d-9a, col_values=(('external_ids', {'iface-id': 'd882437d-9ae3-4508-8a6d-6429e692c104', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:18:6e', 'vm-uuid': 'c6bfac8f-3834-4514-9a56-59c293ced966'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:21 user nova-compute[74980]: INFO os_vif [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:18:6e,bridge_name='br-int',has_traffic_filtering=True,id=d882437d-9ae3-4508-8a6d-6429e692c104,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd882437d-9a')
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No VIF found with MAC fa:16:3e:11:18:6e, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.network.neutron [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Successfully updated port: ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquired lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.network.neutron [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:32:21 user nova-compute[74980]: DEBUG nova.network.neutron [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.network.neutron [req-7416368d-1d7c-4cf6-aae6-4b0ecb6fff59 req-35923a40-1fb1-4c0f-8168-8254fe01c9be service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Updated VIF entry in instance network info cache for port d882437d-9ae3-4508-8a6d-6429e692c104. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.network.neutron [req-7416368d-1d7c-4cf6-aae6-4b0ecb6fff59 req-35923a40-1fb1-4c0f-8168-8254fe01c9be service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Updating instance_info_cache with network_info: [{"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7416368d-1d7c-4cf6-aae6-4b0ecb6fff59 req-35923a40-1fb1-4c0f-8168-8254fe01c9be service nova] Releasing lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.network.neutron [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Updating instance_info_cache with network_info: [{"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Releasing lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Instance network_info: |[{"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Start _get_guest_xml network_info=[{"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:32:22 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:32:22 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2077511521',display_name='tempest-ServerRescueNegativeTestJSON-server-2077511521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2077511521',id=28,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc26ef1932f1408c860b3b9edb4925a4',ramdisk_id='',reservation_id='r-jgytv777',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-86632079',owner_user_name='tempest-ServerRescueNegativeTestJSON-86632079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:32:19Z,user_data=None,user_id='985386b6880e4b07bdad162c7860d7a3',uuid=91bccf34-87a9-48f3-bbc7-4a70b9753036,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converting VIF {"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:11:5f,bridge_name='br-int',has_traffic_filtering=True,id=ae57bdb2-dfca-46be-bc84-9ea10a5634ad,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae57bdb2-df') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.objects.instance [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'pci_devices' on Instance uuid 91bccf34-87a9-48f3-bbc7-4a70b9753036 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:32:22 user nova-compute[74980]:   <uuid>91bccf34-87a9-48f3-bbc7-4a70b9753036</uuid>
Nov 02 17:32:22 user nova-compute[74980]:   <name>instance-0000001c</name>
Nov 02 17:32:22 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:32:22 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:32:22 user nova-compute[74980]:   <metadata>
Nov 02 17:32:22 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:32:22 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:32:22 user nova-compute[74980]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2077511521</nova:name>
Nov 02 17:32:22 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:32:22</nova:creationTime>
Nov 02 17:32:22 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:32:22 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:32:22 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:32:22 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:32:22 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:32:22 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:32:22 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:32:22 user nova-compute[74980]:       <nova:owner>
Nov 02 17:32:22 user nova-compute[74980]:         <nova:user uuid="985386b6880e4b07bdad162c7860d7a3">tempest-ServerRescueNegativeTestJSON-86632079-project-member</nova:user>
Nov 02 17:32:22 user nova-compute[74980]:         <nova:project uuid="dc26ef1932f1408c860b3b9edb4925a4">tempest-ServerRescueNegativeTestJSON-86632079</nova:project>
Nov 02 17:32:22 user nova-compute[74980]:       </nova:owner>
Nov 02 17:32:22 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:32:22 user nova-compute[74980]:       <nova:ports>
Nov 02 17:32:22 user nova-compute[74980]:         <nova:port uuid="ae57bdb2-dfca-46be-bc84-9ea10a5634ad">
Nov 02 17:32:22 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 17:32:22 user nova-compute[74980]:         </nova:port>
Nov 02 17:32:22 user nova-compute[74980]:       </nova:ports>
Nov 02 17:32:22 user nova-compute[74980]:     </nova:instance>
Nov 02 17:32:22 user nova-compute[74980]:   </metadata>
Nov 02 17:32:22 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:32:22 user nova-compute[74980]:     <system>
Nov 02 17:32:22 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:32:22 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:32:22 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:32:22 user nova-compute[74980]:       <entry name="serial">91bccf34-87a9-48f3-bbc7-4a70b9753036</entry>
Nov 02 17:32:22 user nova-compute[74980]:       <entry name="uuid">91bccf34-87a9-48f3-bbc7-4a70b9753036</entry>
Nov 02 17:32:22 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:32:22 user nova-compute[74980]:     </system>
Nov 02 17:32:22 user nova-compute[74980]:   </sysinfo>
Nov 02 17:32:22 user nova-compute[74980]:   <os>
Nov 02 17:32:22 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:32:22 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:32:22 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:32:22 user nova-compute[74980]:   </os>
Nov 02 17:32:22 user nova-compute[74980]:   <features>
Nov 02 17:32:22 user nova-compute[74980]:     <acpi/>
Nov 02 17:32:22 user nova-compute[74980]:     <apic/>
Nov 02 17:32:22 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:32:22 user nova-compute[74980]:   </features>
Nov 02 17:32:22 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:32:22 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:32:22 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:32:22 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:32:22 user nova-compute[74980]:   </clock>
Nov 02 17:32:22 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:32:22 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:32:22 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:32:22 user nova-compute[74980]:   </cpu>
Nov 02 17:32:22 user nova-compute[74980]:   <devices>
Nov 02 17:32:22 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:32:22 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:32:22 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk"/>
Nov 02 17:32:22 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:32:22 user nova-compute[74980]:     </disk>
Nov 02 17:32:22 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:32:22 user nova-compute[74980]:       <mac address="fa:16:3e:3d:11:5f"/>
Nov 02 17:32:22 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:32:22 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:32:22 user nova-compute[74980]:       <target dev="tapae57bdb2-df"/>
Nov 02 17:32:22 user nova-compute[74980]:     </interface>
Nov 02 17:32:22 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:32:22 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/console.log" append="off"/>
Nov 02 17:32:22 user nova-compute[74980]:     </serial>
Nov 02 17:32:22 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:32:22 user nova-compute[74980]:     <video>
Nov 02 17:32:22 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:32:22 user nova-compute[74980]:     </video>
Nov 02 17:32:22 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:32:22 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:32:22 user nova-compute[74980]:     </rng>
Nov 02 17:32:22 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:32:22 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:32:22 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:32:22 user nova-compute[74980]:     </memballoon>
Nov 02 17:32:22 user nova-compute[74980]:   </devices>
Nov 02 17:32:22 user nova-compute[74980]: </domain>
Nov 02 17:32:22 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2077511521',display_name='tempest-ServerRescueNegativeTestJSON-server-2077511521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2077511521',id=28,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc26ef1932f1408c860b3b9edb4925a4',ramdisk_id='',reservation_id='r-jgytv777',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-86632079',owner_user_name='tempest-ServerRescueNegativeTestJSON-86632079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:32:19Z,user_data=None,user_id='985386b6880e4b07bdad162c7860d7a3',uuid=91bccf34-87a9-48f3-bbc7-4a70b9753036,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converting VIF {"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:11:5f,bridge_name='br-int',has_traffic_filtering=True,id=ae57bdb2-dfca-46be-bc84-9ea10a5634ad,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae57bdb2-df') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG os_vif [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:11:5f,bridge_name='br-int',has_traffic_filtering=True,id=ae57bdb2-dfca-46be-bc84-9ea10a5634ad,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae57bdb2-df') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa9007c7-c244-51d4-bfff-929481fb0266', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae57bdb2-df, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae57bdb2-df, col_values=(('qos', UUID('ac3b38fa-7f61-40c7-9935-a10f25a17260')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae57bdb2-df, col_values=(('external_ids', {'iface-id': 'ae57bdb2-dfca-46be-bc84-9ea10a5634ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:11:5f', 'vm-uuid': '91bccf34-87a9-48f3-bbc7-4a70b9753036'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:22 user nova-compute[74980]: INFO os_vif [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:11:5f,bridge_name='br-int',has_traffic_filtering=True,id=ae57bdb2-dfca-46be-bc84-9ea10a5634ad,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae57bdb2-df')
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No VIF found with MAC fa:16:3e:3d:11:5f, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.compute.manager [req-b99b36c9-caf7-4c8a-887e-e6879ebeebac req-a3a3956c-11d7-43c5-8ad8-841d49bf1f20 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received event network-changed-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.compute.manager [req-b99b36c9-caf7-4c8a-887e-e6879ebeebac req-a3a3956c-11d7-43c5-8ad8-841d49bf1f20 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Refreshing instance network info cache due to event network-changed-ae57bdb2-dfca-46be-bc84-9ea10a5634ad. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b99b36c9-caf7-4c8a-887e-e6879ebeebac req-a3a3956c-11d7-43c5-8ad8-841d49bf1f20 service nova] Acquiring lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b99b36c9-caf7-4c8a-887e-e6879ebeebac req-a3a3956c-11d7-43c5-8ad8-841d49bf1f20 service nova] Acquired lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:32:22 user nova-compute[74980]: DEBUG nova.network.neutron [req-b99b36c9-caf7-4c8a-887e-e6879ebeebac req-a3a3956c-11d7-43c5-8ad8-841d49bf1f20 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Refreshing network info cache for port ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:32:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:32:23 user nova-compute[74980]: DEBUG nova.network.neutron [req-b99b36c9-caf7-4c8a-887e-e6879ebeebac req-a3a3956c-11d7-43c5-8ad8-841d49bf1f20 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Updated VIF entry in instance network info cache for port ae57bdb2-dfca-46be-bc84-9ea10a5634ad. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:32:23 user nova-compute[74980]: DEBUG nova.network.neutron [req-b99b36c9-caf7-4c8a-887e-e6879ebeebac req-a3a3956c-11d7-43c5-8ad8-841d49bf1f20 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Updating instance_info_cache with network_info: [{"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:32:23 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 66da6804-057c-4806-b036-d246768c498d] Instance running successfully.
Nov 02 17:32:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Failed to set time: agent not configured {{(pid=74980) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 02 17:32:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-87b1a6a0-8d29-470b-8d02-817f527ef404 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] finish_migration finished successfully. {{(pid=74980) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 02 17:32:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b99b36c9-caf7-4c8a-887e-e6879ebeebac req-a3a3956c-11d7-43c5-8ad8-841d49bf1f20 service nova] Releasing lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:32:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-49e1bd38-fd27-4d71-a597-b884b99672c4 req-21390fae-7de6-4334-95f2-cf6838d46445 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received event network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:32:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-49e1bd38-fd27-4d71-a597-b884b99672c4 req-21390fae-7de6-4334-95f2-cf6838d46445 service nova] Acquiring lock "66da6804-057c-4806-b036-d246768c498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-49e1bd38-fd27-4d71-a597-b884b99672c4 req-21390fae-7de6-4334-95f2-cf6838d46445 service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-49e1bd38-fd27-4d71-a597-b884b99672c4 req-21390fae-7de6-4334-95f2-cf6838d46445 service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-49e1bd38-fd27-4d71-a597-b884b99672c4 req-21390fae-7de6-4334-95f2-cf6838d46445 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] No waiting events found dispatching network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:32:23 user nova-compute[74980]: WARNING nova.compute.manager [req-49e1bd38-fd27-4d71-a597-b884b99672c4 req-21390fae-7de6-4334-95f2-cf6838d46445 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received unexpected event network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 for instance with vm_state resized and task_state None.
Nov 02 17:32:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] No waiting events found dispatching network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:32:25 user nova-compute[74980]: WARNING nova.compute.manager [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received unexpected event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 for instance with vm_state building and task_state spawning.
Nov 02 17:32:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] No waiting events found dispatching network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:32:25 user nova-compute[74980]: WARNING nova.compute.manager [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received unexpected event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 for instance with vm_state building and task_state spawning.
Nov 02 17:32:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] No waiting events found dispatching network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:32:25 user nova-compute[74980]: WARNING nova.compute.manager [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received unexpected event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad for instance with vm_state building and task_state spawning.
Nov 02 17:32:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] No waiting events found dispatching network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:32:25 user nova-compute[74980]: WARNING nova.compute.manager [req-458b1c52-556a-4730-aba9-82f35730b7c0 req-fd6f6cc2-709b-405e-9752-0f032d396713 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received unexpected event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad for instance with vm_state building and task_state spawning.
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:32:27 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Instance spawned successfully.
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:32:27 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Instance spawned successfully.
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:32:27 user nova-compute[74980]: INFO nova.compute.manager [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Took 8.32 seconds to spawn the instance on the hypervisor.
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:32:27 user nova-compute[74980]: INFO nova.compute.manager [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Took 7.65 seconds to spawn the instance on the hypervisor.
Nov 02 17:32:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:32:27 user nova-compute[74980]: INFO nova.compute.manager [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Took 9.48 seconds to build instance.
Nov 02 17:32:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4cefd659-c0c0-450b-9b76-a8e7cc0d232f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "c6bfac8f-3834-4514-9a56-59c293ced966" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.582s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:27 user nova-compute[74980]: INFO nova.compute.manager [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Took 8.86 seconds to build instance.
Nov 02 17:32:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-513b90b6-381e-4c83-8452-39aa517601b0 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.955s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:32:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:32:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:32:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:05 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:33:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG nova.objects.instance [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lazy-loading 'flavor' on Instance uuid dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:09 user nova-compute[74980]: INFO nova.compute.manager [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Attaching volume c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a to /dev/vdb
Nov 02 17:33:09 user nova-compute[74980]: DEBUG os_brick.utils [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f465173-7e33-4e0f-ab2f-9e7f155de26e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c513a21f-d7a6-4ebe-9595-053ab5b2d20b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd74d0d3-99a6-47fc-865a-8ba18d4f74ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cf56a1-f0e8-476a-ac9f-7a65c7879114]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:33:09 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:33:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e235aab0-497f-4132-b13c-188f3b13bf8a]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG os_brick.utils [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:33:09 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updating existing volume attachment record: b7c3d5b0-3665-40dd-9d99-34a6c89c60fa {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:33:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:33:11 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:33:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 17:33:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] There are 0 instances to clean {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 17:33:11 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:33:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:33:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:33:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:33:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:33:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:15 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:33:15 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "976ebe93-f218-49ed-b2e1-6440559cb3d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "976ebe93-f218-49ed-b2e1-6440559cb3d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "976ebe93-f218-49ed-b2e1-6440559cb3d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "976ebe93-f218-49ed-b2e1-6440559cb3d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "976ebe93-f218-49ed-b2e1-6440559cb3d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:16 user nova-compute[74980]: INFO nova.compute.manager [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Terminating instance
Nov 02 17:33:16 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-bee53ef3-aa49-4df0-8e24-2912a122579b req-4dccb6d4-2dda-40da-a695-2633f9d78d18 service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Received event network-vif-unplugged-0123576d-c4a2-49aa-b030-6d33eaf3d634 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bee53ef3-aa49-4df0-8e24-2912a122579b req-4dccb6d4-2dda-40da-a695-2633f9d78d18 service nova] Acquiring lock "976ebe93-f218-49ed-b2e1-6440559cb3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bee53ef3-aa49-4df0-8e24-2912a122579b req-4dccb6d4-2dda-40da-a695-2633f9d78d18 service nova] Lock "976ebe93-f218-49ed-b2e1-6440559cb3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bee53ef3-aa49-4df0-8e24-2912a122579b req-4dccb6d4-2dda-40da-a695-2633f9d78d18 service nova] Lock "976ebe93-f218-49ed-b2e1-6440559cb3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-bee53ef3-aa49-4df0-8e24-2912a122579b req-4dccb6d4-2dda-40da-a695-2633f9d78d18 service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] No waiting events found dispatching network-vif-unplugged-0123576d-c4a2-49aa-b030-6d33eaf3d634 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:33:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-bee53ef3-aa49-4df0-8e24-2912a122579b req-4dccb6d4-2dda-40da-a695-2633f9d78d18 service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Received event network-vif-unplugged-0123576d-c4a2-49aa-b030-6d33eaf3d634 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:17 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Instance destroyed successfully.
Nov 02 17:33:17 user nova-compute[74980]: DEBUG nova.objects.instance [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lazy-loading 'resources' on Instance uuid 976ebe93-f218-49ed-b2e1-6440559cb3d3 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:31:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-912221055',display_name='tempest-VolumesActionsTest-instance-912221055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-912221055',id=26,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:31:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c992cd1419d42e9aeeb103900e8b136',ramdisk_id='',reservation_id='r-35wivy9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-782476121',owner_user_name='tempest-VolumesActionsTest-782476121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:31:32Z,user_data=None,user_id='5675b52cc3114389b0195f6a300c3620',uuid=976ebe93-f218-49ed-b2e1-6440559cb3d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "address": "fa:16:3e:3d:9b:f7", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0123576d-c4", "ovs_interfaceid": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Converting VIF {"id": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "address": "fa:16:3e:3d:9b:f7", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0123576d-c4", "ovs_interfaceid": "0123576d-c4a2-49aa-b030-6d33eaf3d634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9b:f7,bridge_name='br-int',has_traffic_filtering=True,id=0123576d-c4a2-49aa-b030-6d33eaf3d634,network=Network(d15bb169-1025-4bd1-8bc8-5df04514f280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0123576d-c4') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG os_vif [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9b:f7,bridge_name='br-int',has_traffic_filtering=True,id=0123576d-c4a2-49aa-b030-6d33eaf3d634,network=Network(d15bb169-1025-4bd1-8bc8-5df04514f280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0123576d-c4') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0123576d-c4, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6f215ee-8218-475f-8834-392a30dbec7b) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:17 user nova-compute[74980]: INFO os_vif [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9b:f7,bridge_name='br-int',has_traffic_filtering=True,id=0123576d-c4a2-49aa-b030-6d33eaf3d634,network=Network(d15bb169-1025-4bd1-8bc8-5df04514f280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0123576d-c4')
Nov 02 17:33:17 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Deleting instance files /opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3_del
Nov 02 17:33:17 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Deletion of /opt/stack/data/nova/instances/976ebe93-f218-49ed-b2e1-6440559cb3d3_del complete
Nov 02 17:33:17 user nova-compute[74980]: INFO nova.compute.manager [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 02 17:33:17 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:33:17 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Took 0.50 seconds to deallocate network for instance.
Nov 02 17:33:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Refreshing inventories for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Updating ProviderTree inventory for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Updating inventory in ProviderTree for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Refreshing aggregate associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, aggregates: None {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Refreshing trait associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.878s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:18 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Deleted allocations for instance 976ebe93-f218-49ed-b2e1-6440559cb3d3
Nov 02 17:33:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4477d258-2735-4ae0-93c8-67ce91267246 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "976ebe93-f218-49ed-b2e1-6440559cb3d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.366s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:33:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-20232345-6759-4fc1-911d-637289949764 req-60766814-35ec-42a4-a3b6-3cd5cd62ace5 service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Received event network-vif-plugged-0123576d-c4a2-49aa-b030-6d33eaf3d634 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:33:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-20232345-6759-4fc1-911d-637289949764 req-60766814-35ec-42a4-a3b6-3cd5cd62ace5 service nova] Acquiring lock "976ebe93-f218-49ed-b2e1-6440559cb3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-20232345-6759-4fc1-911d-637289949764 req-60766814-35ec-42a4-a3b6-3cd5cd62ace5 service nova] Lock "976ebe93-f218-49ed-b2e1-6440559cb3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-20232345-6759-4fc1-911d-637289949764 req-60766814-35ec-42a4-a3b6-3cd5cd62ace5 service nova] Lock "976ebe93-f218-49ed-b2e1-6440559cb3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-20232345-6759-4fc1-911d-637289949764 req-60766814-35ec-42a4-a3b6-3cd5cd62ace5 service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] No waiting events found dispatching network-vif-plugged-0123576d-c4a2-49aa-b030-6d33eaf3d634 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:33:19 user nova-compute[74980]: WARNING nova.compute.manager [req-20232345-6759-4fc1-911d-637289949764 req-60766814-35ec-42a4-a3b6-3cd5cd62ace5 service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Received unexpected event network-vif-plugged-0123576d-c4a2-49aa-b030-6d33eaf3d634 for instance with vm_state deleted and task_state None.
Nov 02 17:33:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-20232345-6759-4fc1-911d-637289949764 req-60766814-35ec-42a4-a3b6-3cd5cd62ace5 service nova] [instance: 976ebe93-f218-49ed-b2e1-6440559cb3d3] Received event network-vif-deleted-0123576d-c4a2-49aa-b030-6d33eaf3d634 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:33:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:20 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:33:20 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:33:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8009MB free_disk=25.241573333740234GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Applying migration context for instance 66da6804-057c-4806-b036-d246768c498d as it has an incoming, in-progress migration 62a57d6c-41b0-41ff-98f5-463e1e14cd46. Migration status is finished {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 17:33:20 user nova-compute[74980]: INFO nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 66da6804-057c-4806-b036-d246768c498d] Updating resource usage from migration 62a57d6c-41b0-41ff-98f5-463e1e14cd46
Nov 02 17:33:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6319a96b-1499-4d79-8ffe-df25fab1c6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Migration 62a57d6c-41b0-41ff-98f5-463e1e14cd46 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 66da6804-057c-4806-b036-d246768c498d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:33:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:33:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:33:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:33:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:33:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:33:21 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 66da6804-057c-4806-b036-d246768c498d] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:33:22 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 66da6804-057c-4806-b036-d246768c498d] Updating instance_info_cache with network_info: [{"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:33:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:33:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 66da6804-057c-4806-b036-d246768c498d] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:33:22 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:33:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG nova.objects.instance [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lazy-loading 'flavor' on Instance uuid 6319a96b-1499-4d79-8ffe-df25fab1c6d8 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:29 user nova-compute[74980]: INFO nova.compute.manager [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Attaching volume 97d1af33-b87a-43ce-887c-348021c25d1b to /dev/vdb
Nov 02 17:33:29 user nova-compute[74980]: DEBUG os_brick.utils [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[138bf402-782e-4437-9b78-b85becab7e39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f935fe37-a376-4819-ae69-b8c357c10707]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c35765-7e08-47b0-9981-fe412a5eacd2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47b2ec1-29f0-43d2-a8b6-89a36e4378f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:33:29 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:33:29 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[43967fc9-e80d-4c7d-aa1b-b0ce9cb4276f]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG os_brick.utils [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating existing volume attachment record: f3b20655-3198-44bc-aea0-4ed896c29fb1 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:33:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixUAJFDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:33:29 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:33:29 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:33:30 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:33:30 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ee1327-5a23-45f5-89f9-ca6fb71ee4a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:33:30 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97c2a3e-0a30-4184-9190-991ea19ad6ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a] added
Nov 02 17:33:30 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6226d456-cd07-4507-a12b-8480ae982020]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[290b4a42-fbc7-490c-9874-72b591eb7ea5]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixUAJFDp {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixUAJFDp" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b85962a-0c83-4eae-9b87-3d258ff75202]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ixUAJFDp'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[419f5da4-0357-4d4f-951a-2a8622b9067b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eee50cc-6fa0-40e3-b38d-a36e01c22782]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:33:30 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:33:30 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e5dd07-c9fb-42b7-84e8-6b779f3318df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260]
Nov 02 17:33:30 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260] successful.
Nov 02 17:33:30 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[64500a8d-402d-4422-92c9-5941d73573ae]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d103b0c-8bdf-4b88-b4db-0ad75fa68de9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:33:30 user nova-compute[74980]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:33:30 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:33:30 user nova-compute[74980]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:33:30 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b7d553-e6ab-4e03-9e41-9f33763b40de]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:33:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixUAJFDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:33:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:33:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26531356465633261', 'path': '/dev/sdc'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:33:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531356465633261', 'path': '/dev/sdc'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:33:31 user nova-compute[74980]: DEBUG nova.objects.instance [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lazy-loading 'flavor' on Instance uuid dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:33:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:33:31 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:33:31 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:33:31 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:33:31 user nova-compute[74980]:   <serial>c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a</serial>
Nov 02 17:33:31 user nova-compute[74980]: </disk>
Nov 02 17:33:31 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:33:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:33:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:33:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] No VIF found with MAC fa:16:3e:d8:6c:9c, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:33:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-78f52e0e-28ea-4b17-b8f7-aa2a58f5de1c tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.468s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:32 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:33:32 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74980) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 17:33:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:33:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "66da6804-057c-4806-b036-d246768c498d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "66da6804-057c-4806-b036-d246768c498d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:44 user nova-compute[74980]: DEBUG nova.compute.manager [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Going to confirm migration 1 {{(pid=74980) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 02 17:33:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:33:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquired lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:33:44 user nova-compute[74980]: DEBUG nova.network.neutron [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:33:44 user nova-compute[74980]: DEBUG nova.objects.instance [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lazy-loading 'info_cache' on Instance uuid 66da6804-057c-4806-b036-d246768c498d {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:33:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-85b6781e-ccf9-43ed-989f-f217043a221b req-fbe44372-721a-4bae-8d0e-7d58e8a0a424 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received event network-changed-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:33:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-85b6781e-ccf9-43ed-989f-f217043a221b req-fbe44372-721a-4bae-8d0e-7d58e8a0a424 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Refreshing instance network info cache due to event network-changed-28b668aa-b083-474c-bc08-9bd96a7ea7ff. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:33:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-85b6781e-ccf9-43ed-989f-f217043a221b req-fbe44372-721a-4bae-8d0e-7d58e8a0a424 service nova] Acquiring lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:33:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-85b6781e-ccf9-43ed-989f-f217043a221b req-fbe44372-721a-4bae-8d0e-7d58e8a0a424 service nova] Acquired lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:33:44 user nova-compute[74980]: DEBUG nova.network.neutron [req-85b6781e-ccf9-43ed-989f-f217043a221b req-fbe44372-721a-4bae-8d0e-7d58e8a0a424 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Refreshing network info cache for port 28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:33:45 user nova-compute[74980]: DEBUG nova.network.neutron [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Updating instance_info_cache with network_info: [{"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:33:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Releasing lock "refresh_cache-66da6804-057c-4806-b036-d246768c498d" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:33:45 user nova-compute[74980]: DEBUG nova.objects.instance [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lazy-loading 'migration_context' on Instance uuid 66da6804-057c-4806-b036-d246768c498d {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:33:45 user nova-compute[74980]: DEBUG nova.objects.base [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Object Instance<66da6804-057c-4806-b036-d246768c498d> lazy-loaded attributes: info_cache,migration_context {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:33:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:45 user nova-compute[74980]: DEBUG nova.network.neutron [req-85b6781e-ccf9-43ed-989f-f217043a221b req-fbe44372-721a-4bae-8d0e-7d58e8a0a424 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updated VIF entry in instance network info cache for port 28b668aa-b083-474c-bc08-9bd96a7ea7ff. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:33:45 user nova-compute[74980]: DEBUG nova.network.neutron [req-85b6781e-ccf9-43ed-989f-f217043a221b req-fbe44372-721a-4bae-8d0e-7d58e8a0a424 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updating instance_info_cache with network_info: [{"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:33:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-85b6781e-ccf9-43ed-989f-f217043a221b req-fbe44372-721a-4bae-8d0e-7d58e8a0a424 service nova] Releasing lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:33:45 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:33:45 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:33:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.339s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:45 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Deleted allocation for migration 62a57d6c-41b0-41ff-98f5-463e1e14cd46
Nov 02 17:33:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-69616e5f-addd-4b53-9428-f0cc32719d8a tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "66da6804-057c-4806-b036-d246768c498d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.752s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-2d4bdf8a-258a-42d8-b3a1-d8ba207252dc req-02ab81ba-1293-4037-a0a7-fe8443b031d3 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received event network-changed-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:33:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-2d4bdf8a-258a-42d8-b3a1-d8ba207252dc req-02ab81ba-1293-4037-a0a7-fe8443b031d3 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Refreshing instance network info cache due to event network-changed-28b668aa-b083-474c-bc08-9bd96a7ea7ff. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:33:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2d4bdf8a-258a-42d8-b3a1-d8ba207252dc req-02ab81ba-1293-4037-a0a7-fe8443b031d3 service nova] Acquiring lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:33:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2d4bdf8a-258a-42d8-b3a1-d8ba207252dc req-02ab81ba-1293-4037-a0a7-fe8443b031d3 service nova] Acquired lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:33:46 user nova-compute[74980]: DEBUG nova.network.neutron [req-2d4bdf8a-258a-42d8-b3a1-d8ba207252dc req-02ab81ba-1293-4037-a0a7-fe8443b031d3 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Refreshing network info cache for port 28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:33:47 user nova-compute[74980]: DEBUG nova.network.neutron [req-2d4bdf8a-258a-42d8-b3a1-d8ba207252dc req-02ab81ba-1293-4037-a0a7-fe8443b031d3 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updated VIF entry in instance network info cache for port 28b668aa-b083-474c-bc08-9bd96a7ea7ff. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:33:47 user nova-compute[74980]: DEBUG nova.network.neutron [req-2d4bdf8a-258a-42d8-b3a1-d8ba207252dc req-02ab81ba-1293-4037-a0a7-fe8443b031d3 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updating instance_info_cache with network_info: [{"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:33:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2d4bdf8a-258a-42d8-b3a1-d8ba207252dc req-02ab81ba-1293-4037-a0a7-fe8443b031d3 service nova] Releasing lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:33:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:33:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:33:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:33:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:33:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPsmWyMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:33:49 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:33:49 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:33:49 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbce362-91f3-4a29-8792-89aaddbd19ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:33:49 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe575531-0d2c-4b51-9ac3-8ee300543bf8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b] added
Nov 02 17:33:49 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b830e9d-ab0a-4f22-9c58-069a44ca4bee]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7320f673-b5cc-4bb3-b0d2-e25c57d0f88f]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPsmWyMY {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPsmWyMY" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d85b466-f3c0-4aed-a957-2ee98dae786f]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cPsmWyMY'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2edf952-1eb6-4839-b310-7489ff6541ae]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1782ca20-2ab7-404a-8d19-badcc0d29cde]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:33:49 user nova-compute[74980]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:33:49 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:33:49 user nova-compute[74980]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:33:49 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e700382c-372c-445e-8abe-7013690ff1a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260]
Nov 02 17:33:49 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260] successful.
Nov 02 17:33:49 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd45c95e-2900-4399-a9c1-0bebc5a365f0]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5446ec-a253-4e62-8504-85e6cac6c595]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:33:49 user nova-compute[74980]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:33:49 user nova-compute[74980]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:33:49 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:33:49 user nova-compute[74980]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:33:49 user nova-compute[74980]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:33:49 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[638e148c-e795-4cb4-ab2e-b45759d4bc21]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:49 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:33:50 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:33:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPsmWyMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:33:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:33:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26430376437313038', 'path': '/dev/sdd'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:33:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430376437313038', 'path': '/dev/sdd'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:33:50 user nova-compute[74980]: DEBUG nova.objects.instance [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lazy-loading 'flavor' on Instance uuid 6319a96b-1499-4d79-8ffe-df25fab1c6d8 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:33:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:33:50 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:33:50 user nova-compute[74980]:   <source dev="/dev/sdd"/>
Nov 02 17:33:50 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:33:50 user nova-compute[74980]:   <serial>97d1af33-b87a-43ce-887c-348021c25d1b</serial>
Nov 02 17:33:50 user nova-compute[74980]: </disk>
Nov 02 17:33:50 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:33:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:33:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:33:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] No VIF found with MAC fa:16:3e:1e:4f:61, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:33:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-12565960-58d9-4c3f-865d-ed6f05381c96 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.075s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Stashing vm_state: active {{(pid=74980) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 02 17:33:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:53 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:33:53 user nova-compute[74980]: INFO nova.compute.claims [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Claim successful on node user
Nov 02 17:33:53 user nova-compute[74980]: INFO nova.compute.resource_tracker [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating resource usage from migration 3156bc7a-4774-4d40-b647-a6b23d1fa94b
Nov 02 17:33:53 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:33:53 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:33:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.338s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:53 user nova-compute[74980]: INFO nova.compute.manager [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Migrating
Nov 02 17:33:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:33:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquired lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:33:53 user nova-compute[74980]: DEBUG nova.network.neutron [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:33:53 user nova-compute[74980]: DEBUG nova.network.neutron [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating instance_info_cache with network_info: [{"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:33:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Releasing lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:33:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Starting migrate_disk_and_power_off {{(pid=74980) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-f1b33ede-a70a-4aad-bcf0-31802a608f3e req-db3e0bfe-e657-4691-9fb8-25dad580edd3 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-vif-unplugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f1b33ede-a70a-4aad-bcf0-31802a608f3e req-db3e0bfe-e657-4691-9fb8-25dad580edd3 service nova] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f1b33ede-a70a-4aad-bcf0-31802a608f3e req-db3e0bfe-e657-4691-9fb8-25dad580edd3 service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f1b33ede-a70a-4aad-bcf0-31802a608f3e req-db3e0bfe-e657-4691-9fb8-25dad580edd3 service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-f1b33ede-a70a-4aad-bcf0-31802a608f3e req-db3e0bfe-e657-4691-9fb8-25dad580edd3 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] No waiting events found dispatching network-vif-unplugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:33:54 user nova-compute[74980]: WARNING nova.compute.manager [req-f1b33ede-a70a-4aad-bcf0-31802a608f3e req-db3e0bfe-e657-4691-9fb8-25dad580edd3 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received unexpected event network-vif-unplugged-f5e8978e-28b1-419e-a745-0a784521ee3d for instance with vm_state active and task_state resize_migrating.
Nov 02 17:33:54 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Instance destroyed successfully.
Nov 02 17:33:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1460645799',display_name='tempest-ServerActionsTestOtherB-server-1460645799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1460645799',id=23,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDC1zazFsVcK8cRSvh0A9JDxfLAmb3MmWE+O0wv7/MERQOOzJbF5AG6ze84hXy646Ak4C6ld6XkTeszBqKFoffMRNgW/kfbra+jqQgZdpkDkqH9hu6Bzizhbp6Bezooetw==',key_name='tempest-keypair-1765002056',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:29:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ca163fc9523f4f83bd2efba0ec7e468d',ramdisk_id='',reservation_id='r-1djtdfew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-879907014',owner_user_name='tempest-ServerActionsTestOtherB-879907014-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:33:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f7818185f98430399f7f2fe9465217c',uuid=6319a96b-1499-4d79-8ffe-df25fab1c6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-261425156-network", "vif_mac": "fa:16:3e:1e:4f:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converting VIF {"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-261425156-network", "vif_mac": "fa:16:3e:1e:4f:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_vif [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5e8978e-28, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e2619c3-f7c7-4e62-b8c3-6cdbbaadeb4c) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:54 user nova-compute[74980]: INFO os_vif [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28')
Nov 02 17:33:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPsmWyMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:33:54 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cb6e1d-dd39-48e8-84c8-14ef503fbcf6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:33:54 user nova-compute[74980]: No targets found.
Nov 02 17:33:54 user nova-compute[74980]: iSNS:
Nov 02 17:33:54 user nova-compute[74980]: No targets found.
Nov 02 17:33:54 user nova-compute[74980]: STATIC:
Nov 02 17:33:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb
Nov 02 17:33:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:33:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:33:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b
Nov 02 17:33:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:33:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:33:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a
Nov 02 17:33:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:33:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:33:54 user nova-compute[74980]: FIRMWARE:
Nov 02 17:33:54 user nova-compute[74980]: No targets found.
Nov 02 17:33:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:33:54 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:33:54 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[37633d7f-1518-42dd-ac4c-ea93e44f5f46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5743915e-1020-4907-a451-3baa47c71726]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:33:54 user nova-compute[74980]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:33:54 user nova-compute[74980]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:33:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:33:54 user nova-compute[74980]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:33:54 user nova-compute[74980]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:33:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b44441f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b'): ({'sdd'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Removing single pathed devices sdd {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93642bf-f630-4426-ba24-f3c5d657eb2b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d50d0b9-2c12-4a4c-97da-c907640eb03c]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Flushing IO for device /dev/sdd {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd638928-05d0-4895-bbca-4add64fa6fd4]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08fb5f6-2b18-4e0d-aed2-9b601028d1ed]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] SCSI volumes sdd have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be0904f-0419-4919-870d-de132ca3127e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53528eb-08c9-43b1-988b-643ef8966769]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260]
Nov 02 17:33:55 user nova-compute[74980]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260] successful.
Nov 02 17:33:55 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1e5132-ac49-4a9d-98e9-b2d8dce45b91]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] <== disconnect_volume: return (310ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8_resize/disk /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CMD "cp -r /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8_resize/disk /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk" returned: 0 in 0.318s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8_resize/disk.info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk.info {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CMD "cp -r /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8_resize/disk.info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk.info" returned: 0 in 0.033s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-14ce536c-4650-4d77-b974-eb29287bb846 req-3322ab5a-5d56-4ae2-8f5e-e838ac132207 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:33:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-14ce536c-4650-4d77-b974-eb29287bb846 req-3322ab5a-5d56-4ae2-8f5e-e838ac132207 service nova] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-14ce536c-4650-4d77-b974-eb29287bb846 req-3322ab5a-5d56-4ae2-8f5e-e838ac132207 service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-14ce536c-4650-4d77-b974-eb29287bb846 req-3322ab5a-5d56-4ae2-8f5e-e838ac132207 service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-14ce536c-4650-4d77-b974-eb29287bb846 req-3322ab5a-5d56-4ae2-8f5e-e838ac132207 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] No waiting events found dispatching network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:33:56 user nova-compute[74980]: WARNING nova.compute.manager [req-14ce536c-4650-4d77-b974-eb29287bb846 req-3322ab5a-5d56-4ae2-8f5e-e838ac132207 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received unexpected event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d for instance with vm_state active and task_state resize_migrating.
Nov 02 17:33:56 user nova-compute[74980]: DEBUG nova.network.neutron [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Port f5e8978e-28b1-419e-a745-0a784521ee3d binding to destination host user is already ACTIVE {{(pid=74980) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquired lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG nova.network.neutron [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG nova.network.neutron [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating instance_info_cache with network_info: [{"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Releasing lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG os_brick.utils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[017ab18b-965d-4c0d-a1a8-af721cf1ba9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d31241e-d4aa-44bf-a1eb-70c591168ab4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8062b43-b5d4-400e-ac4f-6be494e9d457]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[021929c9-8e91-4fb3-b4fc-0f26be90d856]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:33:57 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:33:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a021ef91-22d3-4577-8a95-f05ba9fb8b72]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:33:57 user nova-compute[74980]: DEBUG os_brick.utils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:33:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:58 user nova-compute[74980]: INFO nova.compute.manager [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Rebooting instance
Nov 02 17:33:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:33:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquired lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:33:58 user nova-compute[74980]: DEBUG nova.network.neutron [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:33:58 user nova-compute[74980]: DEBUG nova.network.neutron [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updating instance_info_cache with network_info: [{"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:33:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Releasing lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:33:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:33:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-5b445267-49b2-4387-a8ac-102bfef14801 req-84f1a55f-8131-432f-91d3-799a12a05008 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received event network-vif-unplugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5b445267-49b2-4387-a8ac-102bfef14801 req-84f1a55f-8131-432f-91d3-799a12a05008 service nova] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5b445267-49b2-4387-a8ac-102bfef14801 req-84f1a55f-8131-432f-91d3-799a12a05008 service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5b445267-49b2-4387-a8ac-102bfef14801 req-84f1a55f-8131-432f-91d3-799a12a05008 service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-5b445267-49b2-4387-a8ac-102bfef14801 req-84f1a55f-8131-432f-91d3-799a12a05008 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] No waiting events found dispatching network-vif-unplugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:33:59 user nova-compute[74980]: WARNING nova.compute.manager [req-5b445267-49b2-4387-a8ac-102bfef14801 req-84f1a55f-8131-432f-91d3-799a12a05008 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received unexpected event network-vif-unplugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff for instance with vm_state active and task_state reboot_started_hard.
Nov 02 17:33:59 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Instance destroyed successfully.
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.objects.instance [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lazy-loading 'resources' on Instance uuid dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-710681487',display_name='tempest-TestMinimumBasicScenario-server-710681487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-710681487',id=25,image_ref='13d514af-9a16-4b69-bb3d-c97adc69a481',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0577uFfOT8cUN6BtfQwlMQpRR/j74a2V6qrBANqwx4s/9epUKXZYsUi41B9mVFJjJCL5YkxgjxKwmbak1uGe6YArtVcvzacA13o+c0rtgXDMSTQ4iyD7+g4drcVrU92Q==',key_name='tempest-TestMinimumBasicScenario-1334816697',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:31:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad1b48d7070548bdae52f005ce12d606',ramdisk_id='',reservation_id='r-df01e7ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13d514af-9a16-4b69-bb3d-c97adc69a481',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-487832598',owner_user_name='tempest-TestMinimumBasicScenario-487832598-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:33:59Z,user_data=None,user_id='46cbf858998242a1a5d8b14b0e56cace',uuid=dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converting VIF {"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:6c:9c,bridge_name='br-int',has_traffic_filtering=True,id=28b668aa-b083-474c-bc08-9bd96a7ea7ff,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b668aa-b0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_vif [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:6c:9c,bridge_name='br-int',has_traffic_filtering=True,id=28b668aa-b083-474c-bc08-9bd96a7ea7ff,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b668aa-b0') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28b668aa-b0, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=488e1266-f937-4fe0-8f10-1f257c7e38eb) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:59 user nova-compute[74980]: INFO os_vif [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:6c:9c,bridge_name='br-int',has_traffic_filtering=True,id=28b668aa-b083-474c-bc08-9bd96a7ea7ff,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b668aa-b0')
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixUAJFDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:33:59 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4962cb2c-7fa7-44de-b953-49e964c12419]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:33:59 user nova-compute[74980]: No targets found.
Nov 02 17:33:59 user nova-compute[74980]: iSNS:
Nov 02 17:33:59 user nova-compute[74980]: No targets found.
Nov 02 17:33:59 user nova-compute[74980]: STATIC:
Nov 02 17:33:59 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb
Nov 02 17:33:59 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:33:59 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:33:59 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a
Nov 02 17:33:59 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:33:59 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:33:59 user nova-compute[74980]: FIRMWARE:
Nov 02 17:33:59 user nova-compute[74980]: No targets found.
Nov 02 17:33:59 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:33:59 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:33:59 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a2a138-8590-4a31-b5e0-d48cd0ee3939]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7651e791-97d7-4717-ad63-7763718ce2e9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:33:59 user nova-compute[74980]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:33:59 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:33:59 user nova-compute[74980]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:33:59 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b4712ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a'): ({'sdc'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Removing single pathed devices sdc {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b44e3a-d112-48a9-a305-7c3e29340fea]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a9324b-7abf-4f2e-b8a1-84963980bc5a]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Flushing IO for device /dev/sdc {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dcd686-1159-4eb9-8d41-33ad2262490c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.030s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef77170d-7202-4dd8-b903-949c3f5af020]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[709b2996-de12-40f6-a814-527e027021f6]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ccd2f3-1efd-4047-aa21-0c90dfff5793]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260]
Nov 02 17:33:59 user nova-compute[74980]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260] successful.
Nov 02 17:33:59 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfa74dd-1966-4554-bc8a-f17f0f3b289f]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] <== disconnect_volume: return (300ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Start _get_guest_xml network_info=[{"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=13d514af-9a16-4b69-bb3d-c97adc69a481,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '13d514af-9a16-4b69-bb3d-c97adc69a481'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixUAJFDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275', 'attached_at': '', 'detached_at': '', 'volume_id': 'c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a', 'serial': 'c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'b7c3d5b0-3665-40dd-9d99-34a6c89c60fa', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:33:59 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:33:59 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=13d514af-9a16-4b69-bb3d-c97adc69a481,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.objects.instance [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lazy-loading 'vcpu_model' on Instance uuid dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.objects.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Object Instance<dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275> lazy-loaded attributes: resources,vcpu_model {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixUAJFDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:33:59 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:33:59 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:33:59 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f88bab-75e5-4718-be4f-ff6c2a87e356]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:33:59 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cee51af-438d-4cff-a2eb-b289a25e7205]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a] added
Nov 02 17:33:59 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[05588215-6888-4646-bfc7-336f763793b8]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[80627cb1-03bc-4e41-b402-d1b55039919d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixUAJFDp {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixUAJFDp" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddfe21d-9f2b-49bb-9e84-ce00d8204891]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ixUAJFDp'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:33:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6547541c-100a-4b50-94e3-7f83f492242c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[773f1cd4-2559-4f11-b091-ddabd0a174ec]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:34:00 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:34:00 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b17f188-d340-4f8f-8079-b81d9c3977b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260]
Nov 02 17:34:00 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260] successful.
Nov 02 17:34:00 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b942d094-9e60-4a14-8155-b4c6b3903a83]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7412068-32fc-4595-b834-8c6548c00d90]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:34:00 user nova-compute[74980]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:34:00 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:34:00 user nova-compute[74980]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:34:00 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafef00c-4fbc-4a77-bb05-1f14a0ead708]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:34:00 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixUAJFDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG nova.compute.manager [req-833c8876-3847-4af0-b105-8df5264c4a63 req-2474581f-29c2-403e-ac97-8de852895a8b service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received event network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-833c8876-3847-4af0-b105-8df5264c4a63 req-2474581f-29c2-403e-ac97-8de852895a8b service nova] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-833c8876-3847-4af0-b105-8df5264c4a63 req-2474581f-29c2-403e-ac97-8de852895a8b service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-833c8876-3847-4af0-b105-8df5264c4a63 req-2474581f-29c2-403e-ac97-8de852895a8b service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG nova.compute.manager [req-833c8876-3847-4af0-b105-8df5264c4a63 req-2474581f-29c2-403e-ac97-8de852895a8b service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] No waiting events found dispatching network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:34:01 user nova-compute[74980]: WARNING nova.compute.manager [req-833c8876-3847-4af0-b105-8df5264c4a63 req-2474581f-29c2-403e-ac97-8de852895a8b service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received unexpected event network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff for instance with vm_state active and task_state reboot_started_hard.
Nov 02 17:34:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26531356465633261', 'path': '/dev/sdc'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531356465633261', 'path': '/dev/sdc'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-710681487',display_name='tempest-TestMinimumBasicScenario-server-710681487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-710681487',id=25,image_ref='13d514af-9a16-4b69-bb3d-c97adc69a481',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0577uFfOT8cUN6BtfQwlMQpRR/j74a2V6qrBANqwx4s/9epUKXZYsUi41B9mVFJjJCL5YkxgjxKwmbak1uGe6YArtVcvzacA13o+c0rtgXDMSTQ4iyD7+g4drcVrU92Q==',key_name='tempest-TestMinimumBasicScenario-1334816697',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:31:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad1b48d7070548bdae52f005ce12d606',ramdisk_id='',reservation_id='r-df01e7ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13d514af-9a16-4b69-bb3d-c97adc69a481',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-487832598',owner_user_name='tempest-TestMinimumBasicScenario-487832598-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:33:59Z,user_data=None,user_id='46cbf858998242a1a5d8b14b0e56cace',uuid=dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converting VIF {"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:6c:9c,bridge_name='br-int',has_traffic_filtering=True,id=28b668aa-b083-474c-bc08-9bd96a7ea7ff,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b668aa-b0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG nova.objects.instance [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lazy-loading 'pci_devices' on Instance uuid dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG nova.objects.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Object Instance<dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:34:01 user nova-compute[74980]:   <uuid>dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275</uuid>
Nov 02 17:34:01 user nova-compute[74980]:   <name>instance-00000019</name>
Nov 02 17:34:01 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:34:01 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:34:01 user nova-compute[74980]:   <metadata>
Nov 02 17:34:01 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:34:01 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:34:01 user nova-compute[74980]:       <nova:name>tempest-TestMinimumBasicScenario-server-710681487</nova:name>
Nov 02 17:34:01 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:33:59</nova:creationTime>
Nov 02 17:34:01 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:34:01 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:34:01 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:34:01 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:34:01 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:34:01 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:34:01 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:34:01 user nova-compute[74980]:       <nova:owner>
Nov 02 17:34:01 user nova-compute[74980]:         <nova:user uuid="46cbf858998242a1a5d8b14b0e56cace">tempest-TestMinimumBasicScenario-487832598-project-member</nova:user>
Nov 02 17:34:01 user nova-compute[74980]:         <nova:project uuid="ad1b48d7070548bdae52f005ce12d606">tempest-TestMinimumBasicScenario-487832598</nova:project>
Nov 02 17:34:01 user nova-compute[74980]:       </nova:owner>
Nov 02 17:34:01 user nova-compute[74980]:       <nova:root type="image" uuid="13d514af-9a16-4b69-bb3d-c97adc69a481"/>
Nov 02 17:34:01 user nova-compute[74980]:       <nova:ports>
Nov 02 17:34:01 user nova-compute[74980]:         <nova:port uuid="28b668aa-b083-474c-bc08-9bd96a7ea7ff">
Nov 02 17:34:01 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 17:34:01 user nova-compute[74980]:         </nova:port>
Nov 02 17:34:01 user nova-compute[74980]:       </nova:ports>
Nov 02 17:34:01 user nova-compute[74980]:     </nova:instance>
Nov 02 17:34:01 user nova-compute[74980]:   </metadata>
Nov 02 17:34:01 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:34:01 user nova-compute[74980]:     <system>
Nov 02 17:34:01 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:34:01 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:34:01 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:34:01 user nova-compute[74980]:       <entry name="serial">dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275</entry>
Nov 02 17:34:01 user nova-compute[74980]:       <entry name="uuid">dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275</entry>
Nov 02 17:34:01 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:34:01 user nova-compute[74980]:     </system>
Nov 02 17:34:01 user nova-compute[74980]:   </sysinfo>
Nov 02 17:34:01 user nova-compute[74980]:   <os>
Nov 02 17:34:01 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:34:01 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:34:01 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:34:01 user nova-compute[74980]:   </os>
Nov 02 17:34:01 user nova-compute[74980]:   <features>
Nov 02 17:34:01 user nova-compute[74980]:     <acpi/>
Nov 02 17:34:01 user nova-compute[74980]:     <apic/>
Nov 02 17:34:01 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:34:01 user nova-compute[74980]:   </features>
Nov 02 17:34:01 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:34:01 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:34:01 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:34:01 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:34:01 user nova-compute[74980]:   </clock>
Nov 02 17:34:01 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:34:01 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:34:01 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:34:01 user nova-compute[74980]:   </cpu>
Nov 02 17:34:01 user nova-compute[74980]:   <devices>
Nov 02 17:34:01 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:34:01 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:34:01 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk"/>
Nov 02 17:34:01 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:34:01 user nova-compute[74980]:     </disk>
Nov 02 17:34:01 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:34:01 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:34:01 user nova-compute[74980]:       <source dev="/dev/sdc"/>
Nov 02 17:34:01 user nova-compute[74980]:       <target dev="vdb" bus="virtio"/>
Nov 02 17:34:01 user nova-compute[74980]:       <serial>c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a</serial>
Nov 02 17:34:01 user nova-compute[74980]:     </disk>
Nov 02 17:34:01 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:34:01 user nova-compute[74980]:       <mac address="fa:16:3e:d8:6c:9c"/>
Nov 02 17:34:01 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:34:01 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:34:01 user nova-compute[74980]:       <target dev="tap28b668aa-b0"/>
Nov 02 17:34:01 user nova-compute[74980]:     </interface>
Nov 02 17:34:01 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:34:01 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/console.log" append="off"/>
Nov 02 17:34:01 user nova-compute[74980]:     </serial>
Nov 02 17:34:01 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:34:01 user nova-compute[74980]:     <video>
Nov 02 17:34:01 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:34:01 user nova-compute[74980]:     </video>
Nov 02 17:34:01 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:34:01 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:34:01 user nova-compute[74980]:     </rng>
Nov 02 17:34:01 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:34:01 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:34:01 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:34:01 user nova-compute[74980]:     </memballoon>
Nov 02 17:34:01 user nova-compute[74980]:   </devices>
Nov 02 17:34:01 user nova-compute[74980]: </domain>
Nov 02 17:34:01 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG nova.objects.instance [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lazy-loading 'trusted_certs' on Instance uuid dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG nova.objects.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Object Instance<dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0 --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Cannot resize image /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:34:01 user nova-compute[74980]: DEBUG nova.objects.instance [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lazy-loading 'migration_context' on Instance uuid dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG nova.objects.base [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Object Instance<dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-710681487',display_name='tempest-TestMinimumBasicScenario-server-710681487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-710681487',id=25,image_ref='13d514af-9a16-4b69-bb3d-c97adc69a481',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0577uFfOT8cUN6BtfQwlMQpRR/j74a2V6qrBANqwx4s/9epUKXZYsUi41B9mVFJjJCL5YkxgjxKwmbak1uGe6YArtVcvzacA13o+c0rtgXDMSTQ4iyD7+g4drcVrU92Q==',key_name='tempest-TestMinimumBasicScenario-1334816697',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:31:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='ad1b48d7070548bdae52f005ce12d606',ramdisk_id='',reservation_id='r-df01e7ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13d514af-9a16-4b69-bb3d-c97adc69a481',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-487832598',owner_user_name='tempest-TestMinimumBasicScenario-487832598-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:33:59Z,user_data=None,user_id='46cbf858998242a1a5d8b14b0e56cace',uuid=dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converting VIF {"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:6c:9c,bridge_name='br-int',has_traffic_filtering=True,id=28b668aa-b083-474c-bc08-9bd96a7ea7ff,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b668aa-b0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG os_vif [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:6c:9c,bridge_name='br-int',has_traffic_filtering=True,id=28b668aa-b083-474c-bc08-9bd96a7ea7ff,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b668aa-b0') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd29ba7d1-8f58-5bbc-99f6-69095abcea57', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28b668aa-b0, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28b668aa-b0, col_values=(('qos', UUID('15c9667e-4806-44f9-91e5-c2cbf217e971')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28b668aa-b0, col_values=(('external_ids', {'iface-id': '28b668aa-b083-474c-bc08-9bd96a7ea7ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:6c:9c', 'vm-uuid': 'dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:34:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:02 user nova-compute[74980]: INFO os_vif [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:6c:9c,bridge_name='br-int',has_traffic_filtering=True,id=28b668aa-b083-474c-bc08-9bd96a7ea7ff,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b668aa-b0')
Nov 02 17:34:02 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-4f344e80-0ac5-473e-9089-32dbb69bf06b req-4fc2ee6e-dea3-46be-ad0a-93aa5aa54d7b service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received event network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4f344e80-0ac5-473e-9089-32dbb69bf06b req-4fc2ee6e-dea3-46be-ad0a-93aa5aa54d7b service nova] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4f344e80-0ac5-473e-9089-32dbb69bf06b req-4fc2ee6e-dea3-46be-ad0a-93aa5aa54d7b service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4f344e80-0ac5-473e-9089-32dbb69bf06b req-4fc2ee6e-dea3-46be-ad0a-93aa5aa54d7b service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-4f344e80-0ac5-473e-9089-32dbb69bf06b req-4fc2ee6e-dea3-46be-ad0a-93aa5aa54d7b service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] No waiting events found dispatching network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:34:03 user nova-compute[74980]: WARNING nova.compute.manager [req-4f344e80-0ac5-473e-9089-32dbb69bf06b req-4fc2ee6e-dea3-46be-ad0a-93aa5aa54d7b service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received unexpected event network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff for instance with vm_state active and task_state reboot_started_hard.
Nov 02 17:34:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid 6319a96b-1499-4d79-8ffe-df25fab1c6d8 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid 66da6804-057c-4806-b036-d246768c498d {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid c6bfac8f-3834-4514-9a56-59c293ced966 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid 91bccf34-87a9-48f3-bbc7-4a70b9753036 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:03 user nova-compute[74980]: INFO nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "66da6804-057c-4806-b036-d246768c498d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "66da6804-057c-4806-b036-d246768c498d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "c6bfac8f-3834-4514-9a56-59c293ced966" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "66da6804-057c-4806-b036-d246768c498d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "c6bfac8f-3834-4514-9a56-59c293ced966" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:05 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:34:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:34:05 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Instance rebooted successfully.
Nov 02 17:34:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:34:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-6d653880-4524-4891-8208-7469bd0bdea4 req-5fbbe7df-0a2e-4386-a568-9a0e0a937c67 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received event network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:34:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6d653880-4524-4891-8208-7469bd0bdea4 req-5fbbe7df-0a2e-4386-a568-9a0e0a937c67 service nova] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6d653880-4524-4891-8208-7469bd0bdea4 req-5fbbe7df-0a2e-4386-a568-9a0e0a937c67 service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6d653880-4524-4891-8208-7469bd0bdea4 req-5fbbe7df-0a2e-4386-a568-9a0e0a937c67 service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-6d653880-4524-4891-8208-7469bd0bdea4 req-5fbbe7df-0a2e-4386-a568-9a0e0a937c67 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] No waiting events found dispatching network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:34:05 user nova-compute[74980]: WARNING nova.compute.manager [req-6d653880-4524-4891-8208-7469bd0bdea4 req-5fbbe7df-0a2e-4386-a568-9a0e0a937c67 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received unexpected event network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff for instance with vm_state active and task_state reboot_started_hard.
Nov 02 17:34:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-567c2885-d846-4999-b4af-8d4186ac1300 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.729s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.925s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:05 user nova-compute[74980]: INFO nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Nov 02 17:34:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "e7023293-bd74-4855-a446-ba835f216068" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "e7023293-bd74-4855-a446-ba835f216068" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:34:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:08 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:34:08 user nova-compute[74980]: INFO nova.compute.claims [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Claim successful on node user
Nov 02 17:34:08 user nova-compute[74980]: INFO nova.compute.manager [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Rescuing
Nov 02 17:34:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:34:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquired lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:34:08 user nova-compute[74980]: DEBUG nova.network.neutron [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:34:08 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:34:08 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:34:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:34:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:34:08 user nova-compute[74980]: DEBUG nova.network.neutron [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:34:08 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:34:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG nova.policy [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5675b52cc3114389b0195f6a300c3620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c992cd1419d42e9aeeb103900e8b136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG nova.compute.manager [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:34:09 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Creating image(s)
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "/opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "/opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG nova.network.neutron [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Updating instance_info_cache with network_info: [{"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Releasing lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.198s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.237s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk 1073741824" returned: 0 in 0.049s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.198s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG nova.network.neutron [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Successfully created port: 391db393-ad7d-448a-b660-9de2dc6bd8c8 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-cce696de-0e73-4d79-88b7-17cefb7fe9bf req-407edf0e-ccbf-474b-aabe-50ac9a6b3c6a service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received event network-vif-unplugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-cce696de-0e73-4d79-88b7-17cefb7fe9bf req-407edf0e-ccbf-474b-aabe-50ac9a6b3c6a service nova] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-cce696de-0e73-4d79-88b7-17cefb7fe9bf req-407edf0e-ccbf-474b-aabe-50ac9a6b3c6a service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-cce696de-0e73-4d79-88b7-17cefb7fe9bf req-407edf0e-ccbf-474b-aabe-50ac9a6b3c6a service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-cce696de-0e73-4d79-88b7-17cefb7fe9bf req-407edf0e-ccbf-474b-aabe-50ac9a6b3c6a service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] No waiting events found dispatching network-vif-unplugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:34:09 user nova-compute[74980]: WARNING nova.compute.manager [req-cce696de-0e73-4d79-88b7-17cefb7fe9bf req-407edf0e-ccbf-474b-aabe-50ac9a6b3c6a service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received unexpected event network-vif-unplugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad for instance with vm_state active and task_state rescuing.
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Cannot resize image /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Ensure instance console log exists: /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:10 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Instance destroyed successfully.
Nov 02 17:34:10 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Attempting rescue
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74980) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Instance directory exists: not creating {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 17:34:10 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Creating image(s)
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "/opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "/opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "/opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'trusted_certs' on Instance uuid 91bccf34-87a9-48f3-bbc7-4a70b9753036 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.193s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue" returned: 0 in 0.047s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'migration_context' on Instance uuid 91bccf34-87a9-48f3-bbc7-4a70b9753036 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.objects.base [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Object Instance<91bccf34-87a9-48f3-bbc7-4a70b9753036> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Start _get_guest_xml network_info=[{"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "vif_mac": "fa:16:3e:3d:11:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'resources' on Instance uuid 91bccf34-87a9-48f3-bbc7-4a70b9753036 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.objects.base [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Object Instance<91bccf34-87a9-48f3-bbc7-4a70b9753036> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'numa_topology' on Instance uuid 91bccf34-87a9-48f3-bbc7-4a70b9753036 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.objects.base [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Object Instance<91bccf34-87a9-48f3-bbc7-4a70b9753036> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:34:10 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:34:10 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'vcpu_model' on Instance uuid 91bccf34-87a9-48f3-bbc7-4a70b9753036 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.objects.base [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Object Instance<91bccf34-87a9-48f3-bbc7-4a70b9753036> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2077511521',display_name='tempest-ServerRescueNegativeTestJSON-server-2077511521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2077511521',id=28,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:32:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc26ef1932f1408c860b3b9edb4925a4',ramdisk_id='',reservation_id='r-jgytv777',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-86632079',owner_user_name='tempest-ServerRescueNegativeTestJSON-86632079-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:32:27Z,user_data=None,user_id='985386b6880e4b07bdad162c7860d7a3',uuid=91bccf34-87a9-48f3-bbc7-4a70b9753036,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "vif_mac": "fa:16:3e:3d:11:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converting VIF {"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "vif_mac": "fa:16:3e:3d:11:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:11:5f,bridge_name='br-int',has_traffic_filtering=True,id=ae57bdb2-dfca-46be-bc84-9ea10a5634ad,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae57bdb2-df') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'pci_devices' on Instance uuid 91bccf34-87a9-48f3-bbc7-4a70b9753036 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.objects.base [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Object Instance<91bccf34-87a9-48f3-bbc7-4a70b9753036> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:34:10 user nova-compute[74980]:   <uuid>91bccf34-87a9-48f3-bbc7-4a70b9753036</uuid>
Nov 02 17:34:10 user nova-compute[74980]:   <name>instance-0000001c</name>
Nov 02 17:34:10 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:34:10 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:34:10 user nova-compute[74980]:   <metadata>
Nov 02 17:34:10 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:34:10 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:34:10 user nova-compute[74980]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2077511521</nova:name>
Nov 02 17:34:10 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:34:10</nova:creationTime>
Nov 02 17:34:10 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:34:10 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:34:10 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:34:10 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:34:10 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:34:10 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:34:10 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:34:10 user nova-compute[74980]:       <nova:owner>
Nov 02 17:34:10 user nova-compute[74980]:         <nova:user uuid="985386b6880e4b07bdad162c7860d7a3">tempest-ServerRescueNegativeTestJSON-86632079-project-member</nova:user>
Nov 02 17:34:10 user nova-compute[74980]:         <nova:project uuid="dc26ef1932f1408c860b3b9edb4925a4">tempest-ServerRescueNegativeTestJSON-86632079</nova:project>
Nov 02 17:34:10 user nova-compute[74980]:       </nova:owner>
Nov 02 17:34:10 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:34:10 user nova-compute[74980]:       <nova:ports>
Nov 02 17:34:10 user nova-compute[74980]:         <nova:port uuid="ae57bdb2-dfca-46be-bc84-9ea10a5634ad">
Nov 02 17:34:10 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 17:34:10 user nova-compute[74980]:         </nova:port>
Nov 02 17:34:10 user nova-compute[74980]:       </nova:ports>
Nov 02 17:34:10 user nova-compute[74980]:     </nova:instance>
Nov 02 17:34:10 user nova-compute[74980]:   </metadata>
Nov 02 17:34:10 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:34:10 user nova-compute[74980]:     <system>
Nov 02 17:34:10 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:34:10 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:34:10 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:34:10 user nova-compute[74980]:       <entry name="serial">91bccf34-87a9-48f3-bbc7-4a70b9753036</entry>
Nov 02 17:34:10 user nova-compute[74980]:       <entry name="uuid">91bccf34-87a9-48f3-bbc7-4a70b9753036</entry>
Nov 02 17:34:10 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:34:10 user nova-compute[74980]:     </system>
Nov 02 17:34:10 user nova-compute[74980]:   </sysinfo>
Nov 02 17:34:10 user nova-compute[74980]:   <os>
Nov 02 17:34:10 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:34:10 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:34:10 user nova-compute[74980]:   </os>
Nov 02 17:34:10 user nova-compute[74980]:   <features>
Nov 02 17:34:10 user nova-compute[74980]:     <acpi/>
Nov 02 17:34:10 user nova-compute[74980]:     <apic/>
Nov 02 17:34:10 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:34:10 user nova-compute[74980]:   </features>
Nov 02 17:34:10 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:34:10 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:34:10 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:34:10 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:34:10 user nova-compute[74980]:   </clock>
Nov 02 17:34:10 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:34:10 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:34:10 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:34:10 user nova-compute[74980]:   </cpu>
Nov 02 17:34:10 user nova-compute[74980]:   <devices>
Nov 02 17:34:10 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:34:10 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:34:10 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue"/>
Nov 02 17:34:10 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:34:10 user nova-compute[74980]:     </disk>
Nov 02 17:34:10 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:34:10 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:34:10 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk"/>
Nov 02 17:34:10 user nova-compute[74980]:       <target dev="vdb" bus="virtio"/>
Nov 02 17:34:10 user nova-compute[74980]:     </disk>
Nov 02 17:34:10 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:34:10 user nova-compute[74980]:       <mac address="fa:16:3e:3d:11:5f"/>
Nov 02 17:34:10 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:34:10 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:34:10 user nova-compute[74980]:       <target dev="tapae57bdb2-df"/>
Nov 02 17:34:10 user nova-compute[74980]:     </interface>
Nov 02 17:34:10 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:34:10 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/console.log" append="off"/>
Nov 02 17:34:10 user nova-compute[74980]:     </serial>
Nov 02 17:34:10 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:34:10 user nova-compute[74980]:     <video>
Nov 02 17:34:10 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:34:10 user nova-compute[74980]:     </video>
Nov 02 17:34:10 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:34:10 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:34:10 user nova-compute[74980]:     </rng>
Nov 02 17:34:10 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:34:10 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:34:10 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:34:10 user nova-compute[74980]:     </memballoon>
Nov 02 17:34:10 user nova-compute[74980]:   </devices>
Nov 02 17:34:10 user nova-compute[74980]: </domain>
Nov 02 17:34:10 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:34:10 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Instance destroyed successfully.
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No VIF found with MAC fa:16:3e:3d:11:5f, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.network.neutron [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Successfully updated port: 391db393-ad7d-448a-b660-9de2dc6bd8c8 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "refresh_cache-e7023293-bd74-4855-a446-ba835f216068" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquired lock "refresh_cache-e7023293-bd74-4855-a446-ba835f216068" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.network.neutron [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.compute.manager [req-101f287b-6293-4990-a506-2228efb94503 req-a2780f48-ac1a-4e45-9d3b-986c2157e3e7 service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] Received event network-changed-391db393-ad7d-448a-b660-9de2dc6bd8c8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG nova.compute.manager [req-101f287b-6293-4990-a506-2228efb94503 req-a2780f48-ac1a-4e45-9d3b-986c2157e3e7 service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] Refreshing instance network info cache due to event network-changed-391db393-ad7d-448a-b660-9de2dc6bd8c8. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:34:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-101f287b-6293-4990-a506-2228efb94503 req-a2780f48-ac1a-4e45-9d3b-986c2157e3e7 service nova] Acquiring lock "refresh_cache-e7023293-bd74-4855-a446-ba835f216068" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Updating instance_info_cache with network_info: [{"id": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "address": "fa:16:3e:d7:b9:06", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391db393-ad", "ovs_interfaceid": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Releasing lock "refresh_cache-e7023293-bd74-4855-a446-ba835f216068" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Instance network_info: |[{"id": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "address": "fa:16:3e:d7:b9:06", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391db393-ad", "ovs_interfaceid": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-101f287b-6293-4990-a506-2228efb94503 req-a2780f48-ac1a-4e45-9d3b-986c2157e3e7 service nova] Acquired lock "refresh_cache-e7023293-bd74-4855-a446-ba835f216068" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.network.neutron [req-101f287b-6293-4990-a506-2228efb94503 req-a2780f48-ac1a-4e45-9d3b-986c2157e3e7 service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] Refreshing network info cache for port 391db393-ad7d-448a-b660-9de2dc6bd8c8 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Start _get_guest_xml network_info=[{"id": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "address": "fa:16:3e:d7:b9:06", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391db393-ad", "ovs_interfaceid": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:34:11 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:34:11 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:34:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2103628552',display_name='tempest-VolumesActionsTest-instance-2103628552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2103628552',id=29,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c992cd1419d42e9aeeb103900e8b136',ramdisk_id='',reservation_id='r-awfuekl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-782476121',owner_user_name='tempest-VolumesActionsTest-782476121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:34:09Z,user_data=None,user_id='5675b52cc3114389b0195f6a300c3620',uuid=e7023293-bd74-4855-a446-ba835f216068,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "address": "fa:16:3e:d7:b9:06", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391db393-ad", "ovs_interfaceid": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Converting VIF {"id": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "address": "fa:16:3e:d7:b9:06", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391db393-ad", "ovs_interfaceid": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=391db393-ad7d-448a-b660-9de2dc6bd8c8,network=Network(d15bb169-1025-4bd1-8bc8-5df04514f280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391db393-ad') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.objects.instance [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lazy-loading 'pci_devices' on Instance uuid e7023293-bd74-4855-a446-ba835f216068 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:34:11 user nova-compute[74980]:   <uuid>e7023293-bd74-4855-a446-ba835f216068</uuid>
Nov 02 17:34:11 user nova-compute[74980]:   <name>instance-0000001d</name>
Nov 02 17:34:11 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:34:11 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:34:11 user nova-compute[74980]:   <metadata>
Nov 02 17:34:11 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:34:11 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:34:11 user nova-compute[74980]:       <nova:name>tempest-VolumesActionsTest-instance-2103628552</nova:name>
Nov 02 17:34:11 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:34:11</nova:creationTime>
Nov 02 17:34:11 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:34:11 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:34:11 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:34:11 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:34:11 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:34:11 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:34:11 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:34:11 user nova-compute[74980]:       <nova:owner>
Nov 02 17:34:11 user nova-compute[74980]:         <nova:user uuid="5675b52cc3114389b0195f6a300c3620">tempest-VolumesActionsTest-782476121-project-member</nova:user>
Nov 02 17:34:11 user nova-compute[74980]:         <nova:project uuid="6c992cd1419d42e9aeeb103900e8b136">tempest-VolumesActionsTest-782476121</nova:project>
Nov 02 17:34:11 user nova-compute[74980]:       </nova:owner>
Nov 02 17:34:11 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:34:11 user nova-compute[74980]:       <nova:ports>
Nov 02 17:34:11 user nova-compute[74980]:         <nova:port uuid="391db393-ad7d-448a-b660-9de2dc6bd8c8">
Nov 02 17:34:11 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 17:34:11 user nova-compute[74980]:         </nova:port>
Nov 02 17:34:11 user nova-compute[74980]:       </nova:ports>
Nov 02 17:34:11 user nova-compute[74980]:     </nova:instance>
Nov 02 17:34:11 user nova-compute[74980]:   </metadata>
Nov 02 17:34:11 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:34:11 user nova-compute[74980]:     <system>
Nov 02 17:34:11 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:34:11 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:34:11 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:34:11 user nova-compute[74980]:       <entry name="serial">e7023293-bd74-4855-a446-ba835f216068</entry>
Nov 02 17:34:11 user nova-compute[74980]:       <entry name="uuid">e7023293-bd74-4855-a446-ba835f216068</entry>
Nov 02 17:34:11 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:34:11 user nova-compute[74980]:     </system>
Nov 02 17:34:11 user nova-compute[74980]:   </sysinfo>
Nov 02 17:34:11 user nova-compute[74980]:   <os>
Nov 02 17:34:11 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:34:11 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:34:11 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:34:11 user nova-compute[74980]:   </os>
Nov 02 17:34:11 user nova-compute[74980]:   <features>
Nov 02 17:34:11 user nova-compute[74980]:     <acpi/>
Nov 02 17:34:11 user nova-compute[74980]:     <apic/>
Nov 02 17:34:11 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:34:11 user nova-compute[74980]:   </features>
Nov 02 17:34:11 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:34:11 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:34:11 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:34:11 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:34:11 user nova-compute[74980]:   </clock>
Nov 02 17:34:11 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:34:11 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:34:11 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:34:11 user nova-compute[74980]:   </cpu>
Nov 02 17:34:11 user nova-compute[74980]:   <devices>
Nov 02 17:34:11 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:34:11 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:34:11 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk"/>
Nov 02 17:34:11 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:34:11 user nova-compute[74980]:     </disk>
Nov 02 17:34:11 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:34:11 user nova-compute[74980]:       <mac address="fa:16:3e:d7:b9:06"/>
Nov 02 17:34:11 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:34:11 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:34:11 user nova-compute[74980]:       <target dev="tap391db393-ad"/>
Nov 02 17:34:11 user nova-compute[74980]:     </interface>
Nov 02 17:34:11 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:34:11 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/console.log" append="off"/>
Nov 02 17:34:11 user nova-compute[74980]:     </serial>
Nov 02 17:34:11 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:34:11 user nova-compute[74980]:     <video>
Nov 02 17:34:11 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:34:11 user nova-compute[74980]:     </video>
Nov 02 17:34:11 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:34:11 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:34:11 user nova-compute[74980]:     </rng>
Nov 02 17:34:11 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:34:11 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:34:11 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:34:11 user nova-compute[74980]:     </memballoon>
Nov 02 17:34:11 user nova-compute[74980]:   </devices>
Nov 02 17:34:11 user nova-compute[74980]: </domain>
Nov 02 17:34:11 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:34:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2103628552',display_name='tempest-VolumesActionsTest-instance-2103628552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2103628552',id=29,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c992cd1419d42e9aeeb103900e8b136',ramdisk_id='',reservation_id='r-awfuekl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-782476121',owner_user_name='tempest-VolumesActionsTest-782476121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:34:09Z,user_data=None,user_id='5675b52cc3114389b0195f6a300c3620',uuid=e7023293-bd74-4855-a446-ba835f216068,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "address": "fa:16:3e:d7:b9:06", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391db393-ad", "ovs_interfaceid": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Converting VIF {"id": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "address": "fa:16:3e:d7:b9:06", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391db393-ad", "ovs_interfaceid": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=391db393-ad7d-448a-b660-9de2dc6bd8c8,network=Network(d15bb169-1025-4bd1-8bc8-5df04514f280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391db393-ad') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG os_vif [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=391db393-ad7d-448a-b660-9de2dc6bd8c8,network=Network(d15bb169-1025-4bd1-8bc8-5df04514f280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391db393-ad') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8611781c-6314-5eb0-b07f-7b386965790b', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap391db393-ad, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap391db393-ad, col_values=(('qos', UUID('170fb203-1383-4b99-a74f-6307eea499de')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap391db393-ad, col_values=(('external_ids', {'iface-id': '391db393-ad7d-448a-b660-9de2dc6bd8c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:b9:06', 'vm-uuid': 'e7023293-bd74-4855-a446-ba835f216068'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:11 user nova-compute[74980]: INFO os_vif [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=391db393-ad7d-448a-b660-9de2dc6bd8c8,network=Network(d15bb169-1025-4bd1-8bc8-5df04514f280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391db393-ad')
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] No VIF found with MAC fa:16:3e:d7:b9:06, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-11dea276-d91c-477d-8824-5e5a1ba46775 req-c997ccb1-ea2e-4944-9b1f-a141581e0dbc service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-11dea276-d91c-477d-8824-5e5a1ba46775 req-c997ccb1-ea2e-4944-9b1f-a141581e0dbc service nova] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-11dea276-d91c-477d-8824-5e5a1ba46775 req-c997ccb1-ea2e-4944-9b1f-a141581e0dbc service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-11dea276-d91c-477d-8824-5e5a1ba46775 req-c997ccb1-ea2e-4944-9b1f-a141581e0dbc service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-11dea276-d91c-477d-8824-5e5a1ba46775 req-c997ccb1-ea2e-4944-9b1f-a141581e0dbc service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] No waiting events found dispatching network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:34:11 user nova-compute[74980]: WARNING nova.compute.manager [req-11dea276-d91c-477d-8824-5e5a1ba46775 req-c997ccb1-ea2e-4944-9b1f-a141581e0dbc service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received unexpected event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad for instance with vm_state active and task_state rescuing.
Nov 02 17:34:12 user nova-compute[74980]: DEBUG nova.network.neutron [req-101f287b-6293-4990-a506-2228efb94503 req-a2780f48-ac1a-4e45-9d3b-986c2157e3e7 service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] Updated VIF entry in instance network info cache for port 391db393-ad7d-448a-b660-9de2dc6bd8c8. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:34:12 user nova-compute[74980]: DEBUG nova.network.neutron [req-101f287b-6293-4990-a506-2228efb94503 req-a2780f48-ac1a-4e45-9d3b-986c2157e3e7 service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] Updating instance_info_cache with network_info: [{"id": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "address": "fa:16:3e:d7:b9:06", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391db393-ad", "ovs_interfaceid": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:34:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-101f287b-6293-4990-a506-2228efb94503 req-a2780f48-ac1a-4e45-9d3b-986c2157e3e7 service nova] Releasing lock "refresh_cache-e7023293-bd74-4855-a446-ba835f216068" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:34:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-cbd93fef-3121-4354-a421-ccc7d2a29f31 req-3e689822-01c9-4075-8af4-599727ed3349 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-cbd93fef-3121-4354-a421-ccc7d2a29f31 req-3e689822-01c9-4075-8af4-599727ed3349 service nova] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-cbd93fef-3121-4354-a421-ccc7d2a29f31 req-3e689822-01c9-4075-8af4-599727ed3349 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-cbd93fef-3121-4354-a421-ccc7d2a29f31 req-3e689822-01c9-4075-8af4-599727ed3349 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-cbd93fef-3121-4354-a421-ccc7d2a29f31 req-3e689822-01c9-4075-8af4-599727ed3349 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] No waiting events found dispatching network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:34:14 user nova-compute[74980]: WARNING nova.compute.manager [req-cbd93fef-3121-4354-a421-ccc7d2a29f31 req-3e689822-01c9-4075-8af4-599727ed3349 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received unexpected event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad for instance with vm_state active and task_state rescuing.
Nov 02 17:34:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-cbd93fef-3121-4354-a421-ccc7d2a29f31 req-3e689822-01c9-4075-8af4-599727ed3349 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-cbd93fef-3121-4354-a421-ccc7d2a29f31 req-3e689822-01c9-4075-8af4-599727ed3349 service nova] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-cbd93fef-3121-4354-a421-ccc7d2a29f31 req-3e689822-01c9-4075-8af4-599727ed3349 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-cbd93fef-3121-4354-a421-ccc7d2a29f31 req-3e689822-01c9-4075-8af4-599727ed3349 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-cbd93fef-3121-4354-a421-ccc7d2a29f31 req-3e689822-01c9-4075-8af4-599727ed3349 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] No waiting events found dispatching network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:34:14 user nova-compute[74980]: WARNING nova.compute.manager [req-cbd93fef-3121-4354-a421-ccc7d2a29f31 req-3e689822-01c9-4075-8af4-599727ed3349 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received unexpected event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad for instance with vm_state active and task_state rescuing.
Nov 02 17:34:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-c4903339-26f3-483b-a81f-afaf20485bab req-5cf23cbb-8c67-4305-82f5-ec27e07e4912 service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] Received event network-vif-plugged-391db393-ad7d-448a-b660-9de2dc6bd8c8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4903339-26f3-483b-a81f-afaf20485bab req-5cf23cbb-8c67-4305-82f5-ec27e07e4912 service nova] Acquiring lock "e7023293-bd74-4855-a446-ba835f216068-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4903339-26f3-483b-a81f-afaf20485bab req-5cf23cbb-8c67-4305-82f5-ec27e07e4912 service nova] Lock "e7023293-bd74-4855-a446-ba835f216068-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4903339-26f3-483b-a81f-afaf20485bab req-5cf23cbb-8c67-4305-82f5-ec27e07e4912 service nova] Lock "e7023293-bd74-4855-a446-ba835f216068-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-c4903339-26f3-483b-a81f-afaf20485bab req-5cf23cbb-8c67-4305-82f5-ec27e07e4912 service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] No waiting events found dispatching network-vif-plugged-391db393-ad7d-448a-b660-9de2dc6bd8c8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:34:14 user nova-compute[74980]: WARNING nova.compute.manager [req-c4903339-26f3-483b-a81f-afaf20485bab req-5cf23cbb-8c67-4305-82f5-ec27e07e4912 service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] Received unexpected event network-vif-plugged-391db393-ad7d-448a-b660-9de2dc6bd8c8 for instance with vm_state building and task_state spawning.
Nov 02 17:34:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:16 user nova-compute[74980]: DEBUG nova.compute.manager [None req-36ed4cde-5794-45c0-8740-7b3235f0e598 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:34:16 user nova-compute[74980]: DEBUG nova.compute.manager [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:34:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:34:16 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e7023293-bd74-4855-a446-ba835f216068] Instance spawned successfully.
Nov 02 17:34:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:34:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-9b97863d-a5e3-449e-80ef-cdd48b84bc9d req-48a2c325-2359-4a0e-a619-4e4e73be40c6 service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] Received event network-vif-plugged-391db393-ad7d-448a-b660-9de2dc6bd8c8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:34:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9b97863d-a5e3-449e-80ef-cdd48b84bc9d req-48a2c325-2359-4a0e-a619-4e4e73be40c6 service nova] Acquiring lock "e7023293-bd74-4855-a446-ba835f216068-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9b97863d-a5e3-449e-80ef-cdd48b84bc9d req-48a2c325-2359-4a0e-a619-4e4e73be40c6 service nova] Lock "e7023293-bd74-4855-a446-ba835f216068-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9b97863d-a5e3-449e-80ef-cdd48b84bc9d req-48a2c325-2359-4a0e-a619-4e4e73be40c6 service nova] Lock "e7023293-bd74-4855-a446-ba835f216068-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-9b97863d-a5e3-449e-80ef-cdd48b84bc9d req-48a2c325-2359-4a0e-a619-4e4e73be40c6 service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] No waiting events found dispatching network-vif-plugged-391db393-ad7d-448a-b660-9de2dc6bd8c8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:34:16 user nova-compute[74980]: WARNING nova.compute.manager [req-9b97863d-a5e3-449e-80ef-cdd48b84bc9d req-48a2c325-2359-4a0e-a619-4e4e73be40c6 service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] Received unexpected event network-vif-plugged-391db393-ad7d-448a-b660-9de2dc6bd8c8 for instance with vm_state building and task_state spawning.
Nov 02 17:34:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:34:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:34:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:34:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:34:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:34:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:34:16 user nova-compute[74980]: INFO nova.compute.manager [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Took 7.42 seconds to spawn the instance on the hypervisor.
Nov 02 17:34:16 user nova-compute[74980]: DEBUG nova.compute.manager [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:34:16 user nova-compute[74980]: INFO nova.compute.manager [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Took 8.34 seconds to build instance.
Nov 02 17:34:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-bb4311ba-f927-42b1-a17c-614c18ee1ac5 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "e7023293-bd74-4855-a446-ba835f216068" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.456s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:17 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:34:17 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:34:17 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:34:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:34:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:34:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Starting finish_migration {{(pid=74980) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Instance directory exists: not creating {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 17:34:19 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Creating image(s)
Nov 02 17:34:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.254s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk. size=21474836480 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk 21474836480 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk 21474836480" returned: 0 in 0.058s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Ensure instance console log exists: /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Start _get_guest_xml network_info=[{"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-261425156-network", "vif_mac": "fa:16:3e:1e:4f:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPsmWyMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6319a96b-1499-4d79-8ffe-df25fab1c6d8', 'attached_at': '2023-11-02T17:34:19.000000', 'detached_at': '', 'volume_id': '97d1af33-b87a-43ce-887c-348021c25d1b', 'serial': '97d1af33-b87a-43ce-887c-348021c25d1b'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '8c1b39c5-2808-4316-9bfa-9e1de12daa85', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:34:20 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:34:20 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPsmWyMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:34:20 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:34:20 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:34:20 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[891e20ec-b6cf-47ce-815c-007d3bd1be2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:34:20 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad727461-63da-41b3-9f3d-b5ae9980ec3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b] added
Nov 02 17:34:20 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86d7eea-c207-4758-96cb-3b0ba5cc56c9]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8369c63-0b16-4a05-9556-947464091994]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPsmWyMY {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPsmWyMY" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1484fc-cc53-4898-8a8f-925f070da3f1]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cPsmWyMY'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ba5f7f-c081-492f-8191-0c1d7b13216a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd829c9d-3631-464e-9bc3-5fcd8227b215]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:34:20 user nova-compute[74980]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:34:20 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:34:20 user nova-compute[74980]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:34:20 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2308b7f2-2e8c-4f16-beaf-d352e963c888]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260]
Nov 02 17:34:20 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260] successful.
Nov 02 17:34:20 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4473f9-9ccf-4bde-b551-60a078215b0f]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e9e3bb-58fa-424e-ad7c-5579edd26981]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:34:20 user nova-compute[74980]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:34:20 user nova-compute[74980]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:34:20 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:34:20 user nova-compute[74980]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:34:20 user nova-compute[74980]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:34:20 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbc691a-f740-46d8-9779-f8e636ed7a95]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPsmWyMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:34:21 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:34:21 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8270MB free_disk=25.199604034423828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26430376437313038', 'path': '/dev/sdd'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430376437313038', 'path': '/dev/sdd'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1460645799',display_name='tempest-ServerActionsTestOtherB-server-1460645799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1460645799',id=23,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDC1zazFsVcK8cRSvh0A9JDxfLAmb3MmWE+O0wv7/MERQOOzJbF5AG6ze84hXy646Ak4C6ld6XkTeszBqKFoffMRNgW/kfbra+jqQgZdpkDkqH9hu6Bzizhbp6Bezooetw==',key_name='tempest-keypair-1765002056',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:29:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ca163fc9523f4f83bd2efba0ec7e468d',ramdisk_id='',reservation_id='r-1djtdfew',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-879907014',owner_user_name='tempest-ServerActionsTestOtherB-879907014-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f7818185f98430399f7f2fe9465217c',uuid=6319a96b-1499-4d79-8ffe-df25fab1c6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-261425156-network", "vif_mac": "fa:16:3e:1e:4f:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converting VIF {"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-261425156-network", "vif_mac": "fa:16:3e:1e:4f:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:34:21 user nova-compute[74980]:   <uuid>6319a96b-1499-4d79-8ffe-df25fab1c6d8</uuid>
Nov 02 17:34:21 user nova-compute[74980]:   <name>instance-00000017</name>
Nov 02 17:34:21 user nova-compute[74980]:   <memory>2097152</memory>
Nov 02 17:34:21 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:34:21 user nova-compute[74980]:   <metadata>
Nov 02 17:34:21 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:34:21 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:34:21 user nova-compute[74980]:       <nova:name>tempest-ServerActionsTestOtherB-server-1460645799</nova:name>
Nov 02 17:34:21 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:34:20</nova:creationTime>
Nov 02 17:34:21 user nova-compute[74980]:       <nova:flavor name="m1.small">
Nov 02 17:34:21 user nova-compute[74980]:         <nova:memory>2048</nova:memory>
Nov 02 17:34:21 user nova-compute[74980]:         <nova:disk>20</nova:disk>
Nov 02 17:34:21 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:34:21 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:34:21 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:34:21 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:34:21 user nova-compute[74980]:       <nova:owner>
Nov 02 17:34:21 user nova-compute[74980]:         <nova:user uuid="8f7818185f98430399f7f2fe9465217c">tempest-ServerActionsTestOtherB-879907014-project-member</nova:user>
Nov 02 17:34:21 user nova-compute[74980]:         <nova:project uuid="ca163fc9523f4f83bd2efba0ec7e468d">tempest-ServerActionsTestOtherB-879907014</nova:project>
Nov 02 17:34:21 user nova-compute[74980]:       </nova:owner>
Nov 02 17:34:21 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:34:21 user nova-compute[74980]:       <nova:ports>
Nov 02 17:34:21 user nova-compute[74980]:         <nova:port uuid="f5e8978e-28b1-419e-a745-0a784521ee3d">
Nov 02 17:34:21 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 17:34:21 user nova-compute[74980]:         </nova:port>
Nov 02 17:34:21 user nova-compute[74980]:       </nova:ports>
Nov 02 17:34:21 user nova-compute[74980]:     </nova:instance>
Nov 02 17:34:21 user nova-compute[74980]:   </metadata>
Nov 02 17:34:21 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:34:21 user nova-compute[74980]:     <system>
Nov 02 17:34:21 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:34:21 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:34:21 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:34:21 user nova-compute[74980]:       <entry name="serial">6319a96b-1499-4d79-8ffe-df25fab1c6d8</entry>
Nov 02 17:34:21 user nova-compute[74980]:       <entry name="uuid">6319a96b-1499-4d79-8ffe-df25fab1c6d8</entry>
Nov 02 17:34:21 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:34:21 user nova-compute[74980]:     </system>
Nov 02 17:34:21 user nova-compute[74980]:   </sysinfo>
Nov 02 17:34:21 user nova-compute[74980]:   <os>
Nov 02 17:34:21 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:34:21 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:34:21 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:34:21 user nova-compute[74980]:   </os>
Nov 02 17:34:21 user nova-compute[74980]:   <features>
Nov 02 17:34:21 user nova-compute[74980]:     <acpi/>
Nov 02 17:34:21 user nova-compute[74980]:     <apic/>
Nov 02 17:34:21 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:34:21 user nova-compute[74980]:   </features>
Nov 02 17:34:21 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:34:21 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:34:21 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:34:21 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:34:21 user nova-compute[74980]:   </clock>
Nov 02 17:34:21 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:34:21 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:34:21 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:34:21 user nova-compute[74980]:   </cpu>
Nov 02 17:34:21 user nova-compute[74980]:   <devices>
Nov 02 17:34:21 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:34:21 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:34:21 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk"/>
Nov 02 17:34:21 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:34:21 user nova-compute[74980]:     </disk>
Nov 02 17:34:21 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:34:21 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:34:21 user nova-compute[74980]:       <source dev="/dev/sdd"/>
Nov 02 17:34:21 user nova-compute[74980]:       <target dev="vdb" bus="virtio"/>
Nov 02 17:34:21 user nova-compute[74980]:       <serial>97d1af33-b87a-43ce-887c-348021c25d1b</serial>
Nov 02 17:34:21 user nova-compute[74980]:     </disk>
Nov 02 17:34:21 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:34:21 user nova-compute[74980]:       <mac address="fa:16:3e:1e:4f:61"/>
Nov 02 17:34:21 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:34:21 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:34:21 user nova-compute[74980]:       <target dev="tapf5e8978e-28"/>
Nov 02 17:34:21 user nova-compute[74980]:     </interface>
Nov 02 17:34:21 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:34:21 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/console.log" append="off"/>
Nov 02 17:34:21 user nova-compute[74980]:     </serial>
Nov 02 17:34:21 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:34:21 user nova-compute[74980]:     <video>
Nov 02 17:34:21 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:34:21 user nova-compute[74980]:     </video>
Nov 02 17:34:21 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:34:21 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:34:21 user nova-compute[74980]:     </rng>
Nov 02 17:34:21 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:34:21 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:34:21 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:34:21 user nova-compute[74980]:     </memballoon>
Nov 02 17:34:21 user nova-compute[74980]:   </devices>
Nov 02 17:34:21 user nova-compute[74980]: </domain>
Nov 02 17:34:21 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1460645799',display_name='tempest-ServerActionsTestOtherB-server-1460645799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1460645799',id=23,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDC1zazFsVcK8cRSvh0A9JDxfLAmb3MmWE+O0wv7/MERQOOzJbF5AG6ze84hXy646Ak4C6ld6XkTeszBqKFoffMRNgW/kfbra+jqQgZdpkDkqH9hu6Bzizhbp6Bezooetw==',key_name='tempest-keypair-1765002056',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:29:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ca163fc9523f4f83bd2efba0ec7e468d',ramdisk_id='',reservation_id='r-1djtdfew',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-879907014',owner_user_name='tempest-ServerActionsTestOtherB-879907014-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f7818185f98430399f7f2fe9465217c',uuid=6319a96b-1499-4d79-8ffe-df25fab1c6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-261425156-network", "vif_mac": "fa:16:3e:1e:4f:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converting VIF {"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-261425156-network", "vif_mac": "fa:16:3e:1e:4f:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG os_vif [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '436a0bc9-b2bc-5fdd-a52b-5f200b506cee', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Applying migration context for instance 6319a96b-1499-4d79-8ffe-df25fab1c6d8 as it has an incoming, in-progress migration 3156bc7a-4774-4d40-b647-a6b23d1fa94b. Migration status is post-migrating {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 17:34:21 user nova-compute[74980]: INFO nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating resource usage from migration 3156bc7a-4774-4d40-b647-a6b23d1fa94b
Nov 02 17:34:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5e8978e-28, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5e8978e-28, col_values=(('qos', UUID('e68664f1-b423-4ec4-a96f-aa6330c8a224')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5e8978e-28, col_values=(('external_ids', {'iface-id': 'f5e8978e-28b1-419e-a745-0a784521ee3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:4f:61', 'vm-uuid': '6319a96b-1499-4d79-8ffe-df25fab1c6d8'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:21 user nova-compute[74980]: INFO os_vif [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28')
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 66da6804-057c-4806-b036-d246768c498d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Migration 3156bc7a-4774-4d40-b647-a6b23d1fa94b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6319a96b-1499-4d79-8ffe-df25fab1c6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e7023293-bd74-4855-a446-ba835f216068 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] No VIF found with MAC fa:16:3e:1e:4f:61, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:34:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:22 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:34:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:34:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-b204eec2-6db2-42ad-826e-8e87449145b1 req-0f3f37d8-d357-423f-886c-5fe43dff435d service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b204eec2-6db2-42ad-826e-8e87449145b1 req-0f3f37d8-d357-423f-886c-5fe43dff435d service nova] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b204eec2-6db2-42ad-826e-8e87449145b1 req-0f3f37d8-d357-423f-886c-5fe43dff435d service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b204eec2-6db2-42ad-826e-8e87449145b1 req-0f3f37d8-d357-423f-886c-5fe43dff435d service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-b204eec2-6db2-42ad-826e-8e87449145b1 req-0f3f37d8-d357-423f-886c-5fe43dff435d service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] No waiting events found dispatching network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:34:23 user nova-compute[74980]: WARNING nova.compute.manager [req-b204eec2-6db2-42ad-826e-8e87449145b1 req-0f3f37d8-d357-423f-886c-5fe43dff435d service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received unexpected event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d for instance with vm_state active and task_state resize_finish.
Nov 02 17:34:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updating instance_info_cache with network_info: [{"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-e031fdfa-a781-4d80-aea8-edeec79aa957 req-2ff12389-ff26-4dac-b198-19d46c9a94dc service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:34:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e031fdfa-a781-4d80-aea8-edeec79aa957 req-2ff12389-ff26-4dac-b198-19d46c9a94dc service nova] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:34:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e031fdfa-a781-4d80-aea8-edeec79aa957 req-2ff12389-ff26-4dac-b198-19d46c9a94dc service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:34:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e031fdfa-a781-4d80-aea8-edeec79aa957 req-2ff12389-ff26-4dac-b198-19d46c9a94dc service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:34:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-e031fdfa-a781-4d80-aea8-edeec79aa957 req-2ff12389-ff26-4dac-b198-19d46c9a94dc service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] No waiting events found dispatching network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:34:25 user nova-compute[74980]: WARNING nova.compute.manager [req-e031fdfa-a781-4d80-aea8-edeec79aa957 req-2ff12389-ff26-4dac-b198-19d46c9a94dc service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received unexpected event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d for instance with vm_state active and task_state resize_finish.
Nov 02 17:34:25 user nova-compute[74980]: DEBUG nova.compute.manager [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:34:25 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Instance running successfully.
Nov 02 17:34:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Failed to set time: agent not configured {{(pid=74980) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 02 17:34:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-96aa5847-679f-4c72-9c6d-b79391c9ee79 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] finish_migration finished successfully. {{(pid=74980) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 02 17:34:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:34:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:35:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:35:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:35:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:35:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:35:12 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:35:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:35:17 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:35:17 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:35:17 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:35:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:35:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:35:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:35:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:35:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:35:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:35:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:35:20 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:35:20 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:35:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=7893MB free_disk=25.168781280517578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Applying migration context for instance 6319a96b-1499-4d79-8ffe-df25fab1c6d8 as it has an incoming, in-progress migration 3156bc7a-4774-4d40-b647-a6b23d1fa94b. Migration status is finished {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 17:35:20 user nova-compute[74980]: INFO nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating resource usage from migration 3156bc7a-4774-4d40-b647-a6b23d1fa94b
Nov 02 17:35:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 66da6804-057c-4806-b036-d246768c498d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Migration 3156bc7a-4774-4d40-b647-a6b23d1fa94b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6319a96b-1499-4d79-8ffe-df25fab1c6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e7023293-bd74-4855-a446-ba835f216068 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:35:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:35:21 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:35:21 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:35:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:35:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:35:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:35:23 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:35:23 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:35:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:35:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 17:35:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:35:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:35:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:35:23 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:35:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updating instance_info_cache with network_info: [{"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:35:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:35:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:35:23 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:35:23 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:35:23 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:35:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:35 user nova-compute[74980]: INFO nova.compute.manager [None req-51a58316-e4f1-43c7-b9c9-8d4f06a22c37 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Get console output
Nov 02 17:35:35 user nova-compute[74980]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 02 17:35:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:35:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:43 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Port f5e8978e-28b1-419e-a745-0a784521ee3d binding to destination host user is already ACTIVE {{(pid=74980) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 02 17:35:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:35:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquired lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:35:43 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:35:43 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating instance_info_cache with network_info: [{"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:35:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Releasing lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:35:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Creating tmpfile /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/tmpg94zuf6h to verify with other compute node that the instance is on the same shared storage. {{(pid=74980) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 02 17:35:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-34320a60-4cc6-44b7-92ec-f1781780cea2 req-44cca5ed-f408-4155-9442-7f1fcedc3de9 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-vif-unplugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-34320a60-4cc6-44b7-92ec-f1781780cea2 req-44cca5ed-f408-4155-9442-7f1fcedc3de9 service nova] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-34320a60-4cc6-44b7-92ec-f1781780cea2 req-44cca5ed-f408-4155-9442-7f1fcedc3de9 service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-34320a60-4cc6-44b7-92ec-f1781780cea2 req-44cca5ed-f408-4155-9442-7f1fcedc3de9 service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-34320a60-4cc6-44b7-92ec-f1781780cea2 req-44cca5ed-f408-4155-9442-7f1fcedc3de9 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] No waiting events found dispatching network-vif-unplugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:35:44 user nova-compute[74980]: WARNING nova.compute.manager [req-34320a60-4cc6-44b7-92ec-f1781780cea2 req-44cca5ed-f408-4155-9442-7f1fcedc3de9 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received unexpected event network-vif-unplugged-f5e8978e-28b1-419e-a745-0a784521ee3d for instance with vm_state resized and task_state resize_reverting.
Nov 02 17:35:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:44 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Instance destroyed successfully.
Nov 02 17:35:44 user nova-compute[74980]: DEBUG nova.objects.instance [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lazy-loading 'resources' on Instance uuid 6319a96b-1499-4d79-8ffe-df25fab1c6d8 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1460645799',display_name='tempest-ServerActionsTestOtherB-server-1460645799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1460645799',id=23,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDC1zazFsVcK8cRSvh0A9JDxfLAmb3MmWE+O0wv7/MERQOOzJbF5AG6ze84hXy646Ak4C6ld6XkTeszBqKFoffMRNgW/kfbra+jqQgZdpkDkqH9hu6Bzizhbp6Bezooetw==',key_name='tempest-keypair-1765002056',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:34:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca163fc9523f4f83bd2efba0ec7e468d',ramdisk_id='',reservation_id='r-1djtdfew',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-879907014',owner_user_name='tempest-ServerActionsTestOtherB-879907014-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:34:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f7818185f98430399f7f2fe9465217c',uuid=6319a96b-1499-4d79-8ffe-df25fab1c6d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converting VIF {"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_vif [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5e8978e-28, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e68664f1-b423-4ec4-a96f-aa6330c8a224) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:35:44 user nova-compute[74980]: INFO os_vif [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28')
Nov 02 17:35:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPsmWyMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:35:44 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c791f93-5938-4402-9bc5-b7f4aea0658d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:35:44 user nova-compute[74980]: No targets found.
Nov 02 17:35:44 user nova-compute[74980]: iSNS:
Nov 02 17:35:44 user nova-compute[74980]: No targets found.
Nov 02 17:35:44 user nova-compute[74980]: STATIC:
Nov 02 17:35:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb
Nov 02 17:35:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:35:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:35:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b
Nov 02 17:35:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:35:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:35:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a
Nov 02 17:35:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:35:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:35:44 user nova-compute[74980]: FIRMWARE:
Nov 02 17:35:44 user nova-compute[74980]: No targets found.
Nov 02 17:35:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:35:44 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:35:44 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bba8fa8-42c3-446b-8d72-b8e718092314]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ceedd3-3ef6-4c7d-9c52-72fa4715cfdd]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:35:44 user nova-compute[74980]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:35:44 user nova-compute[74980]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:35:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:35:44 user nova-compute[74980]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:35:44 user nova-compute[74980]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:35:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59947ac5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b'): ({'sdd'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Removing single pathed devices sdd {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f560003e-6491-43b7-b5a6-4f59191aa2d4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b312bda4-4a58-47d4-bdd0-a1f2780e7f77]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Flushing IO for device /dev/sdd {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8512811a-c613-47ec-bd9b-4eadf453cf99]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a337746-86d3-40e1-9423-543c36c9d014]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] SCSI volumes sdd have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca1a2fc-a9c6-4c0a-9d59-5986954d6960]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[031e21cb-549b-49c6-804e-27ade72cb668]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260]
Nov 02 17:35:44 user nova-compute[74980]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260] successful.
Nov 02 17:35:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[27105802-63c9-41f6-82c0-e45f6c52a9a8]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] <== disconnect_volume: return (283ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:35:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:35:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:35:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:35:45 user nova-compute[74980]: DEBUG nova.objects.instance [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lazy-loading 'migration_context' on Instance uuid 6319a96b-1499-4d79-8ffe-df25fab1c6d8 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:35:45 user nova-compute[74980]: DEBUG nova.objects.base [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Object Instance<6319a96b-1499-4d79-8ffe-df25fab1c6d8> lazy-loaded attributes: resources,migration_context {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:35:46 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:35:46 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:35:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-e7b34a02-8416-4d37-8082-3dc324ff3fad req-15bcfe62-599d-4e9e-9f8d-5d02b64b62e7 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:35:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e7b34a02-8416-4d37-8082-3dc324ff3fad req-15bcfe62-599d-4e9e-9f8d-5d02b64b62e7 service nova] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:35:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e7b34a02-8416-4d37-8082-3dc324ff3fad req-15bcfe62-599d-4e9e-9f8d-5d02b64b62e7 service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:35:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e7b34a02-8416-4d37-8082-3dc324ff3fad req-15bcfe62-599d-4e9e-9f8d-5d02b64b62e7 service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:35:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-e7b34a02-8416-4d37-8082-3dc324ff3fad req-15bcfe62-599d-4e9e-9f8d-5d02b64b62e7 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] No waiting events found dispatching network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:35:46 user nova-compute[74980]: WARNING nova.compute.manager [req-e7b34a02-8416-4d37-8082-3dc324ff3fad req-15bcfe62-599d-4e9e-9f8d-5d02b64b62e7 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received unexpected event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d for instance with vm_state resized and task_state resize_reverting.
Nov 02 17:35:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.388s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:35:46 user nova-compute[74980]: INFO nova.compute.manager [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Swapping old allocation on dict_keys(['8bc01c9c-03f1-416d-b5bd-b94d64739bca']) held by migration 3156bc7a-4774-4d40-b647-a6b23d1fa94b for instance
Nov 02 17:35:46 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Overwriting current allocation {'allocations': {'8bc01c9c-03f1-416d-b5bd-b94d64739bca': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 38}}, 'project_id': 'ca163fc9523f4f83bd2efba0ec7e468d', 'user_id': '8f7818185f98430399f7f2fe9465217c', 'consumer_generation': 1} on consumer 6319a96b-1499-4d79-8ffe-df25fab1c6d8 {{(pid=74980) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 02 17:35:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:35:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquired lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:35:46 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating instance_info_cache with network_info: [{"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Releasing lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG os_brick.utils [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca76b50d-429a-41a3-b70b-24fda2e59fbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e246fc6-1b09-48fe-9e5a-85d33f68e7c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f635109-5d52-42f9-a80e-bb18ce2703c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[edefa51d-c34b-4c23-be65-453c8a0b1890]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:35:47 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:35:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a39427-4a2f-4bbe-aa86-eb1185e007d1]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:35:47 user nova-compute[74980]: DEBUG os_brick.utils [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:35:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-5f453a1d-fdc6-44eb-a4f4-9c674ce514db req-882d9925-e0de-4d6c-a252-af06e921e170 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received event network-changed-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:35:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-5f453a1d-fdc6-44eb-a4f4-9c674ce514db req-882d9925-e0de-4d6c-a252-af06e921e170 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Refreshing instance network info cache due to event network-changed-28b668aa-b083-474c-bc08-9bd96a7ea7ff. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:35:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5f453a1d-fdc6-44eb-a4f4-9c674ce514db req-882d9925-e0de-4d6c-a252-af06e921e170 service nova] Acquiring lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:35:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5f453a1d-fdc6-44eb-a4f4-9c674ce514db req-882d9925-e0de-4d6c-a252-af06e921e170 service nova] Acquired lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:35:49 user nova-compute[74980]: DEBUG nova.network.neutron [req-5f453a1d-fdc6-44eb-a4f4-9c674ce514db req-882d9925-e0de-4d6c-a252-af06e921e170 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Refreshing network info cache for port 28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:35:50 user nova-compute[74980]: DEBUG nova.network.neutron [req-5f453a1d-fdc6-44eb-a4f4-9c674ce514db req-882d9925-e0de-4d6c-a252-af06e921e170 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updated VIF entry in instance network info cache for port 28b668aa-b083-474c-bc08-9bd96a7ea7ff. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:35:50 user nova-compute[74980]: DEBUG nova.network.neutron [req-5f453a1d-fdc6-44eb-a4f4-9c674ce514db req-882d9925-e0de-4d6c-a252-af06e921e170 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updating instance_info_cache with network_info: [{"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:35:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5f453a1d-fdc6-44eb-a4f4-9c674ce514db req-882d9925-e0de-4d6c-a252-af06e921e170 service nova] Releasing lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:35:50 user nova-compute[74980]: DEBUG nova.compute.manager [req-1b6afb26-78e4-47c9-a624-97314dd68d3e req-253dd2b9-588f-4859-ab90-1bd10c554842 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received event network-changed-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:35:50 user nova-compute[74980]: DEBUG nova.compute.manager [req-1b6afb26-78e4-47c9-a624-97314dd68d3e req-253dd2b9-588f-4859-ab90-1bd10c554842 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Refreshing instance network info cache due to event network-changed-28b668aa-b083-474c-bc08-9bd96a7ea7ff. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:35:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1b6afb26-78e4-47c9-a624-97314dd68d3e req-253dd2b9-588f-4859-ab90-1bd10c554842 service nova] Acquiring lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:35:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1b6afb26-78e4-47c9-a624-97314dd68d3e req-253dd2b9-588f-4859-ab90-1bd10c554842 service nova] Acquired lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:35:50 user nova-compute[74980]: DEBUG nova.network.neutron [req-1b6afb26-78e4-47c9-a624-97314dd68d3e req-253dd2b9-588f-4859-ab90-1bd10c554842 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Refreshing network info cache for port 28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:35:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:35:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:35:51 user nova-compute[74980]: INFO nova.compute.manager [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Detaching volume c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a
Nov 02 17:35:51 user nova-compute[74980]: INFO nova.virt.block_device [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Attempting to driver detach volume c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a from mountpoint /dev/vdb
Nov 02 17:35:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Attempting to detach device vdb from instance dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:35:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:35:51 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:35:51 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:35:51 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:35:51 user nova-compute[74980]:   <serial>c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a</serial>
Nov 02 17:35:51 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 17:35:51 user nova-compute[74980]: </disk>
Nov 02 17:35:51 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:35:51 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Successfully detached device vdb from instance dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 from the persistent domain config.
Nov 02 17:35:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:35:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:35:51 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:35:51 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:35:51 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:35:51 user nova-compute[74980]:   <serial>c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a</serial>
Nov 02 17:35:51 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 17:35:51 user nova-compute[74980]: </disk>
Nov 02 17:35:51 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:35:51 user nova-compute[74980]: DEBUG nova.network.neutron [req-1b6afb26-78e4-47c9-a624-97314dd68d3e req-253dd2b9-588f-4859-ab90-1bd10c554842 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updated VIF entry in instance network info cache for port 28b668aa-b083-474c-bc08-9bd96a7ea7ff. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:35:51 user nova-compute[74980]: DEBUG nova.network.neutron [req-1b6afb26-78e4-47c9-a624-97314dd68d3e req-253dd2b9-588f-4859-ab90-1bd10c554842 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updating instance_info_cache with network_info: [{"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:35:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1b6afb26-78e4-47c9-a624-97314dd68d3e req-253dd2b9-588f-4859-ab90-1bd10c554842 service nova] Releasing lock "refresh_cache-dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:35:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:35:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "e7023293-bd74-4855-a446-ba835f216068" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:35:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "e7023293-bd74-4855-a446-ba835f216068" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:35:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "e7023293-bd74-4855-a446-ba835f216068-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:35:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "e7023293-bd74-4855-a446-ba835f216068-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:35:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "e7023293-bd74-4855-a446-ba835f216068-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:35:58 user nova-compute[74980]: INFO nova.compute.manager [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Terminating instance
Nov 02 17:35:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:35:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-0e960c98-4f0d-43c8-9007-36c6be9bc6b9 req-6e85829c-e462-49e5-b221-77cf21ee7ace service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] Received event network-vif-unplugged-391db393-ad7d-448a-b660-9de2dc6bd8c8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0e960c98-4f0d-43c8-9007-36c6be9bc6b9 req-6e85829c-e462-49e5-b221-77cf21ee7ace service nova] Acquiring lock "e7023293-bd74-4855-a446-ba835f216068-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0e960c98-4f0d-43c8-9007-36c6be9bc6b9 req-6e85829c-e462-49e5-b221-77cf21ee7ace service nova] Lock "e7023293-bd74-4855-a446-ba835f216068-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0e960c98-4f0d-43c8-9007-36c6be9bc6b9 req-6e85829c-e462-49e5-b221-77cf21ee7ace service nova] Lock "e7023293-bd74-4855-a446-ba835f216068-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-0e960c98-4f0d-43c8-9007-36c6be9bc6b9 req-6e85829c-e462-49e5-b221-77cf21ee7ace service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] No waiting events found dispatching network-vif-unplugged-391db393-ad7d-448a-b660-9de2dc6bd8c8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-0e960c98-4f0d-43c8-9007-36c6be9bc6b9 req-6e85829c-e462-49e5-b221-77cf21ee7ace service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] Received event network-vif-unplugged-391db393-ad7d-448a-b660-9de2dc6bd8c8 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:59 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e7023293-bd74-4855-a446-ba835f216068] Instance destroyed successfully.
Nov 02 17:35:59 user nova-compute[74980]: DEBUG nova.objects.instance [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lazy-loading 'resources' on Instance uuid e7023293-bd74-4855-a446-ba835f216068 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:34:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2103628552',display_name='tempest-VolumesActionsTest-instance-2103628552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2103628552',id=29,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c992cd1419d42e9aeeb103900e8b136',ramdisk_id='',reservation_id='r-awfuekl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-782476121',owner_user_name='tempest-VolumesActionsTest-782476121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:34:17Z,user_data=None,user_id='5675b52cc3114389b0195f6a300c3620',uuid=e7023293-bd74-4855-a446-ba835f216068,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "address": "fa:16:3e:d7:b9:06", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391db393-ad", "ovs_interfaceid": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Converting VIF {"id": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "address": "fa:16:3e:d7:b9:06", "network": {"id": "d15bb169-1025-4bd1-8bc8-5df04514f280", "bridge": "br-int", "label": "tempest-VolumesActionsTest-598114508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c992cd1419d42e9aeeb103900e8b136", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391db393-ad", "ovs_interfaceid": "391db393-ad7d-448a-b660-9de2dc6bd8c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=391db393-ad7d-448a-b660-9de2dc6bd8c8,network=Network(d15bb169-1025-4bd1-8bc8-5df04514f280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391db393-ad') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG os_vif [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=391db393-ad7d-448a-b660-9de2dc6bd8c8,network=Network(d15bb169-1025-4bd1-8bc8-5df04514f280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391db393-ad') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap391db393-ad, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=170fb203-1383-4b99-a74f-6307eea499de) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:35:59 user nova-compute[74980]: INFO os_vif [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=391db393-ad7d-448a-b660-9de2dc6bd8c8,network=Network(d15bb169-1025-4bd1-8bc8-5df04514f280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391db393-ad')
Nov 02 17:35:59 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Deleting instance files /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068_del
Nov 02 17:35:59 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Deletion of /opt/stack/data/nova/instances/e7023293-bd74-4855-a446-ba835f216068_del complete
Nov 02 17:35:59 user nova-compute[74980]: INFO nova.compute.manager [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] [instance: e7023293-bd74-4855-a446-ba835f216068] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 02 17:35:59 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: e7023293-bd74-4855-a446-ba835f216068] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:35:59 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: e7023293-bd74-4855-a446-ba835f216068] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:36:00 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: e7023293-bd74-4855-a446-ba835f216068] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:36:00 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: e7023293-bd74-4855-a446-ba835f216068] Took 0.47 seconds to deallocate network for instance.
Nov 02 17:36:00 user nova-compute[74980]: DEBUG nova.compute.manager [req-1b3544c0-cf70-40b1-b82f-43ce01bb6d97 req-b0046896-0651-4438-bb20-43c24f30b1b7 service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] Received event network-vif-deleted-391db393-ad7d-448a-b660-9de2dc6bd8c8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:36:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:00 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:36:00 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:36:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:00 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Deleted allocations for instance e7023293-bd74-4855-a446-ba835f216068
Nov 02 17:36:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e59cb6e9-ee36-429a-ab67-c7316a5f6a28 tempest-VolumesActionsTest-782476121 tempest-VolumesActionsTest-782476121-project-member] Lock "e7023293-bd74-4855-a446-ba835f216068" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.891s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:01 user nova-compute[74980]: DEBUG nova.compute.manager [req-79971c65-8414-49b2-b12c-47027c9ed234 req-0e634f8c-76cf-4fb7-a609-c5a794470115 service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] Received event network-vif-plugged-391db393-ad7d-448a-b660-9de2dc6bd8c8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:36:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-79971c65-8414-49b2-b12c-47027c9ed234 req-0e634f8c-76cf-4fb7-a609-c5a794470115 service nova] Acquiring lock "e7023293-bd74-4855-a446-ba835f216068-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-79971c65-8414-49b2-b12c-47027c9ed234 req-0e634f8c-76cf-4fb7-a609-c5a794470115 service nova] Lock "e7023293-bd74-4855-a446-ba835f216068-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-79971c65-8414-49b2-b12c-47027c9ed234 req-0e634f8c-76cf-4fb7-a609-c5a794470115 service nova] Lock "e7023293-bd74-4855-a446-ba835f216068-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:01 user nova-compute[74980]: DEBUG nova.compute.manager [req-79971c65-8414-49b2-b12c-47027c9ed234 req-0e634f8c-76cf-4fb7-a609-c5a794470115 service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] No waiting events found dispatching network-vif-plugged-391db393-ad7d-448a-b660-9de2dc6bd8c8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:36:01 user nova-compute[74980]: WARNING nova.compute.manager [req-79971c65-8414-49b2-b12c-47027c9ed234 req-0e634f8c-76cf-4fb7-a609-c5a794470115 service nova] [instance: e7023293-bd74-4855-a446-ba835f216068] Received unexpected event network-vif-plugged-391db393-ad7d-448a-b660-9de2dc6bd8c8 for instance with vm_state deleted and task_state None.
Nov 02 17:36:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Starting finish_revert_migration {{(pid=74980) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Start _get_guest_xml network_info=[{"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPsmWyMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6319a96b-1499-4d79-8ffe-df25fab1c6d8', 'attached_at': '2023-11-02T17:36:07.000000', 'detached_at': '', 'volume_id': '97d1af33-b87a-43ce-887c-348021c25d1b', 'serial': '97d1af33-b87a-43ce-887c-348021c25d1b'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'ad2e6fd3-11ff-4d2e-8cb6-f386e8806c4f', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:36:06 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:36:06 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.objects.instance [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6319a96b-1499-4d79-8ffe-df25fab1c6d8 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPsmWyMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:36:06 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:36:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:36:06 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:36:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:36:06 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:36:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b958a67e-2237-4060-a988-da618f648605]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:36:06 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:36:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31ef213-116a-4e7e-83cd-2c8a546efd7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b] added
Nov 02 17:36:07 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f2f1f9-8598-463a-9fbf-ad4c872649a2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a405642-6f47-4517-8a2a-f154d8dfae62]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPsmWyMY {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPsmWyMY" returned: 0 in 0.032s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0607470-4860-4ae0-8691-0ff4cac424f4]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cPsmWyMY'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d378770a-369f-4cd5-960a-e3a958d59f1b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d7f7f2-15ec-4315-a3c8-164885f2e184]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:36:07 user nova-compute[74980]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:36:07 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:36:07 user nova-compute[74980]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:36:07 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[50257999-120d-40ad-b875-4159dcc58079]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260]
Nov 02 17:36:07 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260] successful.
Nov 02 17:36:07 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc599ccb-92e3-497a-9241-f806972003ff]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[801b8fe8-b8fa-4635-8399-930e58689f07]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:36:07 user nova-compute[74980]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:36:07 user nova-compute[74980]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:36:07 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:36:07 user nova-compute[74980]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:36:07 user nova-compute[74980]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:36:07 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2175a99b-9adc-431f-b082-25cd6fa27955]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:07 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPsmWyMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26430376437313038', 'path': '/dev/sdd'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430376437313038', 'path': '/dev/sdd'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1460645799',display_name='tempest-ServerActionsTestOtherB-server-1460645799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1460645799',id=23,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDC1zazFsVcK8cRSvh0A9JDxfLAmb3MmWE+O0wv7/MERQOOzJbF5AG6ze84hXy646Ak4C6ld6XkTeszBqKFoffMRNgW/kfbra+jqQgZdpkDkqH9hu6Bzizhbp6Bezooetw==',key_name='tempest-keypair-1765002056',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:34:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ca163fc9523f4f83bd2efba0ec7e468d',ramdisk_id='',reservation_id='r-1djtdfew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-879907014',owner_user_name='tempest-ServerActionsTestOtherB-879907014-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:35:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f7818185f98430399f7f2fe9465217c',uuid=6319a96b-1499-4d79-8ffe-df25fab1c6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converting VIF {"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:36:08 user nova-compute[74980]:   <uuid>6319a96b-1499-4d79-8ffe-df25fab1c6d8</uuid>
Nov 02 17:36:08 user nova-compute[74980]:   <name>instance-00000017</name>
Nov 02 17:36:08 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:36:08 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:36:08 user nova-compute[74980]:   <metadata>
Nov 02 17:36:08 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:36:08 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:36:08 user nova-compute[74980]:       <nova:name>tempest-ServerActionsTestOtherB-server-1460645799</nova:name>
Nov 02 17:36:08 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:36:06</nova:creationTime>
Nov 02 17:36:08 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:36:08 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:36:08 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:36:08 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:36:08 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:36:08 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:36:08 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:36:08 user nova-compute[74980]:       <nova:owner>
Nov 02 17:36:08 user nova-compute[74980]:         <nova:user uuid="8f7818185f98430399f7f2fe9465217c">tempest-ServerActionsTestOtherB-879907014-project-member</nova:user>
Nov 02 17:36:08 user nova-compute[74980]:         <nova:project uuid="ca163fc9523f4f83bd2efba0ec7e468d">tempest-ServerActionsTestOtherB-879907014</nova:project>
Nov 02 17:36:08 user nova-compute[74980]:       </nova:owner>
Nov 02 17:36:08 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:36:08 user nova-compute[74980]:       <nova:ports>
Nov 02 17:36:08 user nova-compute[74980]:         <nova:port uuid="f5e8978e-28b1-419e-a745-0a784521ee3d">
Nov 02 17:36:08 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 17:36:08 user nova-compute[74980]:         </nova:port>
Nov 02 17:36:08 user nova-compute[74980]:       </nova:ports>
Nov 02 17:36:08 user nova-compute[74980]:     </nova:instance>
Nov 02 17:36:08 user nova-compute[74980]:   </metadata>
Nov 02 17:36:08 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:36:08 user nova-compute[74980]:     <system>
Nov 02 17:36:08 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:36:08 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:36:08 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:36:08 user nova-compute[74980]:       <entry name="serial">6319a96b-1499-4d79-8ffe-df25fab1c6d8</entry>
Nov 02 17:36:08 user nova-compute[74980]:       <entry name="uuid">6319a96b-1499-4d79-8ffe-df25fab1c6d8</entry>
Nov 02 17:36:08 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:36:08 user nova-compute[74980]:     </system>
Nov 02 17:36:08 user nova-compute[74980]:   </sysinfo>
Nov 02 17:36:08 user nova-compute[74980]:   <os>
Nov 02 17:36:08 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:36:08 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:36:08 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:36:08 user nova-compute[74980]:   </os>
Nov 02 17:36:08 user nova-compute[74980]:   <features>
Nov 02 17:36:08 user nova-compute[74980]:     <acpi/>
Nov 02 17:36:08 user nova-compute[74980]:     <apic/>
Nov 02 17:36:08 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:36:08 user nova-compute[74980]:   </features>
Nov 02 17:36:08 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:36:08 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:36:08 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:36:08 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:36:08 user nova-compute[74980]:   </clock>
Nov 02 17:36:08 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:36:08 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:36:08 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:36:08 user nova-compute[74980]:   </cpu>
Nov 02 17:36:08 user nova-compute[74980]:   <devices>
Nov 02 17:36:08 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:36:08 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:36:08 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk"/>
Nov 02 17:36:08 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:36:08 user nova-compute[74980]:     </disk>
Nov 02 17:36:08 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:36:08 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:36:08 user nova-compute[74980]:       <source dev="/dev/sdd"/>
Nov 02 17:36:08 user nova-compute[74980]:       <target dev="vdb" bus="virtio"/>
Nov 02 17:36:08 user nova-compute[74980]:       <serial>97d1af33-b87a-43ce-887c-348021c25d1b</serial>
Nov 02 17:36:08 user nova-compute[74980]:     </disk>
Nov 02 17:36:08 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:36:08 user nova-compute[74980]:       <mac address="fa:16:3e:1e:4f:61"/>
Nov 02 17:36:08 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:36:08 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:36:08 user nova-compute[74980]:       <target dev="tapf5e8978e-28"/>
Nov 02 17:36:08 user nova-compute[74980]:     </interface>
Nov 02 17:36:08 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:36:08 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/console.log" append="off"/>
Nov 02 17:36:08 user nova-compute[74980]:     </serial>
Nov 02 17:36:08 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:36:08 user nova-compute[74980]:     <video>
Nov 02 17:36:08 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:36:08 user nova-compute[74980]:     </video>
Nov 02 17:36:08 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:36:08 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:36:08 user nova-compute[74980]:     </rng>
Nov 02 17:36:08 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:36:08 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:36:08 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:36:08 user nova-compute[74980]:     </memballoon>
Nov 02 17:36:08 user nova-compute[74980]:   </devices>
Nov 02 17:36:08 user nova-compute[74980]: </domain>
Nov 02 17:36:08 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1460645799',display_name='tempest-ServerActionsTestOtherB-server-1460645799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1460645799',id=23,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDC1zazFsVcK8cRSvh0A9JDxfLAmb3MmWE+O0wv7/MERQOOzJbF5AG6ze84hXy646Ak4C6ld6XkTeszBqKFoffMRNgW/kfbra+jqQgZdpkDkqH9hu6Bzizhbp6Bezooetw==',key_name='tempest-keypair-1765002056',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:34:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ca163fc9523f4f83bd2efba0ec7e468d',ramdisk_id='',reservation_id='r-1djtdfew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-879907014',owner_user_name='tempest-ServerActionsTestOtherB-879907014-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:35:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f7818185f98430399f7f2fe9465217c',uuid=6319a96b-1499-4d79-8ffe-df25fab1c6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converting VIF {"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG os_vif [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '436a0bc9-b2bc-5fdd-a52b-5f200b506cee', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5e8978e-28, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5e8978e-28, col_values=(('qos', UUID('f37fc00f-d148-47ed-8425-c9940dd0dcc3')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5e8978e-28, col_values=(('external_ids', {'iface-id': 'f5e8978e-28b1-419e-a745-0a784521ee3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:4f:61', 'vm-uuid': '6319a96b-1499-4d79-8ffe-df25fab1c6d8'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:36:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:08 user nova-compute[74980]: INFO os_vif [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28')
Nov 02 17:36:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-92d5236d-c203-4219-998d-8a3c2cdc6396 req-ed8b2450-7186-4990-ad7c-30f2f9db3dfd service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:36:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-92d5236d-c203-4219-998d-8a3c2cdc6396 req-ed8b2450-7186-4990-ad7c-30f2f9db3dfd service nova] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-92d5236d-c203-4219-998d-8a3c2cdc6396 req-ed8b2450-7186-4990-ad7c-30f2f9db3dfd service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-92d5236d-c203-4219-998d-8a3c2cdc6396 req-ed8b2450-7186-4990-ad7c-30f2f9db3dfd service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-92d5236d-c203-4219-998d-8a3c2cdc6396 req-ed8b2450-7186-4990-ad7c-30f2f9db3dfd service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] No waiting events found dispatching network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:36:09 user nova-compute[74980]: WARNING nova.compute.manager [req-92d5236d-c203-4219-998d-8a3c2cdc6396 req-ed8b2450-7186-4990-ad7c-30f2f9db3dfd service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received unexpected event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d for instance with vm_state resized and task_state resize_reverting.
Nov 02 17:36:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:36:11 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Instance running successfully.
Nov 02 17:36:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] finish_revert_migration finished successfully. {{(pid=74980) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 02 17:36:11 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 is timed out.
Nov 02 17:36:11 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Successfully detached device vdb from instance dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 from the live domain config.
Nov 02 17:36:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixUAJFDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:36:11 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:36:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd63bab-6fe2-42a0-9680-2661e25d9c6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:36:11 user nova-compute[74980]: No targets found.
Nov 02 17:36:11 user nova-compute[74980]: iSNS:
Nov 02 17:36:11 user nova-compute[74980]: No targets found.
Nov 02 17:36:11 user nova-compute[74980]: STATIC:
Nov 02 17:36:11 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb
Nov 02 17:36:11 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:36:11 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:36:11 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b
Nov 02 17:36:11 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:36:11 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:36:11 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a
Nov 02 17:36:11 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:36:11 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:36:11 user nova-compute[74980]: FIRMWARE:
Nov 02 17:36:11 user nova-compute[74980]: No targets found.
Nov 02 17:36:11 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:36:11 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:36:11 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a66afc8-608b-4d17-829c-bcf8c27fdd70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3b973e-0af5-4f3d-b238-295929c5afd6]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:36:11 user nova-compute[74980]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:36:11 user nova-compute[74980]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:36:11 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:36:11 user nova-compute[74980]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a (non-flash)
Nov 02 17:36:11 user nova-compute[74980]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:36:11 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b447af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a'): ({'sdc'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Removing single pathed devices sdc {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-d2dcc180-7035-449e-a35e-43d9c25d4fc3 req-e4f68a58-3c0e-4d47-911e-f7116c37ca33 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d2dcc180-7035-449e-a35e-43d9c25d4fc3 req-e4f68a58-3c0e-4d47-911e-f7116c37ca33 service nova] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d2dcc180-7035-449e-a35e-43d9c25d4fc3 req-e4f68a58-3c0e-4d47-911e-f7116c37ca33 service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d2dcc180-7035-449e-a35e-43d9c25d4fc3 req-e4f68a58-3c0e-4d47-911e-f7116c37ca33 service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-d2dcc180-7035-449e-a35e-43d9c25d4fc3 req-e4f68a58-3c0e-4d47-911e-f7116c37ca33 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] No waiting events found dispatching network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:36:11 user nova-compute[74980]: WARNING nova.compute.manager [req-d2dcc180-7035-449e-a35e-43d9c25d4fc3 req-e4f68a58-3c0e-4d47-911e-f7116c37ca33 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received unexpected event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d for instance with vm_state resized and task_state resize_reverting.
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e218a4-afd3-45f3-8ece-7e7112be00a3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b7b47d-4539-4c9f-b66e-991ac9f4f700]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Flushing IO for device /dev/sdc {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:11 user nova-compute[74980]: INFO nova.compute.manager [None req-ef9470fe-ad91-4912-94d2-c679097a7100 tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating instance to original state: 'active'
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f757c0c-8203-4384-b654-87ab80307699]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:36:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2169dbfb-4bdc-4f32-a22f-64afb3eb254d]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[229d7997-37fd-452e-b403-d349d099286e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdba457-07ed-43ea-8916-7ed9dd1270d5]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260]
Nov 02 17:36:12 user nova-compute[74980]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a, portal: 172.16.0.220,3260] successful.
Nov 02 17:36:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c183f9e5-5e4c-4cb4-9acd-6e2fdf13878a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb359bc-de17-42c1-801b-19bc6f610102]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] <== disconnect_volume: return (298ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:36:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:36:13 user nova-compute[74980]: DEBUG nova.objects.instance [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lazy-loading 'flavor' on Instance uuid dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:36:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0492a69f-b438-4a39-97f7-e823c03c4ebb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.023s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:13 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:36:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:17 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:36:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:17 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:36:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:36:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:36:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:20 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:36:20 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:36:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8206MB free_disk=25.222457885742188GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:36:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:36:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e9d8737b-e341-4c00-bb8c-6e1847d24418 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 17:36:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:36:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 66da6804-057c-4806-b036-d246768c498d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:36:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:36:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:36:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6319a96b-1499-4d79-8ffe-df25fab1c6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:36:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:36:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:36:20 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:36:20 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:36:20 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:36:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:36:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:36:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:36:22 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:36:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:36:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:36:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:36:22 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:36:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating instance_info_cache with network_info: [{"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:36:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-6319a96b-1499-4d79-8ffe-df25fab1c6d8" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:36:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:36:23 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:36:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:23 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:36:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "66da6804-057c-4806-b036-d246768c498d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "66da6804-057c-4806-b036-d246768c498d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "66da6804-057c-4806-b036-d246768c498d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "66da6804-057c-4806-b036-d246768c498d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "66da6804-057c-4806-b036-d246768c498d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:35 user nova-compute[74980]: INFO nova.compute.manager [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Terminating instance
Nov 02 17:36:35 user nova-compute[74980]: DEBUG nova.compute.manager [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:36:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-30e514b5-4075-41cb-a6ab-90253cc4751f req-62c7c255-5685-4800-864f-e7c605729c76 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received event network-vif-unplugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-30e514b5-4075-41cb-a6ab-90253cc4751f req-62c7c255-5685-4800-864f-e7c605729c76 service nova] Acquiring lock "66da6804-057c-4806-b036-d246768c498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-30e514b5-4075-41cb-a6ab-90253cc4751f req-62c7c255-5685-4800-864f-e7c605729c76 service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-30e514b5-4075-41cb-a6ab-90253cc4751f req-62c7c255-5685-4800-864f-e7c605729c76 service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-30e514b5-4075-41cb-a6ab-90253cc4751f req-62c7c255-5685-4800-864f-e7c605729c76 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] No waiting events found dispatching network-vif-unplugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-30e514b5-4075-41cb-a6ab-90253cc4751f req-62c7c255-5685-4800-864f-e7c605729c76 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received event network-vif-unplugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:36:36 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 66da6804-057c-4806-b036-d246768c498d] Instance destroyed successfully.
Nov 02 17:36:36 user nova-compute[74980]: DEBUG nova.objects.instance [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lazy-loading 'resources' on Instance uuid 66da6804-057c-4806-b036-d246768c498d {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-757507002',display_name='tempest-ServerActionsTestOtherA-server-757507002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-757507002',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLnMhbM0oba6rJcByxBYQLlndi5MHkt5CHpXxfq+RJdLBsoLWmSnT0vVaxYrrZ06wl3cBC9G1WoMy7HQ9vT9DdZBt3/Q/q1q9MknpNsiMnCx1tDgUx7vQwwWmQat63Hng==',key_name='tempest-keypair-1476871667',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:32:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bb10da584734aedb3d08879a4ffc2b2',ramdisk_id='',reservation_id='r-7b5n7s8x',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-50427258',owner_user_name='tempest-ServerActionsTestOtherA-50427258-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:33:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e61d486aa0bf4b1fb4332aabfa5dafd7',uuid=66da6804-057c-4806-b036-d246768c498d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converting VIF {"id": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "address": "fa:16:3e:da:a2:82", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1cd067-6e", "ovs_interfaceid": "8f1cd067-6e00-4d28-9879-a8f775d31fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=8f1cd067-6e00-4d28-9879-a8f775d31fa8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cd067-6e') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_vif [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=8f1cd067-6e00-4d28-9879-a8f775d31fa8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cd067-6e') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f1cd067-6e, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3c57e5b-a763-429f-90b8-49af3269a5c9) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:36 user nova-compute[74980]: INFO os_vif [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:a2:82,bridge_name='br-int',has_traffic_filtering=True,id=8f1cd067-6e00-4d28-9879-a8f775d31fa8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1cd067-6e')
Nov 02 17:36:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdHmzSgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:36:36 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45a3550-d276-4a4d-a37e-498e43f5aa28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:36:36 user nova-compute[74980]: No targets found.
Nov 02 17:36:36 user nova-compute[74980]: iSNS:
Nov 02 17:36:36 user nova-compute[74980]: No targets found.
Nov 02 17:36:36 user nova-compute[74980]: STATIC:
Nov 02 17:36:36 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb
Nov 02 17:36:36 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:36:36 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:36:36 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b
Nov 02 17:36:36 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:36:36 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:36:36 user nova-compute[74980]: FIRMWARE:
Nov 02 17:36:36 user nova-compute[74980]: No targets found.
Nov 02 17:36:36 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:36:36 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:36:36 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ad57d3-c96c-442f-8313-401d29922e6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0203d5a9-0d1b-4e03-b3be-7eb6ba95d2d9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:36:36 user nova-compute[74980]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:36:36 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb (non-flash)
Nov 02 17:36:36 user nova-compute[74980]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:36:36 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b4127910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5478aa-a32c-44c9-a2d6-3f9bb56cd794]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62d3393-b362-4230-8fa1-fbcdb60cad69]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[89970726-a7aa-4e25-8da8-e058fd363971]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b244815e-2ef0-4b9e-bc1e-683358c87815]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b91a86cd', '/dev/disk/by-id/scsi-1SCST_BIOb91a86cd-c3dea713313a7d28') {{(pid=86001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 17:36:36 user nova-compute[74980]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_b91a86cd
Nov 02 17:36:36 user nova-compute[74980]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOb91a86cd-c3dea713313a7d28
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6076dfa0-c0f4-4dd2-8b8d-21f1f13458e1]: (4, None) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c8cfe6-231e-40b5-a2e0-176eabc01cf4]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:36:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:37 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c447d1d-dffe-4d40-aa3c-507a44bbea94]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260]
Nov 02 17:36:37 user nova-compute[74980]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb, portal: 172.16.0.220,3260] successful.
Nov 02 17:36:37 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:36:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:36:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b9a62f-0fd4-479d-88d9-5b39a58635fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:36:37 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[532140f0-b8de-4736-8a86-e9f57f0ee646]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:36:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:36:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:36:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] <== disconnect_volume: return (312ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:36:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:36:37 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Deleting instance files /opt/stack/data/nova/instances/66da6804-057c-4806-b036-d246768c498d_del
Nov 02 17:36:37 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Deletion of /opt/stack/data/nova/instances/66da6804-057c-4806-b036-d246768c498d_del complete
Nov 02 17:36:37 user nova-compute[74980]: INFO nova.compute.manager [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 02 17:36:37 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:36:37 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 66da6804-057c-4806-b036-d246768c498d] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:36:37 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 66da6804-057c-4806-b036-d246768c498d] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:36:37 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 66da6804-057c-4806-b036-d246768c498d] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:36:37 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 66da6804-057c-4806-b036-d246768c498d] Took 0.72 seconds to deallocate network for instance.
Nov 02 17:36:37 user nova-compute[74980]: DEBUG nova.compute.manager [req-75f92586-3dc3-4aaa-8aed-6340f986a1e2 req-f4bcf744-64e0-4775-9f68-6e955990fd25 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received event network-vif-deleted-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:36:37 user nova-compute[74980]: INFO nova.compute.manager [req-75f92586-3dc3-4aaa-8aed-6340f986a1e2 req-f4bcf744-64e0-4775-9f68-6e955990fd25 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Neutron deleted interface 8f1cd067-6e00-4d28-9879-a8f775d31fa8; detaching it from the instance and deleting it from the info cache
Nov 02 17:36:37 user nova-compute[74980]: DEBUG nova.network.neutron [req-75f92586-3dc3-4aaa-8aed-6340f986a1e2 req-f4bcf744-64e0-4775-9f68-6e955990fd25 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:36:37 user nova-compute[74980]: DEBUG nova.compute.manager [req-75f92586-3dc3-4aaa-8aed-6340f986a1e2 req-f4bcf744-64e0-4775-9f68-6e955990fd25 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Detach interface failed, port_id=8f1cd067-6e00-4d28-9879-a8f775d31fa8, reason: Instance 66da6804-057c-4806-b036-d246768c498d could not be found. {{(pid=74980) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 17:36:38 user nova-compute[74980]: DEBUG nova.compute.manager [req-34f06377-8697-402d-9623-f9818bd47208 req-d3dc3f39-4fa2-426b-b535-4446ea1cee59 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received event network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:36:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-34f06377-8697-402d-9623-f9818bd47208 req-d3dc3f39-4fa2-426b-b535-4446ea1cee59 service nova] Acquiring lock "66da6804-057c-4806-b036-d246768c498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-34f06377-8697-402d-9623-f9818bd47208 req-d3dc3f39-4fa2-426b-b535-4446ea1cee59 service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-34f06377-8697-402d-9623-f9818bd47208 req-d3dc3f39-4fa2-426b-b535-4446ea1cee59 service nova] Lock "66da6804-057c-4806-b036-d246768c498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:38 user nova-compute[74980]: DEBUG nova.compute.manager [req-34f06377-8697-402d-9623-f9818bd47208 req-d3dc3f39-4fa2-426b-b535-4446ea1cee59 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] No waiting events found dispatching network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:36:38 user nova-compute[74980]: WARNING nova.compute.manager [req-34f06377-8697-402d-9623-f9818bd47208 req-d3dc3f39-4fa2-426b-b535-4446ea1cee59 service nova] [instance: 66da6804-057c-4806-b036-d246768c498d] Received unexpected event network-vif-plugged-8f1cd067-6e00-4d28-9879-a8f775d31fa8 for instance with vm_state active and task_state deleting.
Nov 02 17:36:38 user nova-compute[74980]: INFO nova.compute.manager [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Took 0.90 seconds to detach 1 volumes for instance.
Nov 02 17:36:38 user nova-compute[74980]: DEBUG nova.compute.manager [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: 66da6804-057c-4806-b036-d246768c498d] Deleting volume: a3b9a62f-0fd4-479d-88d9-5b39a58635fb {{(pid=74980) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 17:36:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:39 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:36:39 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:36:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:39 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Deleted allocations for instance 66da6804-057c-4806-b036-d246768c498d
Nov 02 17:36:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9a44ada4-9237-4766-a116-a6ea932c6467 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "66da6804-057c-4806-b036-d246768c498d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.292s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:36:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:36:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:36:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:36:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:52 user nova-compute[74980]: INFO nova.compute.manager [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Terminating instance
Nov 02 17:36:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:36:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-ff6d1ac8-5157-4fa5-bfa7-06bd348481c5 req-6268a68e-2a0a-4327-b136-eea85627d456 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received event network-vif-unplugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:36:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ff6d1ac8-5157-4fa5-bfa7-06bd348481c5 req-6268a68e-2a0a-4327-b136-eea85627d456 service nova] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ff6d1ac8-5157-4fa5-bfa7-06bd348481c5 req-6268a68e-2a0a-4327-b136-eea85627d456 service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ff6d1ac8-5157-4fa5-bfa7-06bd348481c5 req-6268a68e-2a0a-4327-b136-eea85627d456 service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-ff6d1ac8-5157-4fa5-bfa7-06bd348481c5 req-6268a68e-2a0a-4327-b136-eea85627d456 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] No waiting events found dispatching network-vif-unplugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:36:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-ff6d1ac8-5157-4fa5-bfa7-06bd348481c5 req-6268a68e-2a0a-4327-b136-eea85627d456 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received event network-vif-unplugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:53 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Instance destroyed successfully.
Nov 02 17:36:53 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lazy-loading 'resources' on Instance uuid dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-710681487',display_name='tempest-TestMinimumBasicScenario-server-710681487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-710681487',id=25,image_ref='13d514af-9a16-4b69-bb3d-c97adc69a481',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0577uFfOT8cUN6BtfQwlMQpRR/j74a2V6qrBANqwx4s/9epUKXZYsUi41B9mVFJjJCL5YkxgjxKwmbak1uGe6YArtVcvzacA13o+c0rtgXDMSTQ4iyD7+g4drcVrU92Q==',key_name='tempest-TestMinimumBasicScenario-1334816697',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:31:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad1b48d7070548bdae52f005ce12d606',ramdisk_id='',reservation_id='r-df01e7ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13d514af-9a16-4b69-bb3d-c97adc69a481',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-487832598',owner_user_name='tempest-TestMinimumBasicScenario-487832598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:34:06Z,user_data=None,user_id='46cbf858998242a1a5d8b14b0e56cace',uuid=dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converting VIF {"id": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "address": "fa:16:3e:d8:6c:9c", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b668aa-b0", "ovs_interfaceid": "28b668aa-b083-474c-bc08-9bd96a7ea7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:6c:9c,bridge_name='br-int',has_traffic_filtering=True,id=28b668aa-b083-474c-bc08-9bd96a7ea7ff,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b668aa-b0') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG os_vif [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:6c:9c,bridge_name='br-int',has_traffic_filtering=True,id=28b668aa-b083-474c-bc08-9bd96a7ea7ff,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b668aa-b0') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28b668aa-b0, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15c9667e-4806-44f9-91e5-c2cbf217e971) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:53 user nova-compute[74980]: INFO os_vif [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:6c:9c,bridge_name='br-int',has_traffic_filtering=True,id=28b668aa-b083-474c-bc08-9bd96a7ea7ff,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b668aa-b0')
Nov 02 17:36:53 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Deleting instance files /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275_del
Nov 02 17:36:53 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Deletion of /opt/stack/data/nova/instances/dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275_del complete
Nov 02 17:36:53 user nova-compute[74980]: INFO nova.compute.manager [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 02 17:36:53 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:36:53 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:36:54 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:36:54 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Took 1.04 seconds to deallocate network for instance.
Nov 02 17:36:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:54 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:36:54 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:36:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-d4cdfc80-c4bb-45f4-b9a4-c9f502ef63d2 req-bac998a9-e811-4f71-af58-6edae28c7944 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received event network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:36:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d4cdfc80-c4bb-45f4-b9a4-c9f502ef63d2 req-bac998a9-e811-4f71-af58-6edae28c7944 service nova] Acquiring lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d4cdfc80-c4bb-45f4-b9a4-c9f502ef63d2 req-bac998a9-e811-4f71-af58-6edae28c7944 service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d4cdfc80-c4bb-45f4-b9a4-c9f502ef63d2 req-bac998a9-e811-4f71-af58-6edae28c7944 service nova] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-d4cdfc80-c4bb-45f4-b9a4-c9f502ef63d2 req-bac998a9-e811-4f71-af58-6edae28c7944 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] No waiting events found dispatching network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:36:54 user nova-compute[74980]: WARNING nova.compute.manager [req-d4cdfc80-c4bb-45f4-b9a4-c9f502ef63d2 req-bac998a9-e811-4f71-af58-6edae28c7944 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received unexpected event network-vif-plugged-28b668aa-b083-474c-bc08-9bd96a7ea7ff for instance with vm_state deleted and task_state None.
Nov 02 17:36:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-d4cdfc80-c4bb-45f4-b9a4-c9f502ef63d2 req-bac998a9-e811-4f71-af58-6edae28c7944 service nova] [instance: dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275] Received event network-vif-deleted-28b668aa-b083-474c-bc08-9bd96a7ea7ff {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:36:55 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Deleted allocations for instance dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275
Nov 02 17:36:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b7cefd84-2ff2-485d-abc8-de06246cf8fb tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "dc1bdb6f-68f7-4582-b0fc-40ba1b1f1275" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.540s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:36:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "e0a58d05-9dff-4590-a240-64826fc8243e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "e0a58d05-9dff-4590-a240-64826fc8243e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:59 user nova-compute[74980]: DEBUG nova.compute.manager [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:36:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:36:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:36:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:36:59 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:36:59 user nova-compute[74980]: INFO nova.compute.claims [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Claim successful on node user
Nov 02 17:37:00 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:37:00 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:37:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:37:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:37:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:37:00 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:37:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:37:00 user nova-compute[74980]: DEBUG nova.policy [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87f4ea9506264174bdbcd706e8cc877d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b461c7b3824820a1fd88721ddbebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:37:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:37:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:37:00 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Creating image(s)
Nov 02 17:37:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "/opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "/opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.203s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:00 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk 1073741824" returned: 0 in 0.049s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG nova.network.neutron [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Successfully created port: 2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Cannot resize image /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Ensure instance console log exists: /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.network.neutron [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Successfully updated port: 2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "refresh_cache-e0a58d05-9dff-4590-a240-64826fc8243e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquired lock "refresh_cache-e0a58d05-9dff-4590-a240-64826fc8243e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.network.neutron [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.compute.manager [req-5bffc79b-574a-46bf-924b-3665084bb2df req-b1c724a6-a916-463c-9b90-05551c0ef06c service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Received event network-changed-2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.compute.manager [req-5bffc79b-574a-46bf-924b-3665084bb2df req-b1c724a6-a916-463c-9b90-05551c0ef06c service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Refreshing instance network info cache due to event network-changed-2d9e080b-5c93-4e9a-bbaa-a354d9056614. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5bffc79b-574a-46bf-924b-3665084bb2df req-b1c724a6-a916-463c-9b90-05551c0ef06c service nova] Acquiring lock "refresh_cache-e0a58d05-9dff-4590-a240-64826fc8243e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.network.neutron [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.network.neutron [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Updating instance_info_cache with network_info: [{"id": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "address": "fa:16:3e:ad:6a:3d", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9e080b-5c", "ovs_interfaceid": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Releasing lock "refresh_cache-e0a58d05-9dff-4590-a240-64826fc8243e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.compute.manager [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Instance network_info: |[{"id": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "address": "fa:16:3e:ad:6a:3d", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9e080b-5c", "ovs_interfaceid": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5bffc79b-574a-46bf-924b-3665084bb2df req-b1c724a6-a916-463c-9b90-05551c0ef06c service nova] Acquired lock "refresh_cache-e0a58d05-9dff-4590-a240-64826fc8243e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.network.neutron [req-5bffc79b-574a-46bf-924b-3665084bb2df req-b1c724a6-a916-463c-9b90-05551c0ef06c service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Refreshing network info cache for port 2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Start _get_guest_xml network_info=[{"id": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "address": "fa:16:3e:ad:6a:3d", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9e080b-5c", "ovs_interfaceid": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:37:02 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:37:02 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-868553513',display_name='tempest-TestStampPattern-server-868553513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-868553513',id=30,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6brPZ2uQ9G456sHLwslPBKMXH8Tx/nIMEedR+0YOFh5yPB/1XbhrPSZGlKxJ15/1VDK+MwShvhsv4pet6TNLtaVxKcGhLuXiTb4JdYXaSjCd+QqbzzQiSp5KWOqpajXQ==',key_name='tempest-TestStampPattern-1458079072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45b461c7b3824820a1fd88721ddbebd6',ramdisk_id='',reservation_id='r-cnudubnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1736614362',owner_user_name='tempest-TestStampPattern-1736614362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:37:01Z,user_data=None,user_id='87f4ea9506264174bdbcd706e8cc877d',uuid=e0a58d05-9dff-4590-a240-64826fc8243e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "address": "fa:16:3e:ad:6a:3d", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9e080b-5c", "ovs_interfaceid": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Converting VIF {"id": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "address": "fa:16:3e:ad:6a:3d", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9e080b-5c", "ovs_interfaceid": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:6a:3d,bridge_name='br-int',has_traffic_filtering=True,id=2d9e080b-5c93-4e9a-bbaa-a354d9056614,network=Network(067a0d22-4891-42a5-8cf2-d95882454841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d9e080b-5c') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.objects.instance [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lazy-loading 'pci_devices' on Instance uuid e0a58d05-9dff-4590-a240-64826fc8243e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:37:02 user nova-compute[74980]:   <uuid>e0a58d05-9dff-4590-a240-64826fc8243e</uuid>
Nov 02 17:37:02 user nova-compute[74980]:   <name>instance-0000001e</name>
Nov 02 17:37:02 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:37:02 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:37:02 user nova-compute[74980]:   <metadata>
Nov 02 17:37:02 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:37:02 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:37:02 user nova-compute[74980]:       <nova:name>tempest-TestStampPattern-server-868553513</nova:name>
Nov 02 17:37:02 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:37:02</nova:creationTime>
Nov 02 17:37:02 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:37:02 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:37:02 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:37:02 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:37:02 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:37:02 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:37:02 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:37:02 user nova-compute[74980]:       <nova:owner>
Nov 02 17:37:02 user nova-compute[74980]:         <nova:user uuid="87f4ea9506264174bdbcd706e8cc877d">tempest-TestStampPattern-1736614362-project-member</nova:user>
Nov 02 17:37:02 user nova-compute[74980]:         <nova:project uuid="45b461c7b3824820a1fd88721ddbebd6">tempest-TestStampPattern-1736614362</nova:project>
Nov 02 17:37:02 user nova-compute[74980]:       </nova:owner>
Nov 02 17:37:02 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:37:02 user nova-compute[74980]:       <nova:ports>
Nov 02 17:37:02 user nova-compute[74980]:         <nova:port uuid="2d9e080b-5c93-4e9a-bbaa-a354d9056614">
Nov 02 17:37:02 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 17:37:02 user nova-compute[74980]:         </nova:port>
Nov 02 17:37:02 user nova-compute[74980]:       </nova:ports>
Nov 02 17:37:02 user nova-compute[74980]:     </nova:instance>
Nov 02 17:37:02 user nova-compute[74980]:   </metadata>
Nov 02 17:37:02 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:37:02 user nova-compute[74980]:     <system>
Nov 02 17:37:02 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:37:02 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:37:02 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:37:02 user nova-compute[74980]:       <entry name="serial">e0a58d05-9dff-4590-a240-64826fc8243e</entry>
Nov 02 17:37:02 user nova-compute[74980]:       <entry name="uuid">e0a58d05-9dff-4590-a240-64826fc8243e</entry>
Nov 02 17:37:02 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:37:02 user nova-compute[74980]:     </system>
Nov 02 17:37:02 user nova-compute[74980]:   </sysinfo>
Nov 02 17:37:02 user nova-compute[74980]:   <os>
Nov 02 17:37:02 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:37:02 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:37:02 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:37:02 user nova-compute[74980]:   </os>
Nov 02 17:37:02 user nova-compute[74980]:   <features>
Nov 02 17:37:02 user nova-compute[74980]:     <acpi/>
Nov 02 17:37:02 user nova-compute[74980]:     <apic/>
Nov 02 17:37:02 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:37:02 user nova-compute[74980]:   </features>
Nov 02 17:37:02 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:37:02 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:37:02 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:37:02 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:37:02 user nova-compute[74980]:   </clock>
Nov 02 17:37:02 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:37:02 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:37:02 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:37:02 user nova-compute[74980]:   </cpu>
Nov 02 17:37:02 user nova-compute[74980]:   <devices>
Nov 02 17:37:02 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:37:02 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:37:02 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk"/>
Nov 02 17:37:02 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:37:02 user nova-compute[74980]:     </disk>
Nov 02 17:37:02 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:37:02 user nova-compute[74980]:       <mac address="fa:16:3e:ad:6a:3d"/>
Nov 02 17:37:02 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:37:02 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:37:02 user nova-compute[74980]:       <target dev="tap2d9e080b-5c"/>
Nov 02 17:37:02 user nova-compute[74980]:     </interface>
Nov 02 17:37:02 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:37:02 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/console.log" append="off"/>
Nov 02 17:37:02 user nova-compute[74980]:     </serial>
Nov 02 17:37:02 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:37:02 user nova-compute[74980]:     <video>
Nov 02 17:37:02 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:37:02 user nova-compute[74980]:     </video>
Nov 02 17:37:02 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:37:02 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:37:02 user nova-compute[74980]:     </rng>
Nov 02 17:37:02 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:37:02 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:37:02 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:37:02 user nova-compute[74980]:     </memballoon>
Nov 02 17:37:02 user nova-compute[74980]:   </devices>
Nov 02 17:37:02 user nova-compute[74980]: </domain>
Nov 02 17:37:02 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-868553513',display_name='tempest-TestStampPattern-server-868553513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-868553513',id=30,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6brPZ2uQ9G456sHLwslPBKMXH8Tx/nIMEedR+0YOFh5yPB/1XbhrPSZGlKxJ15/1VDK+MwShvhsv4pet6TNLtaVxKcGhLuXiTb4JdYXaSjCd+QqbzzQiSp5KWOqpajXQ==',key_name='tempest-TestStampPattern-1458079072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45b461c7b3824820a1fd88721ddbebd6',ramdisk_id='',reservation_id='r-cnudubnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1736614362',owner_user_name='tempest-TestStampPattern-1736614362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:37:01Z,user_data=None,user_id='87f4ea9506264174bdbcd706e8cc877d',uuid=e0a58d05-9dff-4590-a240-64826fc8243e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "address": "fa:16:3e:ad:6a:3d", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9e080b-5c", "ovs_interfaceid": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Converting VIF {"id": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "address": "fa:16:3e:ad:6a:3d", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9e080b-5c", "ovs_interfaceid": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:6a:3d,bridge_name='br-int',has_traffic_filtering=True,id=2d9e080b-5c93-4e9a-bbaa-a354d9056614,network=Network(067a0d22-4891-42a5-8cf2-d95882454841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d9e080b-5c') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG os_vif [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:6a:3d,bridge_name='br-int',has_traffic_filtering=True,id=2d9e080b-5c93-4e9a-bbaa-a354d9056614,network=Network(067a0d22-4891-42a5-8cf2-d95882454841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d9e080b-5c') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4faaa66b-93b9-5581-9256-d5eb0153268c', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d9e080b-5c, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d9e080b-5c, col_values=(('qos', UUID('cc9a922e-973d-4916-8d33-e06697d9cdf4')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d9e080b-5c, col_values=(('external_ids', {'iface-id': '2d9e080b-5c93-4e9a-bbaa-a354d9056614', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:6a:3d', 'vm-uuid': 'e0a58d05-9dff-4590-a240-64826fc8243e'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:37:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:02 user nova-compute[74980]: INFO os_vif [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:6a:3d,bridge_name='br-int',has_traffic_filtering=True,id=2d9e080b-5c93-4e9a-bbaa-a354d9056614,network=Network(067a0d22-4891-42a5-8cf2-d95882454841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d9e080b-5c')
Nov 02 17:37:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:37:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] No VIF found with MAC fa:16:3e:ad:6a:3d, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:37:03 user nova-compute[74980]: DEBUG nova.network.neutron [req-5bffc79b-574a-46bf-924b-3665084bb2df req-b1c724a6-a916-463c-9b90-05551c0ef06c service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Updated VIF entry in instance network info cache for port 2d9e080b-5c93-4e9a-bbaa-a354d9056614. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:37:03 user nova-compute[74980]: DEBUG nova.network.neutron [req-5bffc79b-574a-46bf-924b-3665084bb2df req-b1c724a6-a916-463c-9b90-05551c0ef06c service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Updating instance_info_cache with network_info: [{"id": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "address": "fa:16:3e:ad:6a:3d", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9e080b-5c", "ovs_interfaceid": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:37:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5bffc79b-574a-46bf-924b-3665084bb2df req-b1c724a6-a916-463c-9b90-05551c0ef06c service nova] Releasing lock "refresh_cache-e0a58d05-9dff-4590-a240-64826fc8243e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:37:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-c5442904-5f6e-4ddb-9d7f-6ac829874a58 req-7b54eaff-03d9-462a-a688-1849f715fe00 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Received event network-vif-plugged-2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c5442904-5f6e-4ddb-9d7f-6ac829874a58 req-7b54eaff-03d9-462a-a688-1849f715fe00 service nova] Acquiring lock "e0a58d05-9dff-4590-a240-64826fc8243e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c5442904-5f6e-4ddb-9d7f-6ac829874a58 req-7b54eaff-03d9-462a-a688-1849f715fe00 service nova] Lock "e0a58d05-9dff-4590-a240-64826fc8243e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c5442904-5f6e-4ddb-9d7f-6ac829874a58 req-7b54eaff-03d9-462a-a688-1849f715fe00 service nova] Lock "e0a58d05-9dff-4590-a240-64826fc8243e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-c5442904-5f6e-4ddb-9d7f-6ac829874a58 req-7b54eaff-03d9-462a-a688-1849f715fe00 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] No waiting events found dispatching network-vif-plugged-2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:37:04 user nova-compute[74980]: WARNING nova.compute.manager [req-c5442904-5f6e-4ddb-9d7f-6ac829874a58 req-7b54eaff-03d9-462a-a688-1849f715fe00 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Received unexpected event network-vif-plugged-2d9e080b-5c93-4e9a-bbaa-a354d9056614 for instance with vm_state building and task_state spawning.
Nov 02 17:37:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:05 user nova-compute[74980]: INFO nova.compute.manager [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Rescuing
Nov 02 17:37:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:37:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquired lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:37:05 user nova-compute[74980]: DEBUG nova.network.neutron [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:37:05 user nova-compute[74980]: DEBUG nova.network.neutron [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Updating instance_info_cache with network_info: [{"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:37:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Releasing lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Instance destroyed successfully.
Nov 02 17:37:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Attempting rescue
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74980) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Instance directory exists: not creating {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 17:37:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Creating image(s)
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "/opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "/opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.objects.instance [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'trusted_certs' on Instance uuid c6bfac8f-3834-4514-9a56-59c293ced966 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.rescue {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.rescue" returned: 0 in 0.066s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.objects.instance [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'migration_context' on Instance uuid c6bfac8f-3834-4514-9a56-59c293ced966 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:37:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Instance spawned successfully.
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.objects.base [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Object Instance<c6bfac8f-3834-4514-9a56-59c293ced966> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Start _get_guest_xml network_info=[{"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "vif_mac": "fa:16:3e:11:18:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.objects.instance [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'resources' on Instance uuid c6bfac8f-3834-4514-9a56-59c293ced966 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.objects.base [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Object Instance<c6bfac8f-3834-4514-9a56-59c293ced966> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.objects.instance [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'numa_topology' on Instance uuid c6bfac8f-3834-4514-9a56-59c293ced966 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.objects.base [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Object Instance<c6bfac8f-3834-4514-9a56-59c293ced966> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:37:06 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:37:06 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Received event network-vif-plugged-2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] Acquiring lock "e0a58d05-9dff-4590-a240-64826fc8243e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] Lock "e0a58d05-9dff-4590-a240-64826fc8243e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] Lock "e0a58d05-9dff-4590-a240-64826fc8243e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] No waiting events found dispatching network-vif-plugged-2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:37:06 user nova-compute[74980]: WARNING nova.compute.manager [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Received unexpected event network-vif-plugged-2d9e080b-5c93-4e9a-bbaa-a354d9056614 for instance with vm_state building and task_state spawning.
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received event network-vif-unplugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] No waiting events found dispatching network-vif-unplugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:37:06 user nova-compute[74980]: WARNING nova.compute.manager [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received unexpected event network-vif-unplugged-d882437d-9ae3-4508-8a6d-6429e692c104 for instance with vm_state active and task_state rescuing.
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] No waiting events found dispatching network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:37:06 user nova-compute[74980]: WARNING nova.compute.manager [req-a625f6b5-e19f-4e28-8e1d-f5494b51e538 req-37878938-79ee-4bb3-a510-3b9206c8ff96 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received unexpected event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 for instance with vm_state active and task_state rescuing.
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.objects.instance [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'vcpu_model' on Instance uuid c6bfac8f-3834-4514-9a56-59c293ced966 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.objects.base [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Object Instance<c6bfac8f-3834-4514-9a56-59c293ced966> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-376242262',display_name='tempest-ServerRescueNegativeTestJSON-server-376242262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-376242262',id=27,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:32:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc26ef1932f1408c860b3b9edb4925a4',ramdisk_id='',reservation_id='r-904k0hob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-86632079',owner_user_name='tempest-ServerRescueNegativeTestJSON-86632079-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:32:27Z,user_data=None,user_id='985386b6880e4b07bdad162c7860d7a3',uuid=c6bfac8f-3834-4514-9a56-59c293ced966,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "vif_mac": "fa:16:3e:11:18:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converting VIF {"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "vif_mac": "fa:16:3e:11:18:6e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:18:6e,bridge_name='br-int',has_traffic_filtering=True,id=d882437d-9ae3-4508-8a6d-6429e692c104,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd882437d-9a') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.objects.instance [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'pci_devices' on Instance uuid c6bfac8f-3834-4514-9a56-59c293ced966 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:37:06 user nova-compute[74980]: INFO nova.compute.manager [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.objects.base [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Object Instance<c6bfac8f-3834-4514-9a56-59c293ced966> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:37:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:37:06 user nova-compute[74980]:   <uuid>c6bfac8f-3834-4514-9a56-59c293ced966</uuid>
Nov 02 17:37:06 user nova-compute[74980]:   <name>instance-0000001b</name>
Nov 02 17:37:06 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:37:06 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:37:06 user nova-compute[74980]:   <metadata>
Nov 02 17:37:06 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:37:06 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:37:06 user nova-compute[74980]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-376242262</nova:name>
Nov 02 17:37:06 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:37:06</nova:creationTime>
Nov 02 17:37:06 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:37:06 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:37:06 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:37:06 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:37:06 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:37:06 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:37:06 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:37:06 user nova-compute[74980]:       <nova:owner>
Nov 02 17:37:06 user nova-compute[74980]:         <nova:user uuid="985386b6880e4b07bdad162c7860d7a3">tempest-ServerRescueNegativeTestJSON-86632079-project-member</nova:user>
Nov 02 17:37:06 user nova-compute[74980]:         <nova:project uuid="dc26ef1932f1408c860b3b9edb4925a4">tempest-ServerRescueNegativeTestJSON-86632079</nova:project>
Nov 02 17:37:06 user nova-compute[74980]:       </nova:owner>
Nov 02 17:37:06 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:37:06 user nova-compute[74980]:       <nova:ports>
Nov 02 17:37:06 user nova-compute[74980]:         <nova:port uuid="d882437d-9ae3-4508-8a6d-6429e692c104">
Nov 02 17:37:06 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 17:37:06 user nova-compute[74980]:         </nova:port>
Nov 02 17:37:06 user nova-compute[74980]:       </nova:ports>
Nov 02 17:37:06 user nova-compute[74980]:     </nova:instance>
Nov 02 17:37:06 user nova-compute[74980]:   </metadata>
Nov 02 17:37:06 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:37:06 user nova-compute[74980]:     <system>
Nov 02 17:37:06 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:37:06 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:37:06 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:37:06 user nova-compute[74980]:       <entry name="serial">c6bfac8f-3834-4514-9a56-59c293ced966</entry>
Nov 02 17:37:06 user nova-compute[74980]:       <entry name="uuid">c6bfac8f-3834-4514-9a56-59c293ced966</entry>
Nov 02 17:37:06 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:37:06 user nova-compute[74980]:     </system>
Nov 02 17:37:06 user nova-compute[74980]:   </sysinfo>
Nov 02 17:37:06 user nova-compute[74980]:   <os>
Nov 02 17:37:06 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:37:06 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:37:06 user nova-compute[74980]:   </os>
Nov 02 17:37:06 user nova-compute[74980]:   <features>
Nov 02 17:37:06 user nova-compute[74980]:     <acpi/>
Nov 02 17:37:06 user nova-compute[74980]:     <apic/>
Nov 02 17:37:06 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:37:06 user nova-compute[74980]:   </features>
Nov 02 17:37:06 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:37:06 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:37:06 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:37:06 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:37:06 user nova-compute[74980]:   </clock>
Nov 02 17:37:06 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:37:06 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:37:06 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:37:06 user nova-compute[74980]:   </cpu>
Nov 02 17:37:06 user nova-compute[74980]:   <devices>
Nov 02 17:37:06 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:37:06 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:37:06 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.rescue"/>
Nov 02 17:37:06 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:37:06 user nova-compute[74980]:     </disk>
Nov 02 17:37:06 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:37:06 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:37:06 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk"/>
Nov 02 17:37:06 user nova-compute[74980]:       <target dev="vdb" bus="virtio"/>
Nov 02 17:37:06 user nova-compute[74980]:     </disk>
Nov 02 17:37:06 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:37:06 user nova-compute[74980]:       <mac address="fa:16:3e:11:18:6e"/>
Nov 02 17:37:06 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:37:06 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:37:06 user nova-compute[74980]:       <target dev="tapd882437d-9a"/>
Nov 02 17:37:06 user nova-compute[74980]:     </interface>
Nov 02 17:37:06 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:37:06 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/console.log" append="off"/>
Nov 02 17:37:06 user nova-compute[74980]:     </serial>
Nov 02 17:37:06 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:37:06 user nova-compute[74980]:     <video>
Nov 02 17:37:06 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:37:06 user nova-compute[74980]:     </video>
Nov 02 17:37:06 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:37:06 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:37:06 user nova-compute[74980]:     </rng>
Nov 02 17:37:06 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:37:06 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:37:06 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:37:06 user nova-compute[74980]:     </memballoon>
Nov 02 17:37:06 user nova-compute[74980]:   </devices>
Nov 02 17:37:06 user nova-compute[74980]: </domain>
Nov 02 17:37:06 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:37:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Instance destroyed successfully.
Nov 02 17:37:07 user nova-compute[74980]: INFO nova.compute.manager [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Took 7.12 seconds to build instance.
Nov 02 17:37:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-be4f51ee-7328-4183-a916-0b36bb7c618c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "e0a58d05-9dff-4590-a240-64826fc8243e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.233s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:37:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:37:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No VIF found with MAC fa:16:3e:11:18:6e, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:37:07 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:37:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:08 user nova-compute[74980]: DEBUG nova.compute.manager [req-22761635-4bf1-4392-9945-8f852cddfe2f req-f113cdcb-ace4-4438-9fc0-0bcfcad1f46e service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-22761635-4bf1-4392-9945-8f852cddfe2f req-f113cdcb-ace4-4438-9fc0-0bcfcad1f46e service nova] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-22761635-4bf1-4392-9945-8f852cddfe2f req-f113cdcb-ace4-4438-9fc0-0bcfcad1f46e service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-22761635-4bf1-4392-9945-8f852cddfe2f req-f113cdcb-ace4-4438-9fc0-0bcfcad1f46e service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:08 user nova-compute[74980]: DEBUG nova.compute.manager [req-22761635-4bf1-4392-9945-8f852cddfe2f req-f113cdcb-ace4-4438-9fc0-0bcfcad1f46e service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] No waiting events found dispatching network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:37:08 user nova-compute[74980]: WARNING nova.compute.manager [req-22761635-4bf1-4392-9945-8f852cddfe2f req-f113cdcb-ace4-4438-9fc0-0bcfcad1f46e service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received unexpected event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 for instance with vm_state active and task_state rescuing.
Nov 02 17:37:08 user nova-compute[74980]: DEBUG nova.compute.manager [req-22761635-4bf1-4392-9945-8f852cddfe2f req-f113cdcb-ace4-4438-9fc0-0bcfcad1f46e service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-22761635-4bf1-4392-9945-8f852cddfe2f req-f113cdcb-ace4-4438-9fc0-0bcfcad1f46e service nova] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-22761635-4bf1-4392-9945-8f852cddfe2f req-f113cdcb-ace4-4438-9fc0-0bcfcad1f46e service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-22761635-4bf1-4392-9945-8f852cddfe2f req-f113cdcb-ace4-4438-9fc0-0bcfcad1f46e service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:08 user nova-compute[74980]: DEBUG nova.compute.manager [req-22761635-4bf1-4392-9945-8f852cddfe2f req-f113cdcb-ace4-4438-9fc0-0bcfcad1f46e service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] No waiting events found dispatching network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:37:08 user nova-compute[74980]: WARNING nova.compute.manager [req-22761635-4bf1-4392-9945-8f852cddfe2f req-f113cdcb-ace4-4438-9fc0-0bcfcad1f46e service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received unexpected event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 for instance with vm_state active and task_state rescuing.
Nov 02 17:37:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-51afa1ad-10c4-4ad3-a2a3-be7c34114d0e tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:37:11 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:37:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "b774dda1-5000-4323-aaee-24e9a4029617" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:37:13 user nova-compute[74980]: INFO nova.compute.claims [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Claim successful on node user
Nov 02 17:37:13 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG nova.network.neutron [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:37:13 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:37:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG nova.policy [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1f92dd53761465592b6d5390090f59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb03b0bde444fbc82be742d0027c0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:37:13 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Creating image(s)
Nov 02 17:37:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "/opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "/opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "/opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:13 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.210s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.198s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk 1073741824" returned: 0 in 0.064s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG nova.network.neutron [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Successfully created port: 1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.202s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Cannot resize image /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Ensure instance console log exists: /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.network.neutron [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Successfully updated port: 1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquired lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.network.neutron [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.compute.manager [req-5b021f7c-16a2-4c39-b509-0e746b045846 req-f2ed2660-0a8a-427d-ab31-0ec285542f6b service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-changed-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.compute.manager [req-5b021f7c-16a2-4c39-b509-0e746b045846 req-f2ed2660-0a8a-427d-ab31-0ec285542f6b service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Refreshing instance network info cache due to event network-changed-1f4b9759-99d5-4507-b639-c9755c5da9c2. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5b021f7c-16a2-4c39-b509-0e746b045846 req-f2ed2660-0a8a-427d-ab31-0ec285542f6b service nova] Acquiring lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.network.neutron [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.network.neutron [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Updating instance_info_cache with network_info: [{"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Releasing lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Instance network_info: |[{"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5b021f7c-16a2-4c39-b509-0e746b045846 req-f2ed2660-0a8a-427d-ab31-0ec285542f6b service nova] Acquired lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.network.neutron [req-5b021f7c-16a2-4c39-b509-0e746b045846 req-f2ed2660-0a8a-427d-ab31-0ec285542f6b service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Refreshing network info cache for port 1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Start _get_guest_xml network_info=[{"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:37:15 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:37:15 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1725912966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1725912966',id=31,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAZ17h7BgjKLxayL4IULgvz69q0ubD3+/FIejtFzmXMm9MT0Q3A7LFHZOmkzYCIb3IhyQexjD0uZ7nJlfpErVS87eBHrOqOw2GrQ5LYutL7QUVe8umSQ8yBmUtiSWCgkw==',key_name='tempest-keypair-679286581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccb03b0bde444fbc82be742d0027c0ec',ramdisk_id='',reservation_id='r-rwm0tx71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1991165793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1991165793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:37:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1f92dd53761465592b6d5390090f59f',uuid=b774dda1-5000-4323-aaee-24e9a4029617,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converting VIF {"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:ec:ff,bridge_name='br-int',has_traffic_filtering=True,id=1f4b9759-99d5-4507-b639-c9755c5da9c2,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4b9759-99') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.objects.instance [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lazy-loading 'pci_devices' on Instance uuid b774dda1-5000-4323-aaee-24e9a4029617 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:37:15 user nova-compute[74980]:   <uuid>b774dda1-5000-4323-aaee-24e9a4029617</uuid>
Nov 02 17:37:15 user nova-compute[74980]:   <name>instance-0000001f</name>
Nov 02 17:37:15 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:37:15 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:37:15 user nova-compute[74980]:   <metadata>
Nov 02 17:37:15 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:37:15 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:37:15 user nova-compute[74980]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1725912966</nova:name>
Nov 02 17:37:15 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:37:15</nova:creationTime>
Nov 02 17:37:15 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:37:15 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:37:15 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:37:15 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:37:15 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:37:15 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:37:15 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:37:15 user nova-compute[74980]:       <nova:owner>
Nov 02 17:37:15 user nova-compute[74980]:         <nova:user uuid="f1f92dd53761465592b6d5390090f59f">tempest-AttachVolumeShelveTestJSON-1991165793-project-member</nova:user>
Nov 02 17:37:15 user nova-compute[74980]:         <nova:project uuid="ccb03b0bde444fbc82be742d0027c0ec">tempest-AttachVolumeShelveTestJSON-1991165793</nova:project>
Nov 02 17:37:15 user nova-compute[74980]:       </nova:owner>
Nov 02 17:37:15 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:37:15 user nova-compute[74980]:       <nova:ports>
Nov 02 17:37:15 user nova-compute[74980]:         <nova:port uuid="1f4b9759-99d5-4507-b639-c9755c5da9c2">
Nov 02 17:37:15 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 17:37:15 user nova-compute[74980]:         </nova:port>
Nov 02 17:37:15 user nova-compute[74980]:       </nova:ports>
Nov 02 17:37:15 user nova-compute[74980]:     </nova:instance>
Nov 02 17:37:15 user nova-compute[74980]:   </metadata>
Nov 02 17:37:15 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:37:15 user nova-compute[74980]:     <system>
Nov 02 17:37:15 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:37:15 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:37:15 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:37:15 user nova-compute[74980]:       <entry name="serial">b774dda1-5000-4323-aaee-24e9a4029617</entry>
Nov 02 17:37:15 user nova-compute[74980]:       <entry name="uuid">b774dda1-5000-4323-aaee-24e9a4029617</entry>
Nov 02 17:37:15 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:37:15 user nova-compute[74980]:     </system>
Nov 02 17:37:15 user nova-compute[74980]:   </sysinfo>
Nov 02 17:37:15 user nova-compute[74980]:   <os>
Nov 02 17:37:15 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:37:15 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:37:15 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:37:15 user nova-compute[74980]:   </os>
Nov 02 17:37:15 user nova-compute[74980]:   <features>
Nov 02 17:37:15 user nova-compute[74980]:     <acpi/>
Nov 02 17:37:15 user nova-compute[74980]:     <apic/>
Nov 02 17:37:15 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:37:15 user nova-compute[74980]:   </features>
Nov 02 17:37:15 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:37:15 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:37:15 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:37:15 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:37:15 user nova-compute[74980]:   </clock>
Nov 02 17:37:15 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:37:15 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:37:15 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:37:15 user nova-compute[74980]:   </cpu>
Nov 02 17:37:15 user nova-compute[74980]:   <devices>
Nov 02 17:37:15 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:37:15 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:37:15 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk"/>
Nov 02 17:37:15 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:37:15 user nova-compute[74980]:     </disk>
Nov 02 17:37:15 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:37:15 user nova-compute[74980]:       <mac address="fa:16:3e:51:ec:ff"/>
Nov 02 17:37:15 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:37:15 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:37:15 user nova-compute[74980]:       <target dev="tap1f4b9759-99"/>
Nov 02 17:37:15 user nova-compute[74980]:     </interface>
Nov 02 17:37:15 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:37:15 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/console.log" append="off"/>
Nov 02 17:37:15 user nova-compute[74980]:     </serial>
Nov 02 17:37:15 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:37:15 user nova-compute[74980]:     <video>
Nov 02 17:37:15 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:37:15 user nova-compute[74980]:     </video>
Nov 02 17:37:15 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:37:15 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:37:15 user nova-compute[74980]:     </rng>
Nov 02 17:37:15 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:37:15 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:37:15 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:37:15 user nova-compute[74980]:     </memballoon>
Nov 02 17:37:15 user nova-compute[74980]:   </devices>
Nov 02 17:37:15 user nova-compute[74980]: </domain>
Nov 02 17:37:15 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1725912966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1725912966',id=31,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAZ17h7BgjKLxayL4IULgvz69q0ubD3+/FIejtFzmXMm9MT0Q3A7LFHZOmkzYCIb3IhyQexjD0uZ7nJlfpErVS87eBHrOqOw2GrQ5LYutL7QUVe8umSQ8yBmUtiSWCgkw==',key_name='tempest-keypair-679286581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccb03b0bde444fbc82be742d0027c0ec',ramdisk_id='',reservation_id='r-rwm0tx71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1991165793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1991165793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:37:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1f92dd53761465592b6d5390090f59f',uuid=b774dda1-5000-4323-aaee-24e9a4029617,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converting VIF {"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:ec:ff,bridge_name='br-int',has_traffic_filtering=True,id=1f4b9759-99d5-4507-b639-c9755c5da9c2,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4b9759-99') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG os_vif [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:ec:ff,bridge_name='br-int',has_traffic_filtering=True,id=1f4b9759-99d5-4507-b639-c9755c5da9c2,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4b9759-99') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '974d5fd4-6b11-53e1-b15c-c5e75ecca030', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f4b9759-99, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f4b9759-99, col_values=(('qos', UUID('ef3d7ee0-fadc-46e1-b8ad-091397ede14e')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f4b9759-99, col_values=(('external_ids', {'iface-id': '1f4b9759-99d5-4507-b639-c9755c5da9c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:ec:ff', 'vm-uuid': 'b774dda1-5000-4323-aaee-24e9a4029617'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:15 user nova-compute[74980]: INFO os_vif [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:ec:ff,bridge_name='br-int',has_traffic_filtering=True,id=1f4b9759-99d5-4507-b639-c9755c5da9c2,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4b9759-99')
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:37:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] No VIF found with MAC fa:16:3e:51:ec:ff, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:37:16 user nova-compute[74980]: DEBUG nova.network.neutron [req-5b021f7c-16a2-4c39-b509-0e746b045846 req-f2ed2660-0a8a-427d-ab31-0ec285542f6b service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Updated VIF entry in instance network info cache for port 1f4b9759-99d5-4507-b639-c9755c5da9c2. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:37:16 user nova-compute[74980]: DEBUG nova.network.neutron [req-5b021f7c-16a2-4c39-b509-0e746b045846 req-f2ed2660-0a8a-427d-ab31-0ec285542f6b service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Updating instance_info_cache with network_info: [{"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:37:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5b021f7c-16a2-4c39-b509-0e746b045846 req-f2ed2660-0a8a-427d-ab31-0ec285542f6b service nova] Releasing lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:37:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-d282ba64-a374-4c90-a8c5-380b7c26f6bf req-1c021ff0-6f26-4a84-8388-154f40dc153d service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d282ba64-a374-4c90-a8c5-380b7c26f6bf req-1c021ff0-6f26-4a84-8388-154f40dc153d service nova] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d282ba64-a374-4c90-a8c5-380b7c26f6bf req-1c021ff0-6f26-4a84-8388-154f40dc153d service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d282ba64-a374-4c90-a8c5-380b7c26f6bf req-1c021ff0-6f26-4a84-8388-154f40dc153d service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-d282ba64-a374-4c90-a8c5-380b7c26f6bf req-1c021ff0-6f26-4a84-8388-154f40dc153d service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] No waiting events found dispatching network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:37:17 user nova-compute[74980]: WARNING nova.compute.manager [req-d282ba64-a374-4c90-a8c5-380b7c26f6bf req-1c021ff0-6f26-4a84-8388-154f40dc153d service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received unexpected event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 for instance with vm_state building and task_state spawning.
Nov 02 17:37:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:18 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:37:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:37:18 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:37:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:18 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:37:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:20 user nova-compute[74980]: DEBUG nova.compute.manager [req-2c7f46c8-a621-49b7-bba8-9cd46ecc42aa req-9baafc64-8bfb-4ee1-b9f3-c8bc187e0fbe service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2c7f46c8-a621-49b7-bba8-9cd46ecc42aa req-9baafc64-8bfb-4ee1-b9f3-c8bc187e0fbe service nova] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2c7f46c8-a621-49b7-bba8-9cd46ecc42aa req-9baafc64-8bfb-4ee1-b9f3-c8bc187e0fbe service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2c7f46c8-a621-49b7-bba8-9cd46ecc42aa req-9baafc64-8bfb-4ee1-b9f3-c8bc187e0fbe service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:20 user nova-compute[74980]: DEBUG nova.compute.manager [req-2c7f46c8-a621-49b7-bba8-9cd46ecc42aa req-9baafc64-8bfb-4ee1-b9f3-c8bc187e0fbe service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] No waiting events found dispatching network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:37:20 user nova-compute[74980]: WARNING nova.compute.manager [req-2c7f46c8-a621-49b7-bba8-9cd46ecc42aa req-9baafc64-8bfb-4ee1-b9f3-c8bc187e0fbe service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received unexpected event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 for instance with vm_state building and task_state spawning.
Nov 02 17:37:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.604s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:37:21 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Instance spawned successfully.
Nov 02 17:37:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:21 user nova-compute[74980]: INFO nova.compute.manager [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Took 8.02 seconds to spawn the instance on the hypervisor.
Nov 02 17:37:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:37:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:22 user nova-compute[74980]: INFO nova.compute.manager [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Took 8.85 seconds to build instance.
Nov 02 17:37:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-fe97faa8-7622-43ef-9fb3-cf8999a8e569 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "b774dda1-5000-4323-aaee-24e9a4029617" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.977s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:37:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:24 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:37:24 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:37:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8139MB free_disk=25.043582916259766GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:37:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:37:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:37:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:37:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6319a96b-1499-4d79-8ffe-df25fab1c6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:37:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e0a58d05-9dff-4590-a240-64826fc8243e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:37:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance b774dda1-5000-4323-aaee-24e9a4029617 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:37:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:37:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:37:24 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:37:24 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:37:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:37:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:25 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:37:25 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:37:25 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:37:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:37:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:37:26 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:37:26 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Updating instance_info_cache with network_info: [{"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:37:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:37:26 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:37:26 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:37:26 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:37:26 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:37:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:37 user nova-compute[74980]: INFO nova.compute.manager [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Terminating instance
Nov 02 17:37:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:37:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG nova.compute.manager [req-28330809-d628-436f-aaf0-9fc69228f79c req-9289efad-5444-4964-99b6-bb8733cd3c99 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Received event network-vif-unplugged-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-28330809-d628-436f-aaf0-9fc69228f79c req-9289efad-5444-4964-99b6-bb8733cd3c99 service nova] Acquiring lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-28330809-d628-436f-aaf0-9fc69228f79c req-9289efad-5444-4964-99b6-bb8733cd3c99 service nova] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-28330809-d628-436f-aaf0-9fc69228f79c req-9289efad-5444-4964-99b6-bb8733cd3c99 service nova] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG nova.compute.manager [req-28330809-d628-436f-aaf0-9fc69228f79c req-9289efad-5444-4964-99b6-bb8733cd3c99 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] No waiting events found dispatching network-vif-unplugged-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG nova.compute.manager [req-28330809-d628-436f-aaf0-9fc69228f79c req-9289efad-5444-4964-99b6-bb8733cd3c99 service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Received event network-vif-unplugged-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:37:38 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Instance destroyed successfully.
Nov 02 17:37:38 user nova-compute[74980]: DEBUG nova.objects.instance [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lazy-loading 'resources' on Instance uuid cef7417a-9d8f-49b7-ba6a-6fb9c1251a24 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1331126015',display_name='tempest-ServerActionsTestOtherA-server-1331126015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1331126015',id=3,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLnMhbM0oba6rJcByxBYQLlndi5MHkt5CHpXxfq+RJdLBsoLWmSnT0vVaxYrrZ06wl3cBC9G1WoMy7HQ9vT9DdZBt3/Q/q1q9MknpNsiMnCx1tDgUx7vQwwWmQat63Hng==',key_name='tempest-keypair-1476871667',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:17:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bb10da584734aedb3d08879a4ffc2b2',ramdisk_id='',reservation_id='r-4vdf07b2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-50427258',owner_user_name='tempest-ServerActionsTestOtherA-50427258-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e61d486aa0bf4b1fb4332aabfa5dafd7',uuid=cef7417a-9d8f-49b7-ba6a-6fb9c1251a24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converting VIF {"id": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "address": "fa:16:3e:02:4f:b6", "network": {"id": "d0b6eeee-9443-4520-a695-65cd1a19595d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1549045594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bb10da584734aedb3d08879a4ffc2b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48f410f-fd", "ovs_interfaceid": "d48f410f-fd59-42c7-bf39-17ccc20ad6b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:4f:b6,bridge_name='br-int',has_traffic_filtering=True,id=d48f410f-fd59-42c7-bf39-17ccc20ad6b8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48f410f-fd') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG os_vif [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:4f:b6,bridge_name='br-int',has_traffic_filtering=True,id=d48f410f-fd59-42c7-bf39-17ccc20ad6b8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48f410f-fd') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd48f410f-fd, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9d10539-b6cc-4775-9cae-91ce87b0f158) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:37:38 user nova-compute[74980]: INFO os_vif [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:4f:b6,bridge_name='br-int',has_traffic_filtering=True,id=d48f410f-fd59-42c7-bf39-17ccc20ad6b8,network=Network(d0b6eeee-9443-4520-a695-65cd1a19595d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48f410f-fd')
Nov 02 17:37:38 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Deleting instance files /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24_del
Nov 02 17:37:38 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Deletion of /opt/stack/data/nova/instances/cef7417a-9d8f-49b7-ba6a-6fb9c1251a24_del complete
Nov 02 17:37:38 user nova-compute[74980]: INFO nova.compute.manager [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 02 17:37:38 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:37:38 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:37:39 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:37:39 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Took 0.48 seconds to deallocate network for instance.
Nov 02 17:37:39 user nova-compute[74980]: DEBUG nova.compute.manager [req-6319d2da-44bf-45c4-b812-5c20460df271 req-d64744e4-cce9-4330-9253-d89ce9048c0b service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Received event network-vif-deleted-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:39 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:37:39 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:37:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:39 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Deleted allocations for instance cef7417a-9d8f-49b7-ba6a-6fb9c1251a24
Nov 02 17:37:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-45b46cad-44ca-4741-825f-faa139ea9b14 tempest-ServerActionsTestOtherA-50427258 tempest-ServerActionsTestOtherA-50427258-project-member] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.933s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:40 user nova-compute[74980]: DEBUG nova.compute.manager [req-f26f0834-20a3-4429-81d8-3835b2a8dc34 req-9a2f459f-ba50-4359-8d5a-0d2a88fe21ce service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Received event network-vif-plugged-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f26f0834-20a3-4429-81d8-3835b2a8dc34 req-9a2f459f-ba50-4359-8d5a-0d2a88fe21ce service nova] Acquiring lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f26f0834-20a3-4429-81d8-3835b2a8dc34 req-9a2f459f-ba50-4359-8d5a-0d2a88fe21ce service nova] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f26f0834-20a3-4429-81d8-3835b2a8dc34 req-9a2f459f-ba50-4359-8d5a-0d2a88fe21ce service nova] Lock "cef7417a-9d8f-49b7-ba6a-6fb9c1251a24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:40 user nova-compute[74980]: DEBUG nova.compute.manager [req-f26f0834-20a3-4429-81d8-3835b2a8dc34 req-9a2f459f-ba50-4359-8d5a-0d2a88fe21ce service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] No waiting events found dispatching network-vif-plugged-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:37:40 user nova-compute[74980]: WARNING nova.compute.manager [req-f26f0834-20a3-4429-81d8-3835b2a8dc34 req-9a2f459f-ba50-4359-8d5a-0d2a88fe21ce service nova] [instance: cef7417a-9d8f-49b7-ba6a-6fb9c1251a24] Received unexpected event network-vif-plugged-d48f410f-fd59-42c7-bf39-17ccc20ad6b8 for instance with vm_state deleted and task_state None.
Nov 02 17:37:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:37:47 user nova-compute[74980]: INFO nova.compute.claims [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Claim successful on node user
Nov 02 17:37:47 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:37:47 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:37:47 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG nova.policy [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46cbf858998242a1a5d8b14b0e56cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1b48d7070548bdae52f005ce12d606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:37:47 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Creating image(s)
Nov 02 17:37:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "/opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "/opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "f8272c538c50fd42c6b02e4edcc76c003b5a6316" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "f8272c538c50fd42c6b02e4edcc76c003b5a6316" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316.part --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:48 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Successfully created port: cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:37:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316.part --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:48 user nova-compute[74980]: DEBUG nova.virt.images [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] 76cac6b4-4c51-42d2-93b6-849aead8e2bf was qcow2, converting to raw {{(pid=74980) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 17:37:48 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:37:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316.part /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316.converted {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316.part /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316.converted" returned: 0 in 0.148s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316.converted --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316.converted --force-share --output=json" returned: 0 in 0.226s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "f8272c538c50fd42c6b02e4edcc76c003b5a6316" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.145s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Successfully updated port: cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquired lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-31586f68-cf72-4d96-b22d-2a6b4a3d5032 req-9fbf7930-73fb-4971-b4fd-1b4dcb79d8b1 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received event network-changed-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-31586f68-cf72-4d96-b22d-2a6b4a3d5032 req-9fbf7930-73fb-4971-b4fd-1b4dcb79d8b1 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Refreshing instance network info cache due to event network-changed-cceec27b-26b9-4954-b5f7-3ca024d6862d. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-31586f68-cf72-4d96-b22d-2a6b4a3d5032 req-9fbf7930-73fb-4971-b4fd-1b4dcb79d8b1 service nova] Acquiring lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316 --force-share --output=json" returned: 0 in 0.210s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "f8272c538c50fd42c6b02e4edcc76c003b5a6316" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "f8272c538c50fd42c6b02e4edcc76c003b5a6316" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316 --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316,backing_fmt=raw /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316,backing_fmt=raw /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk 1073741824" returned: 0 in 0.046s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "f8272c538c50fd42c6b02e4edcc76c003b5a6316" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Updating instance_info_cache with network_info: [{"id": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "address": "fa:16:3e:b4:62:19", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceec27b-26", "ovs_interfaceid": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Releasing lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Instance network_info: |[{"id": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "address": "fa:16:3e:b4:62:19", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceec27b-26", "ovs_interfaceid": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-31586f68-cf72-4d96-b22d-2a6b4a3d5032 req-9fbf7930-73fb-4971-b4fd-1b4dcb79d8b1 service nova] Acquired lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.network.neutron [req-31586f68-cf72-4d96-b22d-2a6b4a3d5032 req-9fbf7930-73fb-4971-b4fd-1b4dcb79d8b1 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Refreshing network info cache for port cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316 --force-share --output=json" returned: 0 in 0.199s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Cannot resize image /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Ensure instance console log exists: /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Start _get_guest_xml network_info=[{"id": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "address": "fa:16:3e:b4:62:19", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceec27b-26", "ovs_interfaceid": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:37:44Z,direct_url=<?>,disk_format='qcow2',id=76cac6b4-4c51-42d2-93b6-849aead8e2bf,min_disk=0,min_ram=0,name='tempest-scenario-img--926060340',owner='ad1b48d7070548bdae52f005ce12d606',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:37:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '76cac6b4-4c51-42d2-93b6-849aead8e2bf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:37:49 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:37:49 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:37:44Z,direct_url=<?>,disk_format='qcow2',id=76cac6b4-4c51-42d2-93b6-849aead8e2bf,min_disk=0,min_ram=0,name='tempest-scenario-img--926060340',owner='ad1b48d7070548bdae52f005ce12d606',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:37:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-14048985',display_name='tempest-TestMinimumBasicScenario-server-14048985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-14048985',id=32,image_ref='76cac6b4-4c51-42d2-93b6-849aead8e2bf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIjb3Y87hHQhBb3pfcRe2JyREOLL5k96Z8E6gGjgvqQ/X1WF9InmCeMhiqeDOCYLfnjsVLFxyitfQTTSdDsgiopYKZTUk2O5pY3bIsJ+pnrbu7F3Z7rctmHSqZ3yiZnog==',key_name='tempest-TestMinimumBasicScenario-1717062256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad1b48d7070548bdae52f005ce12d606',ramdisk_id='',reservation_id='r-d1jqxwo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76cac6b4-4c51-42d2-93b6-849aead8e2bf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-487832598',owner_user_name='tempest-TestMinimumBasicScenario-487832598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:37:48Z,user_data=None,user_id='46cbf858998242a1a5d8b14b0e56cace',uuid=3d5b4f62-2d45-434f-bfc3-a626930b3168,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "address": "fa:16:3e:b4:62:19", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceec27b-26", "ovs_interfaceid": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converting VIF {"id": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "address": "fa:16:3e:b4:62:19", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceec27b-26", "ovs_interfaceid": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:62:19,bridge_name='br-int',has_traffic_filtering=True,id=cceec27b-26b9-4954-b5f7-3ca024d6862d,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcceec27b-26') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.objects.instance [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d5b4f62-2d45-434f-bfc3-a626930b3168 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:37:49 user nova-compute[74980]:   <uuid>3d5b4f62-2d45-434f-bfc3-a626930b3168</uuid>
Nov 02 17:37:49 user nova-compute[74980]:   <name>instance-00000020</name>
Nov 02 17:37:49 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:37:49 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:37:49 user nova-compute[74980]:   <metadata>
Nov 02 17:37:49 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:37:49 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:37:49 user nova-compute[74980]:       <nova:name>tempest-TestMinimumBasicScenario-server-14048985</nova:name>
Nov 02 17:37:49 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:37:49</nova:creationTime>
Nov 02 17:37:49 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:37:49 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:37:49 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:37:49 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:37:49 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:37:49 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:37:49 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:37:49 user nova-compute[74980]:       <nova:owner>
Nov 02 17:37:49 user nova-compute[74980]:         <nova:user uuid="46cbf858998242a1a5d8b14b0e56cace">tempest-TestMinimumBasicScenario-487832598-project-member</nova:user>
Nov 02 17:37:49 user nova-compute[74980]:         <nova:project uuid="ad1b48d7070548bdae52f005ce12d606">tempest-TestMinimumBasicScenario-487832598</nova:project>
Nov 02 17:37:49 user nova-compute[74980]:       </nova:owner>
Nov 02 17:37:49 user nova-compute[74980]:       <nova:root type="image" uuid="76cac6b4-4c51-42d2-93b6-849aead8e2bf"/>
Nov 02 17:37:49 user nova-compute[74980]:       <nova:ports>
Nov 02 17:37:49 user nova-compute[74980]:         <nova:port uuid="cceec27b-26b9-4954-b5f7-3ca024d6862d">
Nov 02 17:37:49 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 17:37:49 user nova-compute[74980]:         </nova:port>
Nov 02 17:37:49 user nova-compute[74980]:       </nova:ports>
Nov 02 17:37:49 user nova-compute[74980]:     </nova:instance>
Nov 02 17:37:49 user nova-compute[74980]:   </metadata>
Nov 02 17:37:49 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:37:49 user nova-compute[74980]:     <system>
Nov 02 17:37:49 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:37:49 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:37:49 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:37:49 user nova-compute[74980]:       <entry name="serial">3d5b4f62-2d45-434f-bfc3-a626930b3168</entry>
Nov 02 17:37:49 user nova-compute[74980]:       <entry name="uuid">3d5b4f62-2d45-434f-bfc3-a626930b3168</entry>
Nov 02 17:37:49 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:37:49 user nova-compute[74980]:     </system>
Nov 02 17:37:49 user nova-compute[74980]:   </sysinfo>
Nov 02 17:37:49 user nova-compute[74980]:   <os>
Nov 02 17:37:49 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:37:49 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:37:49 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:37:49 user nova-compute[74980]:   </os>
Nov 02 17:37:49 user nova-compute[74980]:   <features>
Nov 02 17:37:49 user nova-compute[74980]:     <acpi/>
Nov 02 17:37:49 user nova-compute[74980]:     <apic/>
Nov 02 17:37:49 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:37:49 user nova-compute[74980]:   </features>
Nov 02 17:37:49 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:37:49 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:37:49 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:37:49 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:37:49 user nova-compute[74980]:   </clock>
Nov 02 17:37:49 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:37:49 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:37:49 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:37:49 user nova-compute[74980]:   </cpu>
Nov 02 17:37:49 user nova-compute[74980]:   <devices>
Nov 02 17:37:49 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:37:49 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:37:49 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk"/>
Nov 02 17:37:49 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:37:49 user nova-compute[74980]:     </disk>
Nov 02 17:37:49 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:37:49 user nova-compute[74980]:       <mac address="fa:16:3e:b4:62:19"/>
Nov 02 17:37:49 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:37:49 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:37:49 user nova-compute[74980]:       <target dev="tapcceec27b-26"/>
Nov 02 17:37:49 user nova-compute[74980]:     </interface>
Nov 02 17:37:49 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:37:49 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/console.log" append="off"/>
Nov 02 17:37:49 user nova-compute[74980]:     </serial>
Nov 02 17:37:49 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:37:49 user nova-compute[74980]:     <video>
Nov 02 17:37:49 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:37:49 user nova-compute[74980]:     </video>
Nov 02 17:37:49 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:37:49 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:37:49 user nova-compute[74980]:     </rng>
Nov 02 17:37:49 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:37:49 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:37:49 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:37:49 user nova-compute[74980]:     </memballoon>
Nov 02 17:37:49 user nova-compute[74980]:   </devices>
Nov 02 17:37:49 user nova-compute[74980]: </domain>
Nov 02 17:37:49 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-14048985',display_name='tempest-TestMinimumBasicScenario-server-14048985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-14048985',id=32,image_ref='76cac6b4-4c51-42d2-93b6-849aead8e2bf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIjb3Y87hHQhBb3pfcRe2JyREOLL5k96Z8E6gGjgvqQ/X1WF9InmCeMhiqeDOCYLfnjsVLFxyitfQTTSdDsgiopYKZTUk2O5pY3bIsJ+pnrbu7F3Z7rctmHSqZ3yiZnog==',key_name='tempest-TestMinimumBasicScenario-1717062256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad1b48d7070548bdae52f005ce12d606',ramdisk_id='',reservation_id='r-d1jqxwo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76cac6b4-4c51-42d2-93b6-849aead8e2bf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-487832598',owner_user_name='tempest-TestMinimumBasicScenario-487832598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:37:48Z,user_data=None,user_id='46cbf858998242a1a5d8b14b0e56cace',uuid=3d5b4f62-2d45-434f-bfc3-a626930b3168,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "address": "fa:16:3e:b4:62:19", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceec27b-26", "ovs_interfaceid": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converting VIF {"id": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "address": "fa:16:3e:b4:62:19", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceec27b-26", "ovs_interfaceid": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:62:19,bridge_name='br-int',has_traffic_filtering=True,id=cceec27b-26b9-4954-b5f7-3ca024d6862d,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcceec27b-26') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG os_vif [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:62:19,bridge_name='br-int',has_traffic_filtering=True,id=cceec27b-26b9-4954-b5f7-3ca024d6862d,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcceec27b-26') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7baa46e-6c38-58e9-ae25-1dede5f7232b', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcceec27b-26, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcceec27b-26, col_values=(('qos', UUID('cfe1669e-f1ba-4b76-9a7f-1813acd048d5')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcceec27b-26, col_values=(('external_ids', {'iface-id': 'cceec27b-26b9-4954-b5f7-3ca024d6862d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:62:19', 'vm-uuid': '3d5b4f62-2d45-434f-bfc3-a626930b3168'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:49 user nova-compute[74980]: INFO os_vif [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:62:19,bridge_name='br-int',has_traffic_filtering=True,id=cceec27b-26b9-4954-b5f7-3ca024d6862d,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcceec27b-26')
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.network.neutron [req-31586f68-cf72-4d96-b22d-2a6b4a3d5032 req-9fbf7930-73fb-4971-b4fd-1b4dcb79d8b1 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Updated VIF entry in instance network info cache for port cceec27b-26b9-4954-b5f7-3ca024d6862d. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG nova.network.neutron [req-31586f68-cf72-4d96-b22d-2a6b4a3d5032 req-9fbf7930-73fb-4971-b4fd-1b4dcb79d8b1 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Updating instance_info_cache with network_info: [{"id": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "address": "fa:16:3e:b4:62:19", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceec27b-26", "ovs_interfaceid": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-31586f68-cf72-4d96-b22d-2a6b4a3d5032 req-9fbf7930-73fb-4971-b4fd-1b4dcb79d8b1 service nova] Releasing lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:37:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:37:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] No VIF found with MAC fa:16:3e:b4:62:19, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:37:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-1254e594-1e80-439f-af49-680b414494a2 req-0f360cff-74cd-46a8-94a3-f0e85d06a806 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received event network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1254e594-1e80-439f-af49-680b414494a2 req-0f360cff-74cd-46a8-94a3-f0e85d06a806 service nova] Acquiring lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1254e594-1e80-439f-af49-680b414494a2 req-0f360cff-74cd-46a8-94a3-f0e85d06a806 service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1254e594-1e80-439f-af49-680b414494a2 req-0f360cff-74cd-46a8-94a3-f0e85d06a806 service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-1254e594-1e80-439f-af49-680b414494a2 req-0f360cff-74cd-46a8-94a3-f0e85d06a806 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] No waiting events found dispatching network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:37:51 user nova-compute[74980]: WARNING nova.compute.manager [req-1254e594-1e80-439f-af49-680b414494a2 req-0f360cff-74cd-46a8-94a3-f0e85d06a806 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received unexpected event network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d for instance with vm_state building and task_state spawning.
Nov 02 17:37:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:53 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:37:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:37:53 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Instance spawned successfully.
Nov 02 17:37:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:37:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:37:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-758f4124-4c5f-4329-9c63-e28be2514a26 req-225a4f0d-8594-40b7-9c2b-9020db826f14 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received event network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:37:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-758f4124-4c5f-4329-9c63-e28be2514a26 req-225a4f0d-8594-40b7-9c2b-9020db826f14 service nova] Acquiring lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-758f4124-4c5f-4329-9c63-e28be2514a26 req-225a4f0d-8594-40b7-9c2b-9020db826f14 service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-758f4124-4c5f-4329-9c63-e28be2514a26 req-225a4f0d-8594-40b7-9c2b-9020db826f14 service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-758f4124-4c5f-4329-9c63-e28be2514a26 req-225a4f0d-8594-40b7-9c2b-9020db826f14 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] No waiting events found dispatching network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:37:53 user nova-compute[74980]: WARNING nova.compute.manager [req-758f4124-4c5f-4329-9c63-e28be2514a26 req-225a4f0d-8594-40b7-9c2b-9020db826f14 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received unexpected event network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d for instance with vm_state building and task_state spawning.
Nov 02 17:37:53 user nova-compute[74980]: INFO nova.compute.manager [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 02 17:37:53 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:37:53 user nova-compute[74980]: INFO nova.compute.manager [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Took 6.70 seconds to build instance.
Nov 02 17:37:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a8a46514-76e1-4287-8b6e-b3a7ff2b4549 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.792s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:37:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Acquiring lock "1618e41d-a1b2-44f0-af30-e151d30a95a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "1618e41d-a1b2-44f0-af30-e151d30a95a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:57 user nova-compute[74980]: DEBUG nova.compute.manager [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:37:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:57 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:37:57 user nova-compute[74980]: INFO nova.compute.claims [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Claim successful on node user
Nov 02 17:37:58 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG nova.network.neutron [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:37:58 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:37:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:37:58 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Creating image(s)
Nov 02 17:37:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Acquiring lock "/opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "/opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "/opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG nova.policy [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee53096ca1a8457cbeaa336b424ba457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891673f4e7f54c14a34fe042eae3c2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.185s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.198s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk 1073741824" returned: 0 in 0.047s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.186s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:59 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:37:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:37:59 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:37:59 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Cannot resize image /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:37:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:37:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Ensure instance console log exists: /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:37:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:37:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:37:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:37:59 user nova-compute[74980]: DEBUG nova.network.neutron [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Successfully created port: 4a6d2306-3088-4587-a990-aa23e4b821df {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:37:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Successfully updated port: 4a6d2306-3088-4587-a990-aa23e4b821df {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Acquiring lock "refresh_cache-1618e41d-a1b2-44f0-af30-e151d30a95a3" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Acquired lock "refresh_cache-1618e41d-a1b2-44f0-af30-e151d30a95a3" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.compute.manager [req-8418eb9d-c2ee-49b0-841a-f7418cfbb1f6 req-4108da67-d7f1-4527-af1c-8f5b0850c937 service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Received event network-changed-4a6d2306-3088-4587-a990-aa23e4b821df {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.compute.manager [req-8418eb9d-c2ee-49b0-841a-f7418cfbb1f6 req-4108da67-d7f1-4527-af1c-8f5b0850c937 service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Refreshing instance network info cache due to event network-changed-4a6d2306-3088-4587-a990-aa23e4b821df. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8418eb9d-c2ee-49b0-841a-f7418cfbb1f6 req-4108da67-d7f1-4527-af1c-8f5b0850c937 service nova] Acquiring lock "refresh_cache-1618e41d-a1b2-44f0-af30-e151d30a95a3" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Updating instance_info_cache with network_info: [{"id": "4a6d2306-3088-4587-a990-aa23e4b821df", "address": "fa:16:3e:a9:e0:eb", "network": {"id": "66437e03-c8f3-4f77-8a8b-2987d39a83d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0506163bacd94766bee5ce28755ea623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6d2306-30", "ovs_interfaceid": "4a6d2306-3088-4587-a990-aa23e4b821df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Releasing lock "refresh_cache-1618e41d-a1b2-44f0-af30-e151d30a95a3" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Instance network_info: |[{"id": "4a6d2306-3088-4587-a990-aa23e4b821df", "address": "fa:16:3e:a9:e0:eb", "network": {"id": "66437e03-c8f3-4f77-8a8b-2987d39a83d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0506163bacd94766bee5ce28755ea623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6d2306-30", "ovs_interfaceid": "4a6d2306-3088-4587-a990-aa23e4b821df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8418eb9d-c2ee-49b0-841a-f7418cfbb1f6 req-4108da67-d7f1-4527-af1c-8f5b0850c937 service nova] Acquired lock "refresh_cache-1618e41d-a1b2-44f0-af30-e151d30a95a3" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.network.neutron [req-8418eb9d-c2ee-49b0-841a-f7418cfbb1f6 req-4108da67-d7f1-4527-af1c-8f5b0850c937 service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Refreshing network info cache for port 4a6d2306-3088-4587-a990-aa23e4b821df {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Start _get_guest_xml network_info=[{"id": "4a6d2306-3088-4587-a990-aa23e4b821df", "address": "fa:16:3e:a9:e0:eb", "network": {"id": "66437e03-c8f3-4f77-8a8b-2987d39a83d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0506163bacd94766bee5ce28755ea623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6d2306-30", "ovs_interfaceid": "4a6d2306-3088-4587-a990-aa23e4b821df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:38:00 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:38:00 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1796302382',display_name='tempest-VolumesNegativeTest-instance-1796302382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1796302382',id=33,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='891673f4e7f54c14a34fe042eae3c2d4',ramdisk_id='',reservation_id='r-sodytyp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-784513807',owner_user_name='tempest-VolumesNegativeTest-784513807-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:37:58Z,user_data=None,user_id='ee53096ca1a8457cbeaa336b424ba457',uuid=1618e41d-a1b2-44f0-af30-e151d30a95a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a6d2306-3088-4587-a990-aa23e4b821df", "address": "fa:16:3e:a9:e0:eb", "network": {"id": "66437e03-c8f3-4f77-8a8b-2987d39a83d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0506163bacd94766bee5ce28755ea623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6d2306-30", "ovs_interfaceid": "4a6d2306-3088-4587-a990-aa23e4b821df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Converting VIF {"id": "4a6d2306-3088-4587-a990-aa23e4b821df", "address": "fa:16:3e:a9:e0:eb", "network": {"id": "66437e03-c8f3-4f77-8a8b-2987d39a83d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0506163bacd94766bee5ce28755ea623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6d2306-30", "ovs_interfaceid": "4a6d2306-3088-4587-a990-aa23e4b821df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e0:eb,bridge_name='br-int',has_traffic_filtering=True,id=4a6d2306-3088-4587-a990-aa23e4b821df,network=Network(66437e03-c8f3-4f77-8a8b-2987d39a83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6d2306-30') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.objects.instance [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lazy-loading 'pci_devices' on Instance uuid 1618e41d-a1b2-44f0-af30-e151d30a95a3 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:38:00 user nova-compute[74980]:   <uuid>1618e41d-a1b2-44f0-af30-e151d30a95a3</uuid>
Nov 02 17:38:00 user nova-compute[74980]:   <name>instance-00000021</name>
Nov 02 17:38:00 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:38:00 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:38:00 user nova-compute[74980]:   <metadata>
Nov 02 17:38:00 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:38:00 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:38:00 user nova-compute[74980]:       <nova:name>tempest-VolumesNegativeTest-instance-1796302382</nova:name>
Nov 02 17:38:00 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:38:00</nova:creationTime>
Nov 02 17:38:00 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:38:00 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:38:00 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:38:00 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:38:00 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:38:00 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:38:00 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:38:00 user nova-compute[74980]:       <nova:owner>
Nov 02 17:38:00 user nova-compute[74980]:         <nova:user uuid="ee53096ca1a8457cbeaa336b424ba457">tempest-VolumesNegativeTest-784513807-project-member</nova:user>
Nov 02 17:38:00 user nova-compute[74980]:         <nova:project uuid="891673f4e7f54c14a34fe042eae3c2d4">tempest-VolumesNegativeTest-784513807</nova:project>
Nov 02 17:38:00 user nova-compute[74980]:       </nova:owner>
Nov 02 17:38:00 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:38:00 user nova-compute[74980]:       <nova:ports>
Nov 02 17:38:00 user nova-compute[74980]:         <nova:port uuid="4a6d2306-3088-4587-a990-aa23e4b821df">
Nov 02 17:38:00 user nova-compute[74980]:           <nova:ip type="fixed" address="192.168.233.73" ipVersion="4"/>
Nov 02 17:38:00 user nova-compute[74980]:         </nova:port>
Nov 02 17:38:00 user nova-compute[74980]:       </nova:ports>
Nov 02 17:38:00 user nova-compute[74980]:     </nova:instance>
Nov 02 17:38:00 user nova-compute[74980]:   </metadata>
Nov 02 17:38:00 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:38:00 user nova-compute[74980]:     <system>
Nov 02 17:38:00 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:38:00 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:38:00 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:38:00 user nova-compute[74980]:       <entry name="serial">1618e41d-a1b2-44f0-af30-e151d30a95a3</entry>
Nov 02 17:38:00 user nova-compute[74980]:       <entry name="uuid">1618e41d-a1b2-44f0-af30-e151d30a95a3</entry>
Nov 02 17:38:00 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:38:00 user nova-compute[74980]:     </system>
Nov 02 17:38:00 user nova-compute[74980]:   </sysinfo>
Nov 02 17:38:00 user nova-compute[74980]:   <os>
Nov 02 17:38:00 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:38:00 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:38:00 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:38:00 user nova-compute[74980]:   </os>
Nov 02 17:38:00 user nova-compute[74980]:   <features>
Nov 02 17:38:00 user nova-compute[74980]:     <acpi/>
Nov 02 17:38:00 user nova-compute[74980]:     <apic/>
Nov 02 17:38:00 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:38:00 user nova-compute[74980]:   </features>
Nov 02 17:38:00 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:38:00 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:38:00 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:38:00 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:38:00 user nova-compute[74980]:   </clock>
Nov 02 17:38:00 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:38:00 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:38:00 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:38:00 user nova-compute[74980]:   </cpu>
Nov 02 17:38:00 user nova-compute[74980]:   <devices>
Nov 02 17:38:00 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:38:00 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:38:00 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk"/>
Nov 02 17:38:00 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:38:00 user nova-compute[74980]:     </disk>
Nov 02 17:38:00 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:38:00 user nova-compute[74980]:       <mac address="fa:16:3e:a9:e0:eb"/>
Nov 02 17:38:00 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:38:00 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:38:00 user nova-compute[74980]:       <target dev="tap4a6d2306-30"/>
Nov 02 17:38:00 user nova-compute[74980]:     </interface>
Nov 02 17:38:00 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:38:00 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/console.log" append="off"/>
Nov 02 17:38:00 user nova-compute[74980]:     </serial>
Nov 02 17:38:00 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:38:00 user nova-compute[74980]:     <video>
Nov 02 17:38:00 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:38:00 user nova-compute[74980]:     </video>
Nov 02 17:38:00 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:38:00 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:38:00 user nova-compute[74980]:     </rng>
Nov 02 17:38:00 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:38:00 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:38:00 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:38:00 user nova-compute[74980]:     </memballoon>
Nov 02 17:38:00 user nova-compute[74980]:   </devices>
Nov 02 17:38:00 user nova-compute[74980]: </domain>
Nov 02 17:38:00 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1796302382',display_name='tempest-VolumesNegativeTest-instance-1796302382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1796302382',id=33,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='891673f4e7f54c14a34fe042eae3c2d4',ramdisk_id='',reservation_id='r-sodytyp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-784513807',owner_user_name='tempest-VolumesNegativeTest-784513807-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:37:58Z,user_data=None,user_id='ee53096ca1a8457cbeaa336b424ba457',uuid=1618e41d-a1b2-44f0-af30-e151d30a95a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a6d2306-3088-4587-a990-aa23e4b821df", "address": "fa:16:3e:a9:e0:eb", "network": {"id": "66437e03-c8f3-4f77-8a8b-2987d39a83d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0506163bacd94766bee5ce28755ea623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6d2306-30", "ovs_interfaceid": "4a6d2306-3088-4587-a990-aa23e4b821df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Converting VIF {"id": "4a6d2306-3088-4587-a990-aa23e4b821df", "address": "fa:16:3e:a9:e0:eb", "network": {"id": "66437e03-c8f3-4f77-8a8b-2987d39a83d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0506163bacd94766bee5ce28755ea623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6d2306-30", "ovs_interfaceid": "4a6d2306-3088-4587-a990-aa23e4b821df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e0:eb,bridge_name='br-int',has_traffic_filtering=True,id=4a6d2306-3088-4587-a990-aa23e4b821df,network=Network(66437e03-c8f3-4f77-8a8b-2987d39a83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6d2306-30') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG os_vif [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e0:eb,bridge_name='br-int',has_traffic_filtering=True,id=4a6d2306-3088-4587-a990-aa23e4b821df,network=Network(66437e03-c8f3-4f77-8a8b-2987d39a83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6d2306-30') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8a9cc19-b5bd-58c3-81c0-1a7fa09ce069', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a6d2306-30, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a6d2306-30, col_values=(('qos', UUID('bc929276-98c3-4697-948b-fd468aecea92')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a6d2306-30, col_values=(('external_ids', {'iface-id': '4a6d2306-3088-4587-a990-aa23e4b821df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:e0:eb', 'vm-uuid': '1618e41d-a1b2-44f0-af30-e151d30a95a3'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:00 user nova-compute[74980]: INFO os_vif [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e0:eb,bridge_name='br-int',has_traffic_filtering=True,id=4a6d2306-3088-4587-a990-aa23e4b821df,network=Network(66437e03-c8f3-4f77-8a8b-2987d39a83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6d2306-30')
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] No VIF found with MAC fa:16:3e:a9:e0:eb, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.network.neutron [req-8418eb9d-c2ee-49b0-841a-f7418cfbb1f6 req-4108da67-d7f1-4527-af1c-8f5b0850c937 service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Updated VIF entry in instance network info cache for port 4a6d2306-3088-4587-a990-aa23e4b821df. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG nova.network.neutron [req-8418eb9d-c2ee-49b0-841a-f7418cfbb1f6 req-4108da67-d7f1-4527-af1c-8f5b0850c937 service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Updating instance_info_cache with network_info: [{"id": "4a6d2306-3088-4587-a990-aa23e4b821df", "address": "fa:16:3e:a9:e0:eb", "network": {"id": "66437e03-c8f3-4f77-8a8b-2987d39a83d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0506163bacd94766bee5ce28755ea623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6d2306-30", "ovs_interfaceid": "4a6d2306-3088-4587-a990-aa23e4b821df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:38:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8418eb9d-c2ee-49b0-841a-f7418cfbb1f6 req-4108da67-d7f1-4527-af1c-8f5b0850c937 service nova] Releasing lock "refresh_cache-1618e41d-a1b2-44f0-af30-e151d30a95a3" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:38:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:02 user nova-compute[74980]: DEBUG nova.compute.manager [req-99525984-7280-42f8-9d7a-2fe790dc5adf req-98c88f62-7d23-47bd-b925-f33f5f1a3e2c service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Received event network-vif-plugged-4a6d2306-3088-4587-a990-aa23e4b821df {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:38:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-99525984-7280-42f8-9d7a-2fe790dc5adf req-98c88f62-7d23-47bd-b925-f33f5f1a3e2c service nova] Acquiring lock "1618e41d-a1b2-44f0-af30-e151d30a95a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:38:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-99525984-7280-42f8-9d7a-2fe790dc5adf req-98c88f62-7d23-47bd-b925-f33f5f1a3e2c service nova] Lock "1618e41d-a1b2-44f0-af30-e151d30a95a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:38:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-99525984-7280-42f8-9d7a-2fe790dc5adf req-98c88f62-7d23-47bd-b925-f33f5f1a3e2c service nova] Lock "1618e41d-a1b2-44f0-af30-e151d30a95a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:38:02 user nova-compute[74980]: DEBUG nova.compute.manager [req-99525984-7280-42f8-9d7a-2fe790dc5adf req-98c88f62-7d23-47bd-b925-f33f5f1a3e2c service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] No waiting events found dispatching network-vif-plugged-4a6d2306-3088-4587-a990-aa23e4b821df {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:38:02 user nova-compute[74980]: WARNING nova.compute.manager [req-99525984-7280-42f8-9d7a-2fe790dc5adf req-98c88f62-7d23-47bd-b925-f33f5f1a3e2c service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Received unexpected event network-vif-plugged-4a6d2306-3088-4587-a990-aa23e4b821df for instance with vm_state building and task_state spawning.
Nov 02 17:38:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:38:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:38:03 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Instance spawned successfully.
Nov 02 17:38:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:38:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:38:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:38:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:38:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:38:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:38:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:38:03 user nova-compute[74980]: INFO nova.compute.manager [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Took 5.56 seconds to spawn the instance on the hypervisor.
Nov 02 17:38:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:38:04 user nova-compute[74980]: INFO nova.compute.manager [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Took 6.25 seconds to build instance.
Nov 02 17:38:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-85154c89-b02e-44bf-909a-f69b10a40957 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "1618e41d-a1b2-44f0-af30-e151d30a95a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.344s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:38:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-b3e8d3c8-9a4b-4607-97c7-217abc2cca04 req-7b5e8f82-2cfb-4688-8f64-a6226b523f6d service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Received event network-vif-plugged-4a6d2306-3088-4587-a990-aa23e4b821df {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:38:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b3e8d3c8-9a4b-4607-97c7-217abc2cca04 req-7b5e8f82-2cfb-4688-8f64-a6226b523f6d service nova] Acquiring lock "1618e41d-a1b2-44f0-af30-e151d30a95a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:38:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b3e8d3c8-9a4b-4607-97c7-217abc2cca04 req-7b5e8f82-2cfb-4688-8f64-a6226b523f6d service nova] Lock "1618e41d-a1b2-44f0-af30-e151d30a95a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:38:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b3e8d3c8-9a4b-4607-97c7-217abc2cca04 req-7b5e8f82-2cfb-4688-8f64-a6226b523f6d service nova] Lock "1618e41d-a1b2-44f0-af30-e151d30a95a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:38:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-b3e8d3c8-9a4b-4607-97c7-217abc2cca04 req-7b5e8f82-2cfb-4688-8f64-a6226b523f6d service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] No waiting events found dispatching network-vif-plugged-4a6d2306-3088-4587-a990-aa23e4b821df {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:38:04 user nova-compute[74980]: WARNING nova.compute.manager [req-b3e8d3c8-9a4b-4607-97c7-217abc2cca04 req-7b5e8f82-2cfb-4688-8f64-a6226b523f6d service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Received unexpected event network-vif-plugged-4a6d2306-3088-4587-a990-aa23e4b821df for instance with vm_state active and task_state None.
Nov 02 17:38:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:38:12 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:38:12 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:38:12 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 17:38:12 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] There are 0 instances to clean {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 17:38:14 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:38:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:17 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:38:19 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:38:19 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:38:19 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:38:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:38:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:38:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:38:19 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:38:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:38:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:23 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:38:23 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:38:23 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=7908MB free_disk=25.178024291992188GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6319a96b-1499-4d79-8ffe-df25fab1c6d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e0a58d05-9dff-4590-a240-64826fc8243e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance b774dda1-5000-4323-aaee-24e9a4029617 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 3d5b4f62-2d45-434f-bfc3-a626930b3168 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1618e41d-a1b2-44f0-af30-e151d30a95a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing inventories for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating ProviderTree inventory for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating inventory in ProviderTree for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing aggregate associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, aggregates: None {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 17:38:23 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing trait associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 17:38:24 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:38:24 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:38:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:38:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:38:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:25 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:38:25 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:38:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:38:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:38:25 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:38:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:25 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Updating instance_info_cache with network_info: [{"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:38:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:38:25 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:38:25 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:38:25 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:38:25 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:38:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:38:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:38:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:38:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:38:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:38:34 user nova-compute[74980]: INFO nova.compute.manager [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Terminating instance
Nov 02 17:38:34 user nova-compute[74980]: DEBUG nova.compute.manager [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:38:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:34 user nova-compute[74980]: DEBUG nova.compute.manager [req-a00a83d1-9b4d-480e-ba3c-d9898db9bb5e req-1cd2fca3-e9c4-4872-9bf2-1665e6c722d6 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-vif-unplugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:38:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a00a83d1-9b4d-480e-ba3c-d9898db9bb5e req-1cd2fca3-e9c4-4872-9bf2-1665e6c722d6 service nova] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:38:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a00a83d1-9b4d-480e-ba3c-d9898db9bb5e req-1cd2fca3-e9c4-4872-9bf2-1665e6c722d6 service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:38:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a00a83d1-9b4d-480e-ba3c-d9898db9bb5e req-1cd2fca3-e9c4-4872-9bf2-1665e6c722d6 service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:38:34 user nova-compute[74980]: DEBUG nova.compute.manager [req-a00a83d1-9b4d-480e-ba3c-d9898db9bb5e req-1cd2fca3-e9c4-4872-9bf2-1665e6c722d6 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] No waiting events found dispatching network-vif-unplugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:38:34 user nova-compute[74980]: DEBUG nova.compute.manager [req-a00a83d1-9b4d-480e-ba3c-d9898db9bb5e req-1cd2fca3-e9c4-4872-9bf2-1665e6c722d6 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-vif-unplugged-f5e8978e-28b1-419e-a745-0a784521ee3d for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:35 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Instance destroyed successfully.
Nov 02 17:38:35 user nova-compute[74980]: DEBUG nova.objects.instance [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lazy-loading 'resources' on Instance uuid 6319a96b-1499-4d79-8ffe-df25fab1c6d8 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1460645799',display_name='tempest-ServerActionsTestOtherB-server-1460645799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1460645799',id=23,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDC1zazFsVcK8cRSvh0A9JDxfLAmb3MmWE+O0wv7/MERQOOzJbF5AG6ze84hXy646Ak4C6ld6XkTeszBqKFoffMRNgW/kfbra+jqQgZdpkDkqH9hu6Bzizhbp6Bezooetw==',key_name='tempest-keypair-1765002056',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:36:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca163fc9523f4f83bd2efba0ec7e468d',ramdisk_id='',reservation_id='r-1djtdfew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-879907014',owner_user_name='tempest-ServerActionsTestOtherB-879907014-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:36:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f7818185f98430399f7f2fe9465217c',uuid=6319a96b-1499-4d79-8ffe-df25fab1c6d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converting VIF {"id": "f5e8978e-28b1-419e-a745-0a784521ee3d", "address": "fa:16:3e:1e:4f:61", "network": {"id": "9a6c2238-70cd-40a6-8823-68b840866801", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-261425156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca163fc9523f4f83bd2efba0ec7e468d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e8978e-28", "ovs_interfaceid": "f5e8978e-28b1-419e-a745-0a784521ee3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_vif [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5e8978e-28, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f37fc00f-d148-47ed-8425-c9940dd0dcc3) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:35 user nova-compute[74980]: INFO os_vif [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:61,bridge_name='br-int',has_traffic_filtering=True,id=f5e8978e-28b1-419e-a745-0a784521ee3d,network=Network(9a6c2238-70cd-40a6-8823-68b840866801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e8978e-28')
Nov 02 17:38:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPsmWyMY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:38:35 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[717d506d-659c-4b77-9889-17a7600f4683]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:38:35 user nova-compute[74980]: No targets found.
Nov 02 17:38:35 user nova-compute[74980]: iSNS:
Nov 02 17:38:35 user nova-compute[74980]: No targets found.
Nov 02 17:38:35 user nova-compute[74980]: STATIC:
Nov 02 17:38:35 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b
Nov 02 17:38:35 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:38:35 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:38:35 user nova-compute[74980]: FIRMWARE:
Nov 02 17:38:35 user nova-compute[74980]: No targets found.
Nov 02 17:38:35 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:38:35 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:38:35 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[052f182a-b23b-4f7a-aaa8-46a7ebf7fb32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a73733-ceb2-4449-aaa9-d7381ece16f7]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:38:35 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b (non-flash)
Nov 02 17:38:35 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b4184700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b'): ({'sdd'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Removing single pathed devices sdd {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.050s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e243b3-cab0-48cc-bb5f-ab7ded70295c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d88fdf-c22d-4fa6-b64a-506c1a200be6]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Flushing IO for device /dev/sdd {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55487c2-07e0-4431-9e40-b130a15656db]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.031s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff02525-7175-44f2-b54e-84eeb00ad33b]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] SCSI volumes sdd have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4312ed8d-a877-4061-bd9d-e9ab051c6329]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce68a49c-4671-4e04-904b-e7a66cf9b206]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260]
Nov 02 17:38:35 user nova-compute[74980]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b, portal: 172.16.0.220,3260] successful.
Nov 02 17:38:35 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d1af33-b87a-43ce-887c-348021c25d1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64e7c50-beb8-404b-833d-50e793984654]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] <== disconnect_volume: return (310ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:38:35 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Deleting instance files /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8_del
Nov 02 17:38:35 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Deletion of /opt/stack/data/nova/instances/6319a96b-1499-4d79-8ffe-df25fab1c6d8_del complete
Nov 02 17:38:35 user nova-compute[74980]: INFO nova.compute.manager [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 02 17:38:35 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:38:35 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:38:36 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:38:36 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74980) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 17:38:36 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:38:36 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Took 1.04 seconds to deallocate network for instance.
Nov 02 17:38:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-fd6e4e31-9112-4009-8537-67ee1c429e35 req-098c478c-c5e2-47a7-8815-8d55cbc2a0f6 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-vif-deleted-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:38:36 user nova-compute[74980]: INFO nova.compute.manager [req-fd6e4e31-9112-4009-8537-67ee1c429e35 req-098c478c-c5e2-47a7-8815-8d55cbc2a0f6 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Neutron deleted interface f5e8978e-28b1-419e-a745-0a784521ee3d; detaching it from the instance and deleting it from the info cache
Nov 02 17:38:36 user nova-compute[74980]: DEBUG nova.network.neutron [req-fd6e4e31-9112-4009-8537-67ee1c429e35 req-098c478c-c5e2-47a7-8815-8d55cbc2a0f6 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:38:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-fd6e4e31-9112-4009-8537-67ee1c429e35 req-098c478c-c5e2-47a7-8815-8d55cbc2a0f6 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Detach interface failed, port_id=f5e8978e-28b1-419e-a745-0a784521ee3d, reason: Instance 6319a96b-1499-4d79-8ffe-df25fab1c6d8 could not be found. {{(pid=74980) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 17:38:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-0850608a-2f17-4666-803a-7234bc394766 req-8a39beac-3c12-4058-aae9-a55856ab1287 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:38:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0850608a-2f17-4666-803a-7234bc394766 req-8a39beac-3c12-4058-aae9-a55856ab1287 service nova] Acquiring lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:38:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0850608a-2f17-4666-803a-7234bc394766 req-8a39beac-3c12-4058-aae9-a55856ab1287 service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:38:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0850608a-2f17-4666-803a-7234bc394766 req-8a39beac-3c12-4058-aae9-a55856ab1287 service nova] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:38:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-0850608a-2f17-4666-803a-7234bc394766 req-8a39beac-3c12-4058-aae9-a55856ab1287 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] No waiting events found dispatching network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:38:36 user nova-compute[74980]: WARNING nova.compute.manager [req-0850608a-2f17-4666-803a-7234bc394766 req-8a39beac-3c12-4058-aae9-a55856ab1287 service nova] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Received unexpected event network-vif-plugged-f5e8978e-28b1-419e-a745-0a784521ee3d for instance with vm_state active and task_state deleting.
Nov 02 17:38:37 user nova-compute[74980]: INFO nova.compute.manager [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] [instance: 6319a96b-1499-4d79-8ffe-df25fab1c6d8] Took 0.94 seconds to detach 1 volumes for instance.
Nov 02 17:38:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:38:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:38:37 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:38:37 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:38:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:38:38 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Deleted allocations for instance 6319a96b-1499-4d79-8ffe-df25fab1c6d8
Nov 02 17:38:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-59d99f2a-0848-44a4-9f12-5ede618f57ca tempest-ServerActionsTestOtherB-879907014 tempest-ServerActionsTestOtherB-879907014-project-member] Lock "6319a96b-1499-4d79-8ffe-df25fab1c6d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.710s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:38:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:38:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:38:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:38:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:38:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:38:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-929c7b61-214f-44f0-ae25-7d58b41d4943 req-de346357-dc39-4459-ac9c-9f254d64faf3 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Received event network-changed-2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:38:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-929c7b61-214f-44f0-ae25-7d58b41d4943 req-de346357-dc39-4459-ac9c-9f254d64faf3 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Refreshing instance network info cache due to event network-changed-2d9e080b-5c93-4e9a-bbaa-a354d9056614. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:38:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-929c7b61-214f-44f0-ae25-7d58b41d4943 req-de346357-dc39-4459-ac9c-9f254d64faf3 service nova] Acquiring lock "refresh_cache-e0a58d05-9dff-4590-a240-64826fc8243e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:38:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-929c7b61-214f-44f0-ae25-7d58b41d4943 req-de346357-dc39-4459-ac9c-9f254d64faf3 service nova] Acquired lock "refresh_cache-e0a58d05-9dff-4590-a240-64826fc8243e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:38:51 user nova-compute[74980]: DEBUG nova.network.neutron [req-929c7b61-214f-44f0-ae25-7d58b41d4943 req-de346357-dc39-4459-ac9c-9f254d64faf3 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Refreshing network info cache for port 2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG nova.network.neutron [req-929c7b61-214f-44f0-ae25-7d58b41d4943 req-de346357-dc39-4459-ac9c-9f254d64faf3 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Updated VIF entry in instance network info cache for port 2d9e080b-5c93-4e9a-bbaa-a354d9056614. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG nova.network.neutron [req-929c7b61-214f-44f0-ae25-7d58b41d4943 req-de346357-dc39-4459-ac9c-9f254d64faf3 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Updating instance_info_cache with network_info: [{"id": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "address": "fa:16:3e:ad:6a:3d", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9e080b-5c", "ovs_interfaceid": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-929c7b61-214f-44f0-ae25-7d58b41d4943 req-de346357-dc39-4459-ac9c-9f254d64faf3 service nova] Releasing lock "refresh_cache-e0a58d05-9dff-4590-a240-64826fc8243e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "e0a58d05-9dff-4590-a240-64826fc8243e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "e0a58d05-9dff-4590-a240-64826fc8243e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG nova.objects.instance [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lazy-loading 'flavor' on Instance uuid e0a58d05-9dff-4590-a240-64826fc8243e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "e0a58d05-9dff-4590-a240-64826fc8243e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "e0a58d05-9dff-4590-a240-64826fc8243e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "e0a58d05-9dff-4590-a240-64826fc8243e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:38:52 user nova-compute[74980]: INFO nova.compute.manager [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Attaching volume 89f8091a-b8d6-45f2-83e3-6030cadf294d to /dev/vdb
Nov 02 17:38:52 user nova-compute[74980]: DEBUG os_brick.utils [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aee872c-e5ca-4c3d-addb-3ee9d95b6406]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89e7298-766a-4482-af01-acd7727a3931]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f74fdf-b6f5-4bf8-96d2-f1317718353e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ea5317-6347-427d-acee-01e683f7214f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:38:52 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:38:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c9eb53-f792-4d7d-bec6-5b7504c3b83d]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG os_brick.utils [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:38:52 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Updating existing volume attachment record: e95b779d-01af-427d-a418-6fee377a25cf {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:38:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:56 user nova-compute[74980]: INFO nova.compute.manager [None req-ad704501-cebf-4a7a-9fdd-846ac2b91300 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Unrescuing
Nov 02 17:38:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ad704501-cebf-4a7a-9fdd-846ac2b91300 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:38:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ad704501-cebf-4a7a-9fdd-846ac2b91300 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquired lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:38:56 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ad704501-cebf-4a7a-9fdd-846ac2b91300 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:38:57 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ad704501-cebf-4a7a-9fdd-846ac2b91300 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Updating instance_info_cache with network_info: [{"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:38:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ad704501-cebf-4a7a-9fdd-846ac2b91300 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Releasing lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:38:57 user nova-compute[74980]: DEBUG nova.objects.instance [None req-ad704501-cebf-4a7a-9fdd-846ac2b91300 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'flavor' on Instance uuid c6bfac8f-3834-4514-9a56-59c293ced966 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:38:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-fc3f51fe-e287-450e-8692-ca0a23fa39d8 req-ceb32be2-b7a7-4ef1-8ec2-e4f256603c2a service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received event network-vif-unplugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:38:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fc3f51fe-e287-450e-8692-ca0a23fa39d8 req-ceb32be2-b7a7-4ef1-8ec2-e4f256603c2a service nova] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:38:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fc3f51fe-e287-450e-8692-ca0a23fa39d8 req-ceb32be2-b7a7-4ef1-8ec2-e4f256603c2a service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:38:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fc3f51fe-e287-450e-8692-ca0a23fa39d8 req-ceb32be2-b7a7-4ef1-8ec2-e4f256603c2a service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:38:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-fc3f51fe-e287-450e-8692-ca0a23fa39d8 req-ceb32be2-b7a7-4ef1-8ec2-e4f256603c2a service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] No waiting events found dispatching network-vif-unplugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:38:57 user nova-compute[74980]: WARNING nova.compute.manager [req-fc3f51fe-e287-450e-8692-ca0a23fa39d8 req-ceb32be2-b7a7-4ef1-8ec2-e4f256603c2a service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received unexpected event network-vif-unplugged-d882437d-9ae3-4508-8a6d-6429e692c104 for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:38:57 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Instance destroyed successfully.
Nov 02 17:38:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] No waiting events found dispatching network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:38:59 user nova-compute[74980]: WARNING nova.compute.manager [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received unexpected event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:38:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] No waiting events found dispatching network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:38:59 user nova-compute[74980]: WARNING nova.compute.manager [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received unexpected event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:38:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:38:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] No waiting events found dispatching network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:38:59 user nova-compute[74980]: WARNING nova.compute.manager [req-e4cc8ec6-d782-41ab-9e4f-4d1b66828ae7 req-16e66fc5-a89c-44d1-a4b6-f32ebfe18302 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received unexpected event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:39:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:01 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ad704501-cebf-4a7a-9fdd-846ac2b91300 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:39:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-7ecf9c18-ca2f-49f5-a5ea-dad773051acd req-4b857c14-fd76-4008-9473-b4adcb602c91 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-changed-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:39:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-7ecf9c18-ca2f-49f5-a5ea-dad773051acd req-4b857c14-fd76-4008-9473-b4adcb602c91 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Refreshing instance network info cache due to event network-changed-1f4b9759-99d5-4507-b639-c9755c5da9c2. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:39:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7ecf9c18-ca2f-49f5-a5ea-dad773051acd req-4b857c14-fd76-4008-9473-b4adcb602c91 service nova] Acquiring lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:39:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7ecf9c18-ca2f-49f5-a5ea-dad773051acd req-4b857c14-fd76-4008-9473-b4adcb602c91 service nova] Acquired lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:39:04 user nova-compute[74980]: DEBUG nova.network.neutron [req-7ecf9c18-ca2f-49f5-a5ea-dad773051acd req-4b857c14-fd76-4008-9473-b4adcb602c91 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Refreshing network info cache for port 1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:39:04 user nova-compute[74980]: DEBUG nova.network.neutron [req-7ecf9c18-ca2f-49f5-a5ea-dad773051acd req-4b857c14-fd76-4008-9473-b4adcb602c91 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Updated VIF entry in instance network info cache for port 1f4b9759-99d5-4507-b639-c9755c5da9c2. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:39:04 user nova-compute[74980]: DEBUG nova.network.neutron [req-7ecf9c18-ca2f-49f5-a5ea-dad773051acd req-4b857c14-fd76-4008-9473-b4adcb602c91 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Updating instance_info_cache with network_info: [{"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:39:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7ecf9c18-ca2f-49f5-a5ea-dad773051acd req-4b857c14-fd76-4008-9473-b4adcb602c91 service nova] Releasing lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:39:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "b774dda1-5000-4323-aaee-24e9a4029617" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:11 user nova-compute[74980]: INFO nova.compute.manager [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Shelving
Nov 02 17:39:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-c8f25167-0904-4c41-8cff-3853c3c8111e req-b31fb15e-948b-461d-9d20-d68e6abd9464 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-vif-unplugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:39:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c8f25167-0904-4c41-8cff-3853c3c8111e req-b31fb15e-948b-461d-9d20-d68e6abd9464 service nova] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c8f25167-0904-4c41-8cff-3853c3c8111e req-b31fb15e-948b-461d-9d20-d68e6abd9464 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c8f25167-0904-4c41-8cff-3853c3c8111e req-b31fb15e-948b-461d-9d20-d68e6abd9464 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-c8f25167-0904-4c41-8cff-3853c3c8111e req-b31fb15e-948b-461d-9d20-d68e6abd9464 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] No waiting events found dispatching network-vif-unplugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:39:11 user nova-compute[74980]: WARNING nova.compute.manager [req-c8f25167-0904-4c41-8cff-3853c3c8111e req-b31fb15e-948b-461d-9d20-d68e6abd9464 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received unexpected event network-vif-unplugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 for instance with vm_state active and task_state shelving.
Nov 02 17:39:11 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:39:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:11 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Instance destroyed successfully.
Nov 02 17:39:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:12 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Beginning cold snapshot process
Nov 02 17:39:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hBEtfOUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:39:12 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:39:12 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:39:12 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260" returned: 21 in 0.041s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c04c5e-2503-44e6-bdbb-58e985205ac2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:39:12 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8e1314-7219-4da2-9d38-22a03e87abbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d] added
Nov 02 17:39:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17fad6b-0de7-4475-ac1b-c9d8a901ec54]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e66028d-6bd5-403b-beae-ea6b9a3d76ad]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hBEtfOUz {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hBEtfOUz" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ba8ee7-8a23-46b8-a4be-0b8f9c2a5a51]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hBEtfOUz'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[686dad25-f802-43b2-b995-4f8229dc3793]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk /opt/stack/data/nova/instances/snapshots/tmpinbvuqhi/1e43f09752084b4ca31c38c16052a6c7 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e66a20-5ade-42c8-8a31-73a2509a5428]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:39:12 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:39:12 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:39:12 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 17:39:12 user nova-compute[74980]: 
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0942e59-7f9a-4582-8b5c-09bb171e0d9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d, portal: 172.16.0.220,3260]
Nov 02 17:39:12 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d, portal: 172.16.0.220,3260] successful.
Nov 02 17:39:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28b3ad9-8d6a-4e37-b874-550bfbc62cf1]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50e98a5-7a88-4bc1-9905-d522e1d5c75f]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d (non-flash)
Nov 02 17:39:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d (non-flash)
Nov 02 17:39:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fc9e73-f008-4a1b-a610-e80dcb3c09b5]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hBEtfOUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk /opt/stack/data/nova/instances/snapshots/tmpinbvuqhi/1e43f09752084b4ca31c38c16052a6c7" returned: 0 in 0.539s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:12 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Snapshot extracted, beginning image upload
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] No waiting events found dispatching network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:39:13 user nova-compute[74980]: WARNING nova.compute.manager [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received unexpected event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 17:39:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] No waiting events found dispatching network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:39:13 user nova-compute[74980]: WARNING nova.compute.manager [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received unexpected event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 17:39:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] No waiting events found dispatching network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:39:13 user nova-compute[74980]: WARNING nova.compute.manager [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received unexpected event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 17:39:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-vif-unplugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] No waiting events found dispatching network-vif-unplugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:39:13 user nova-compute[74980]: WARNING nova.compute.manager [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received unexpected event network-vif-unplugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 17:39:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] No waiting events found dispatching network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:39:13 user nova-compute[74980]: WARNING nova.compute.manager [req-b2f2c66b-e4ff-4112-95bf-5d8500f06335 req-a19f8478-9ebe-40a8-92e0-07b16b2c1a66 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received unexpected event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 17:39:13 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '26530373462333863', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530373462333863', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG nova.objects.instance [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lazy-loading 'flavor' on Instance uuid e0a58d05-9dff-4590-a240-64826fc8243e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:39:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:39:13 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:39:13 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:39:13 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:39:13 user nova-compute[74980]:   <serial>89f8091a-b8d6-45f2-83e3-6030cadf294d</serial>
Nov 02 17:39:13 user nova-compute[74980]: </disk>
Nov 02 17:39:13 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:39:14 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:39:14 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:39:14 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] No VIF found with MAC fa:16:3e:ad:6a:3d, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:39:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f711d8da-fb7f-4dce-8a97-591e47114a94 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "e0a58d05-9dff-4590-a240-64826fc8243e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.745s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:15 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Snapshot image upload complete
Nov 02 17:39:15 user nova-compute[74980]: DEBUG nova.compute.manager [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:39:15 user nova-compute[74980]: INFO nova.compute.manager [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Shelve offloading
Nov 02 17:39:15 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Instance destroyed successfully.
Nov 02 17:39:15 user nova-compute[74980]: DEBUG nova.compute.manager [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:39:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:39:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquired lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:39:15 user nova-compute[74980]: DEBUG nova.network.neutron [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG nova.network.neutron [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Updating instance_info_cache with network_info: [{"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Releasing lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:16 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Instance destroyed successfully.
Nov 02 17:39:16 user nova-compute[74980]: DEBUG nova.objects.instance [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lazy-loading 'resources' on Instance uuid b774dda1-5000-4323-aaee-24e9a4029617 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1725912966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1725912966',id=31,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAZ17h7BgjKLxayL4IULgvz69q0ubD3+/FIejtFzmXMm9MT0Q3A7LFHZOmkzYCIb3IhyQexjD0uZ7nJlfpErVS87eBHrOqOw2GrQ5LYutL7QUVe8umSQ8yBmUtiSWCgkw==',key_name='tempest-keypair-679286581',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:37:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ccb03b0bde444fbc82be742d0027c0ec',ramdisk_id='',reservation_id='r-rwm0tx71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1991165793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1991165793-project-member',shelved_at='2023-11-02T17:39:15.597287',shelved_host='user',shelved_image_id='658bd214-b9fe-42e9-bfbd-0a05b0a955ea'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:39:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1f92dd53761465592b6d5390090f59f',uuid=b774dda1-5000-4323-aaee-24e9a4029617,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converting VIF {"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:ec:ff,bridge_name='br-int',has_traffic_filtering=True,id=1f4b9759-99d5-4507-b639-c9755c5da9c2,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4b9759-99') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG os_vif [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:ec:ff,bridge_name='br-int',has_traffic_filtering=True,id=1f4b9759-99d5-4507-b639-c9755c5da9c2,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4b9759-99') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f4b9759-99, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef3d7ee0-fadc-46e1-b8ad-091397ede14e) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-e5ee019a-1e3c-468d-b5b4-aa539f8c403b req-742864a8-1804-415e-b780-f7eb8d9ca599 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-changed-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-e5ee019a-1e3c-468d-b5b4-aa539f8c403b req-742864a8-1804-415e-b780-f7eb8d9ca599 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Refreshing instance network info cache due to event network-changed-1f4b9759-99d5-4507-b639-c9755c5da9c2. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e5ee019a-1e3c-468d-b5b4-aa539f8c403b req-742864a8-1804-415e-b780-f7eb8d9ca599 service nova] Acquiring lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e5ee019a-1e3c-468d-b5b4-aa539f8c403b req-742864a8-1804-415e-b780-f7eb8d9ca599 service nova] Acquired lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:39:16 user nova-compute[74980]: DEBUG nova.network.neutron [req-e5ee019a-1e3c-468d-b5b4-aa539f8c403b req-742864a8-1804-415e-b780-f7eb8d9ca599 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Refreshing network info cache for port 1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:39:16 user nova-compute[74980]: INFO os_vif [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:ec:ff,bridge_name='br-int',has_traffic_filtering=True,id=1f4b9759-99d5-4507-b639-c9755c5da9c2,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4b9759-99')
Nov 02 17:39:16 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Deleting instance files /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617_del
Nov 02 17:39:16 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Deletion of /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617_del complete
Nov 02 17:39:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "e0a58d05-9dff-4590-a240-64826fc8243e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "e0a58d05-9dff-4590-a240-64826fc8243e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:17 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Deleted allocations for instance b774dda1-5000-4323-aaee-24e9a4029617
Nov 02 17:39:17 user nova-compute[74980]: INFO nova.compute.manager [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Detaching volume 89f8091a-b8d6-45f2-83e3-6030cadf294d
Nov 02 17:39:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:17 user nova-compute[74980]: DEBUG nova.objects.instance [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lazy-loading 'numa_topology' on Instance uuid b774dda1-5000-4323-aaee-24e9a4029617 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:39:17 user nova-compute[74980]: DEBUG nova.objects.base [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Object Instance<b774dda1-5000-4323-aaee-24e9a4029617> lazy-loaded attributes: resources,numa_topology {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:39:17 user nova-compute[74980]: INFO nova.virt.block_device [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Attempting to driver detach volume 89f8091a-b8d6-45f2-83e3-6030cadf294d from mountpoint /dev/vdb
Nov 02 17:39:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Attempting to detach device vdb from instance e0a58d05-9dff-4590-a240-64826fc8243e from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:39:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:39:17 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:39:17 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:39:17 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:39:17 user nova-compute[74980]:   <serial>89f8091a-b8d6-45f2-83e3-6030cadf294d</serial>
Nov 02 17:39:17 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:39:17 user nova-compute[74980]: </disk>
Nov 02 17:39:17 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:39:17 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Successfully detached device vdb from instance e0a58d05-9dff-4590-a240-64826fc8243e from the persistent domain config.
Nov 02 17:39:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e0a58d05-9dff-4590-a240-64826fc8243e from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:39:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:39:17 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:39:17 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:39:17 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:39:17 user nova-compute[74980]:   <serial>89f8091a-b8d6-45f2-83e3-6030cadf294d</serial>
Nov 02 17:39:17 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:39:17 user nova-compute[74980]: </disk>
Nov 02 17:39:17 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:39:17 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:39:17 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:39:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:17 user nova-compute[74980]: DEBUG nova.network.neutron [req-e5ee019a-1e3c-468d-b5b4-aa539f8c403b req-742864a8-1804-415e-b780-f7eb8d9ca599 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Updated VIF entry in instance network info cache for port 1f4b9759-99d5-4507-b639-c9755c5da9c2. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:39:17 user nova-compute[74980]: DEBUG nova.network.neutron [req-e5ee019a-1e3c-468d-b5b4-aa539f8c403b req-742864a8-1804-415e-b780-f7eb8d9ca599 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Updating instance_info_cache with network_info: [{"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1f4b9759-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:39:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e5ee019a-1e3c-468d-b5b4-aa539f8c403b req-742864a8-1804-415e-b780-f7eb8d9ca599 service nova] Releasing lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:39:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-3ee0c79f-0dbb-41af-893c-fdf6e9baa2a5 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "b774dda1-5000-4323-aaee-24e9a4029617" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.186s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e0a58d05-9dff-4590-a240-64826fc8243e {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:39:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:20 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:39:20 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:39:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:39:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:39:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:39:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:24 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:39:24 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:39:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8146MB free_disk=25.156482696533203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:39:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:39:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:39:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e0a58d05-9dff-4590-a240-64826fc8243e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:39:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 3d5b4f62-2d45-434f-bfc3-a626930b3168 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:39:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 1618e41d-a1b2-44f0-af30-e151d30a95a3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:39:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:39:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:39:24 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:39:24 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:39:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:39:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:27 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:39:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:39:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Didn't find any instances for network info cache update. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 17:39:27 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:39:27 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:39:29 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:39:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:37 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e0a58d05-9dff-4590-a240-64826fc8243e is timed out.
Nov 02 17:39:37 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Successfully detached device vdb from instance e0a58d05-9dff-4590-a240-64826fc8243e from the live domain config.
Nov 02 17:39:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hBEtfOUz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:39:37 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c8c3f3-dc39-4c01-87e1-edba282bb4c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:39:37 user nova-compute[74980]: No targets found.
Nov 02 17:39:37 user nova-compute[74980]: iSNS:
Nov 02 17:39:37 user nova-compute[74980]: No targets found.
Nov 02 17:39:37 user nova-compute[74980]: STATIC:
Nov 02 17:39:37 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d
Nov 02 17:39:37 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:39:37 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:39:37 user nova-compute[74980]: FIRMWARE:
Nov 02 17:39:37 user nova-compute[74980]: No targets found.
Nov 02 17:39:37 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:39:37 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:39:37 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[17501bad-833a-4460-8d53-95149422b123]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[22171f79-72a2-48eb-9488-63a43d960498]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d (non-flash)
Nov 02 17:39:37 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d (non-flash)
Nov 02 17:39:37 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b4409c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc01355-366d-4b62-a745-489ec53b47d1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf5eedf-7e25-486f-9ccf-8fc4c3fe9144]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb2b77f-6906-49f3-8d2a-699ac710cb72]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94a7fe8-94f4-4983-a3ca-49c435cc7b52]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f91076-deeb-4d4d-a59c-9549d9f5f939]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4d9000-260a-4d04-8f40-671dd90875b1]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d, portal: 172.16.0.220,3260]
Nov 02 17:39:37 user nova-compute[74980]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d, portal: 172.16.0.220,3260] successful.
Nov 02 17:39:37 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f8091a-b8d6-45f2-83e3-6030cadf294d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d62acb5-003c-463f-b672-6b27d2ef0953]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] <== disconnect_volume: return (317ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:39:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:39:38 user nova-compute[74980]: DEBUG nova.objects.instance [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lazy-loading 'flavor' on Instance uuid e0a58d05-9dff-4590-a240-64826fc8243e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:39:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-92cb8e5f-f75e-41b9-9292-309913b683d8 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "e0a58d05-9dff-4590-a240-64826fc8243e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.769s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG nova.objects.instance [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lazy-loading 'flavor' on Instance uuid 3d5b4f62-2d45-434f-bfc3-a626930b3168 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:44 user nova-compute[74980]: INFO nova.compute.manager [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Attaching volume 81ab47ad-734a-4db0-9a1b-85a60bcf1b16 to /dev/vdb
Nov 02 17:39:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG os_brick.utils [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5e4808-383d-4f7c-b7c4-dbaba891c875]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac4f490-a6ce-434e-9779-715b710f9a33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ab14a1-1ce6-40b0-97d3-4aae758f9448]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a032d5-395a-4304-910e-e7fba4348f25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:39:44 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:39:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02355f4-1f74-437c-8cc9-3af2e869e0ba]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG os_brick.utils [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:39:44 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Updating existing volume attachment record: d68d44f2-8540-4abd-b0fc-53c096896fbd {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:39:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Acquiring lock "1618e41d-a1b2-44f0-af30-e151d30a95a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "1618e41d-a1b2-44f0-af30-e151d30a95a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Acquiring lock "1618e41d-a1b2-44f0-af30-e151d30a95a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "1618e41d-a1b2-44f0-af30-e151d30a95a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "1618e41d-a1b2-44f0-af30-e151d30a95a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:47 user nova-compute[74980]: INFO nova.compute.manager [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Terminating instance
Nov 02 17:39:47 user nova-compute[74980]: DEBUG nova.compute.manager [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG nova.compute.manager [req-2fb1af18-4ff2-48da-aa75-8f20dfaf5bed req-45640c7e-c919-4553-ab38-eab5db37f812 service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Received event network-vif-unplugged-4a6d2306-3088-4587-a990-aa23e4b821df {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2fb1af18-4ff2-48da-aa75-8f20dfaf5bed req-45640c7e-c919-4553-ab38-eab5db37f812 service nova] Acquiring lock "1618e41d-a1b2-44f0-af30-e151d30a95a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2fb1af18-4ff2-48da-aa75-8f20dfaf5bed req-45640c7e-c919-4553-ab38-eab5db37f812 service nova] Lock "1618e41d-a1b2-44f0-af30-e151d30a95a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2fb1af18-4ff2-48da-aa75-8f20dfaf5bed req-45640c7e-c919-4553-ab38-eab5db37f812 service nova] Lock "1618e41d-a1b2-44f0-af30-e151d30a95a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG nova.compute.manager [req-2fb1af18-4ff2-48da-aa75-8f20dfaf5bed req-45640c7e-c919-4553-ab38-eab5db37f812 service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] No waiting events found dispatching network-vif-unplugged-4a6d2306-3088-4587-a990-aa23e4b821df {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG nova.compute.manager [req-2fb1af18-4ff2-48da-aa75-8f20dfaf5bed req-45640c7e-c919-4553-ab38-eab5db37f812 service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Received event network-vif-unplugged-4a6d2306-3088-4587-a990-aa23e4b821df for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:39:48 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Instance destroyed successfully.
Nov 02 17:39:48 user nova-compute[74980]: DEBUG nova.objects.instance [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lazy-loading 'resources' on Instance uuid 1618e41d-a1b2-44f0-af30-e151d30a95a3 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1796302382',display_name='tempest-VolumesNegativeTest-instance-1796302382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1796302382',id=33,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:38:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='891673f4e7f54c14a34fe042eae3c2d4',ramdisk_id='',reservation_id='r-sodytyp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-784513807',owner_user_name='tempest-VolumesNegativeTest-784513807-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:38:04Z,user_data=None,user_id='ee53096ca1a8457cbeaa336b424ba457',uuid=1618e41d-a1b2-44f0-af30-e151d30a95a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a6d2306-3088-4587-a990-aa23e4b821df", "address": "fa:16:3e:a9:e0:eb", "network": {"id": "66437e03-c8f3-4f77-8a8b-2987d39a83d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0506163bacd94766bee5ce28755ea623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6d2306-30", "ovs_interfaceid": "4a6d2306-3088-4587-a990-aa23e4b821df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Converting VIF {"id": "4a6d2306-3088-4587-a990-aa23e4b821df", "address": "fa:16:3e:a9:e0:eb", "network": {"id": "66437e03-c8f3-4f77-8a8b-2987d39a83d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0506163bacd94766bee5ce28755ea623", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6d2306-30", "ovs_interfaceid": "4a6d2306-3088-4587-a990-aa23e4b821df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e0:eb,bridge_name='br-int',has_traffic_filtering=True,id=4a6d2306-3088-4587-a990-aa23e4b821df,network=Network(66437e03-c8f3-4f77-8a8b-2987d39a83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6d2306-30') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG os_vif [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e0:eb,bridge_name='br-int',has_traffic_filtering=True,id=4a6d2306-3088-4587-a990-aa23e4b821df,network=Network(66437e03-c8f3-4f77-8a8b-2987d39a83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6d2306-30') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a6d2306-30, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc929276-98c3-4697-948b-fd468aecea92) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:39:48 user nova-compute[74980]: INFO os_vif [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e0:eb,bridge_name='br-int',has_traffic_filtering=True,id=4a6d2306-3088-4587-a990-aa23e4b821df,network=Network(66437e03-c8f3-4f77-8a8b-2987d39a83d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6d2306-30')
Nov 02 17:39:48 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Deleting instance files /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3_del
Nov 02 17:39:48 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Deletion of /opt/stack/data/nova/instances/1618e41d-a1b2-44f0-af30-e151d30a95a3_del complete
Nov 02 17:39:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "a1f33052-902f-44ef-b758-67cfc144416c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "a1f33052-902f-44ef-b758-67cfc144416c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:48 user nova-compute[74980]: INFO nova.compute.manager [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 02 17:39:48 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:48 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:39:48 user nova-compute[74980]: INFO nova.compute.claims [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Claim successful on node user
Nov 02 17:39:49 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG nova.network.neutron [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:39:49 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:39:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:39:49 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Creating image(s)
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "/opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "/opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG nova.policy [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fef01429fb294195984431fd3699f78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11e1bb23618243ddb099bc6855aa2f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.192s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:39:49 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Took 1.13 seconds to deallocate network for instance.
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk 1073741824" returned: 0 in 0.058s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.205s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG nova.network.neutron [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Successfully created port: fb6fd444-023b-4b51-b56c-e5fc136d6a53 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Cannot resize image /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Ensure instance console log exists: /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG nova.compute.manager [req-c038b952-f715-4f75-969f-9d57f1090195 req-566b4d50-35a6-4186-bf7a-5f8d77a43a7a service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Received event network-vif-plugged-4a6d2306-3088-4587-a990-aa23e4b821df {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c038b952-f715-4f75-969f-9d57f1090195 req-566b4d50-35a6-4186-bf7a-5f8d77a43a7a service nova] Acquiring lock "1618e41d-a1b2-44f0-af30-e151d30a95a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c038b952-f715-4f75-969f-9d57f1090195 req-566b4d50-35a6-4186-bf7a-5f8d77a43a7a service nova] Lock "1618e41d-a1b2-44f0-af30-e151d30a95a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c038b952-f715-4f75-969f-9d57f1090195 req-566b4d50-35a6-4186-bf7a-5f8d77a43a7a service nova] Lock "1618e41d-a1b2-44f0-af30-e151d30a95a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG nova.compute.manager [req-c038b952-f715-4f75-969f-9d57f1090195 req-566b4d50-35a6-4186-bf7a-5f8d77a43a7a service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] No waiting events found dispatching network-vif-plugged-4a6d2306-3088-4587-a990-aa23e4b821df {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:39:50 user nova-compute[74980]: WARNING nova.compute.manager [req-c038b952-f715-4f75-969f-9d57f1090195 req-566b4d50-35a6-4186-bf7a-5f8d77a43a7a service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Received unexpected event network-vif-plugged-4a6d2306-3088-4587-a990-aa23e4b821df for instance with vm_state deleted and task_state None.
Nov 02 17:39:50 user nova-compute[74980]: DEBUG nova.compute.manager [req-c038b952-f715-4f75-969f-9d57f1090195 req-566b4d50-35a6-4186-bf7a-5f8d77a43a7a service nova] [instance: 1618e41d-a1b2-44f0-af30-e151d30a95a3] Received event network-vif-deleted-4a6d2306-3088-4587-a990-aa23e4b821df {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:39:50 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Deleted allocations for instance 1618e41d-a1b2-44f0-af30-e151d30a95a3
Nov 02 17:39:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-478a3f86-ee76-4641-a429-6506aee7fe04 tempest-VolumesNegativeTest-784513807 tempest-VolumesNegativeTest-784513807-project-member] Lock "1618e41d-a1b2-44f0-af30-e151d30a95a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.513s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG nova.network.neutron [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Successfully updated port: fb6fd444-023b-4b51-b56c-e5fc136d6a53 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquired lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG nova.network.neutron [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:39:50 user nova-compute[74980]: DEBUG nova.network.neutron [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.network.neutron [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Updating instance_info_cache with network_info: [{"id": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "address": "fa:16:3e:7c:b8:1b", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6fd444-02", "ovs_interfaceid": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Releasing lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Instance network_info: |[{"id": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "address": "fa:16:3e:7c:b8:1b", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6fd444-02", "ovs_interfaceid": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Start _get_guest_xml network_info=[{"id": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "address": "fa:16:3e:7c:b8:1b", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6fd444-02", "ovs_interfaceid": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:39:51 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:39:51 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1219821736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1219821736',id=34,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11e1bb23618243ddb099bc6855aa2f64',ramdisk_id='',reservation_id='r-k14uvbf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-36491096',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:39:49Z,user_data=None,user_id='fef01429fb294195984431fd3699f78b',uuid=a1f33052-902f-44ef-b758-67cfc144416c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "address": "fa:16:3e:7c:b8:1b", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6fd444-02", "ovs_interfaceid": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converting VIF {"id": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "address": "fa:16:3e:7c:b8:1b", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6fd444-02", "ovs_interfaceid": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b8:1b,bridge_name='br-int',has_traffic_filtering=True,id=fb6fd444-023b-4b51-b56c-e5fc136d6a53,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6fd444-02') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.objects.instance [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'pci_devices' on Instance uuid a1f33052-902f-44ef-b758-67cfc144416c {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:39:51 user nova-compute[74980]:   <uuid>a1f33052-902f-44ef-b758-67cfc144416c</uuid>
Nov 02 17:39:51 user nova-compute[74980]:   <name>instance-00000022</name>
Nov 02 17:39:51 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:39:51 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:39:51 user nova-compute[74980]:   <metadata>
Nov 02 17:39:51 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:39:51 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:39:51 user nova-compute[74980]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1219821736</nova:name>
Nov 02 17:39:51 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:39:51</nova:creationTime>
Nov 02 17:39:51 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:39:51 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:39:51 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:39:51 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:39:51 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:39:51 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:39:51 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:39:51 user nova-compute[74980]:       <nova:owner>
Nov 02 17:39:51 user nova-compute[74980]:         <nova:user uuid="fef01429fb294195984431fd3699f78b">tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member</nova:user>
Nov 02 17:39:51 user nova-compute[74980]:         <nova:project uuid="11e1bb23618243ddb099bc6855aa2f64">tempest-ServerBootFromVolumeStableRescueTest-36491096</nova:project>
Nov 02 17:39:51 user nova-compute[74980]:       </nova:owner>
Nov 02 17:39:51 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:39:51 user nova-compute[74980]:       <nova:ports>
Nov 02 17:39:51 user nova-compute[74980]:         <nova:port uuid="fb6fd444-023b-4b51-b56c-e5fc136d6a53">
Nov 02 17:39:51 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 17:39:51 user nova-compute[74980]:         </nova:port>
Nov 02 17:39:51 user nova-compute[74980]:       </nova:ports>
Nov 02 17:39:51 user nova-compute[74980]:     </nova:instance>
Nov 02 17:39:51 user nova-compute[74980]:   </metadata>
Nov 02 17:39:51 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:39:51 user nova-compute[74980]:     <system>
Nov 02 17:39:51 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:39:51 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:39:51 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:39:51 user nova-compute[74980]:       <entry name="serial">a1f33052-902f-44ef-b758-67cfc144416c</entry>
Nov 02 17:39:51 user nova-compute[74980]:       <entry name="uuid">a1f33052-902f-44ef-b758-67cfc144416c</entry>
Nov 02 17:39:51 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:39:51 user nova-compute[74980]:     </system>
Nov 02 17:39:51 user nova-compute[74980]:   </sysinfo>
Nov 02 17:39:51 user nova-compute[74980]:   <os>
Nov 02 17:39:51 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:39:51 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:39:51 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:39:51 user nova-compute[74980]:   </os>
Nov 02 17:39:51 user nova-compute[74980]:   <features>
Nov 02 17:39:51 user nova-compute[74980]:     <acpi/>
Nov 02 17:39:51 user nova-compute[74980]:     <apic/>
Nov 02 17:39:51 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:39:51 user nova-compute[74980]:   </features>
Nov 02 17:39:51 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:39:51 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:39:51 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:39:51 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:39:51 user nova-compute[74980]:   </clock>
Nov 02 17:39:51 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:39:51 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:39:51 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:39:51 user nova-compute[74980]:   </cpu>
Nov 02 17:39:51 user nova-compute[74980]:   <devices>
Nov 02 17:39:51 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:39:51 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:39:51 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk"/>
Nov 02 17:39:51 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:39:51 user nova-compute[74980]:     </disk>
Nov 02 17:39:51 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:39:51 user nova-compute[74980]:       <mac address="fa:16:3e:7c:b8:1b"/>
Nov 02 17:39:51 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:39:51 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:39:51 user nova-compute[74980]:       <target dev="tapfb6fd444-02"/>
Nov 02 17:39:51 user nova-compute[74980]:     </interface>
Nov 02 17:39:51 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:39:51 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/console.log" append="off"/>
Nov 02 17:39:51 user nova-compute[74980]:     </serial>
Nov 02 17:39:51 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:39:51 user nova-compute[74980]:     <video>
Nov 02 17:39:51 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:39:51 user nova-compute[74980]:     </video>
Nov 02 17:39:51 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:39:51 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:39:51 user nova-compute[74980]:     </rng>
Nov 02 17:39:51 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:39:51 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:39:51 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:39:51 user nova-compute[74980]:     </memballoon>
Nov 02 17:39:51 user nova-compute[74980]:   </devices>
Nov 02 17:39:51 user nova-compute[74980]: </domain>
Nov 02 17:39:51 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1219821736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1219821736',id=34,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11e1bb23618243ddb099bc6855aa2f64',ramdisk_id='',reservation_id='r-k14uvbf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-36491096',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:39:49Z,user_data=None,user_id='fef01429fb294195984431fd3699f78b',uuid=a1f33052-902f-44ef-b758-67cfc144416c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "address": "fa:16:3e:7c:b8:1b", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6fd444-02", "ovs_interfaceid": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converting VIF {"id": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "address": "fa:16:3e:7c:b8:1b", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6fd444-02", "ovs_interfaceid": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b8:1b,bridge_name='br-int',has_traffic_filtering=True,id=fb6fd444-023b-4b51-b56c-e5fc136d6a53,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6fd444-02') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG os_vif [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b8:1b,bridge_name='br-int',has_traffic_filtering=True,id=fb6fd444-023b-4b51-b56c-e5fc136d6a53,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6fd444-02') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da765dd9-c153-52b2-af34-2384a4288a53', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb6fd444-02, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb6fd444-02, col_values=(('qos', UUID('ecdc47a2-5696-4ce9-8e93-ba2c9ef1e142')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb6fd444-02, col_values=(('external_ids', {'iface-id': 'fb6fd444-023b-4b51-b56c-e5fc136d6a53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:b8:1b', 'vm-uuid': 'a1f33052-902f-44ef-b758-67cfc144416c'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:51 user nova-compute[74980]: INFO os_vif [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b8:1b,bridge_name='br-int',has_traffic_filtering=True,id=fb6fd444-023b-4b51-b56c-e5fc136d6a53,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6fd444-02')
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:39:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] No VIF found with MAC fa:16:3e:7c:b8:1b, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:39:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-548b5247-b8cc-4234-b3dd-2302f49655b3 req-fe6c6976-9b7f-4873-9ec9-db2901992d0a service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Received event network-changed-fb6fd444-023b-4b51-b56c-e5fc136d6a53 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:39:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-548b5247-b8cc-4234-b3dd-2302f49655b3 req-fe6c6976-9b7f-4873-9ec9-db2901992d0a service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Refreshing instance network info cache due to event network-changed-fb6fd444-023b-4b51-b56c-e5fc136d6a53. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:39:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-548b5247-b8cc-4234-b3dd-2302f49655b3 req-fe6c6976-9b7f-4873-9ec9-db2901992d0a service nova] Acquiring lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:39:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-548b5247-b8cc-4234-b3dd-2302f49655b3 req-fe6c6976-9b7f-4873-9ec9-db2901992d0a service nova] Acquired lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:39:52 user nova-compute[74980]: DEBUG nova.network.neutron [req-548b5247-b8cc-4234-b3dd-2302f49655b3 req-fe6c6976-9b7f-4873-9ec9-db2901992d0a service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Refreshing network info cache for port fb6fd444-023b-4b51-b56c-e5fc136d6a53 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:39:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:52 user nova-compute[74980]: DEBUG nova.network.neutron [req-548b5247-b8cc-4234-b3dd-2302f49655b3 req-fe6c6976-9b7f-4873-9ec9-db2901992d0a service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Updated VIF entry in instance network info cache for port fb6fd444-023b-4b51-b56c-e5fc136d6a53. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:39:52 user nova-compute[74980]: DEBUG nova.network.neutron [req-548b5247-b8cc-4234-b3dd-2302f49655b3 req-fe6c6976-9b7f-4873-9ec9-db2901992d0a service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Updating instance_info_cache with network_info: [{"id": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "address": "fa:16:3e:7c:b8:1b", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6fd444-02", "ovs_interfaceid": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:39:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-548b5247-b8cc-4234-b3dd-2302f49655b3 req-fe6c6976-9b7f-4873-9ec9-db2901992d0a service nova] Releasing lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:39:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-3472e85e-a60c-4791-aa56-6d1ddda3813e req-001ce507-3b59-4137-84ca-c53e26f90464 service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Received event network-vif-plugged-fb6fd444-023b-4b51-b56c-e5fc136d6a53 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3472e85e-a60c-4791-aa56-6d1ddda3813e req-001ce507-3b59-4137-84ca-c53e26f90464 service nova] Acquiring lock "a1f33052-902f-44ef-b758-67cfc144416c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3472e85e-a60c-4791-aa56-6d1ddda3813e req-001ce507-3b59-4137-84ca-c53e26f90464 service nova] Lock "a1f33052-902f-44ef-b758-67cfc144416c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3472e85e-a60c-4791-aa56-6d1ddda3813e req-001ce507-3b59-4137-84ca-c53e26f90464 service nova] Lock "a1f33052-902f-44ef-b758-67cfc144416c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-3472e85e-a60c-4791-aa56-6d1ddda3813e req-001ce507-3b59-4137-84ca-c53e26f90464 service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] No waiting events found dispatching network-vif-plugged-fb6fd444-023b-4b51-b56c-e5fc136d6a53 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:39:54 user nova-compute[74980]: WARNING nova.compute.manager [req-3472e85e-a60c-4791-aa56-6d1ddda3813e req-001ce507-3b59-4137-84ca-c53e26f90464 service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Received unexpected event network-vif-plugged-fb6fd444-023b-4b51-b56c-e5fc136d6a53 for instance with vm_state building and task_state spawning.
Nov 02 17:39:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-3472e85e-a60c-4791-aa56-6d1ddda3813e req-001ce507-3b59-4137-84ca-c53e26f90464 service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Received event network-vif-plugged-fb6fd444-023b-4b51-b56c-e5fc136d6a53 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3472e85e-a60c-4791-aa56-6d1ddda3813e req-001ce507-3b59-4137-84ca-c53e26f90464 service nova] Acquiring lock "a1f33052-902f-44ef-b758-67cfc144416c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3472e85e-a60c-4791-aa56-6d1ddda3813e req-001ce507-3b59-4137-84ca-c53e26f90464 service nova] Lock "a1f33052-902f-44ef-b758-67cfc144416c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3472e85e-a60c-4791-aa56-6d1ddda3813e req-001ce507-3b59-4137-84ca-c53e26f90464 service nova] Lock "a1f33052-902f-44ef-b758-67cfc144416c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-3472e85e-a60c-4791-aa56-6d1ddda3813e req-001ce507-3b59-4137-84ca-c53e26f90464 service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] No waiting events found dispatching network-vif-plugged-fb6fd444-023b-4b51-b56c-e5fc136d6a53 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:39:54 user nova-compute[74980]: WARNING nova.compute.manager [req-3472e85e-a60c-4791-aa56-6d1ddda3813e req-001ce507-3b59-4137-84ca-c53e26f90464 service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Received unexpected event network-vif-plugged-fb6fd444-023b-4b51-b56c-e5fc136d6a53 for instance with vm_state building and task_state spawning.
Nov 02 17:39:54 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:39:54 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Instance spawned successfully.
Nov 02 17:39:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:39:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:39:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:39:55 user nova-compute[74980]: INFO nova.compute.manager [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 02 17:39:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:39:55 user nova-compute[74980]: INFO nova.compute.manager [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Took 6.41 seconds to build instance.
Nov 02 17:39:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4e9bccef-c46d-4cb7-b394-ad93cedfd46c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "a1f33052-902f-44ef-b758-67cfc144416c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.505s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:39:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SagYcsHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:40:05 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:40:05 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:40:05 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b364f774-f8e8-4e27-9ca5-78ab74dd1be2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:40:05 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f267179f-af34-45b2-9a2c-eeb1d6faeae7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16] added
Nov 02 17:40:05 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d69c46-eef8-4988-9639-dfd897b9a938]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dbdd5e-7e9d-40b5-87f6-57f73abba087]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SagYcsHU {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SagYcsHU" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a50852b-2f0c-4567-beea-a04eaa62a83f]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SagYcsHU'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f859d1-188f-41a1-98bf-14a33f2449a1]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9116d711-1e57-41e0-8af4-e56b3fab08fe]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:40:05 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:40:05 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:40:05 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 17:40:05 user nova-compute[74980]: 
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[18645c1e-9eaa-41db-8318-587dede132b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16, portal: 172.16.0.220,3260]
Nov 02 17:40:05 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16, portal: 172.16.0.220,3260] successful.
Nov 02 17:40:05 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b60f72-6611-4f11-9b10-147cf22bf540]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[34803ccc-3a0b-4646-a0ed-33dad1f3394e]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 (non-flash)
Nov 02 17:40:05 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 (non-flash)
Nov 02 17:40:05 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae8125d-b9f0-4a4e-a4dd-f3ee145adb7d]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:40:05 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:40:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:40:06 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:40:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SagYcsHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:40:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:40:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23166313934306364', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:40:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166313934306364', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:40:06 user nova-compute[74980]: DEBUG nova.objects.instance [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lazy-loading 'flavor' on Instance uuid 3d5b4f62-2d45-434f-bfc3-a626930b3168 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:40:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:40:06 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:40:06 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:40:06 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:40:06 user nova-compute[74980]:   <serial>81ab47ad-734a-4db0-9a1b-85a60bcf1b16</serial>
Nov 02 17:40:06 user nova-compute[74980]: </disk>
Nov 02 17:40:06 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:40:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:40:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:40:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] No VIF found with MAC fa:16:3e:b4:62:19, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:40:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-50750157-35e9-407f-b77a-e5aa6dbc5bca tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.435s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-c264f410-1531-4677-ac80-e512ee68b5d8 req-498e147c-b1fe-456c-9d11-ca2eab7d0073 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received event network-changed-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:40:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-c264f410-1531-4677-ac80-e512ee68b5d8 req-498e147c-b1fe-456c-9d11-ca2eab7d0073 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Refreshing instance network info cache due to event network-changed-cceec27b-26b9-4954-b5f7-3ca024d6862d. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:40:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c264f410-1531-4677-ac80-e512ee68b5d8 req-498e147c-b1fe-456c-9d11-ca2eab7d0073 service nova] Acquiring lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:40:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c264f410-1531-4677-ac80-e512ee68b5d8 req-498e147c-b1fe-456c-9d11-ca2eab7d0073 service nova] Acquired lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:40:09 user nova-compute[74980]: DEBUG nova.network.neutron [req-c264f410-1531-4677-ac80-e512ee68b5d8 req-498e147c-b1fe-456c-9d11-ca2eab7d0073 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Refreshing network info cache for port cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:40:09 user nova-compute[74980]: DEBUG nova.network.neutron [req-c264f410-1531-4677-ac80-e512ee68b5d8 req-498e147c-b1fe-456c-9d11-ca2eab7d0073 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Updated VIF entry in instance network info cache for port cceec27b-26b9-4954-b5f7-3ca024d6862d. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:40:09 user nova-compute[74980]: DEBUG nova.network.neutron [req-c264f410-1531-4677-ac80-e512ee68b5d8 req-498e147c-b1fe-456c-9d11-ca2eab7d0073 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Updating instance_info_cache with network_info: [{"id": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "address": "fa:16:3e:b4:62:19", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceec27b-26", "ovs_interfaceid": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:40:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c264f410-1531-4677-ac80-e512ee68b5d8 req-498e147c-b1fe-456c-9d11-ca2eab7d0073 service nova] Releasing lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:40:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-da75ba0f-71d3-4060-911e-1348180de29c req-bc1f125b-1490-4318-a9b9-3b966a7a0de6 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received event network-changed-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:40:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-da75ba0f-71d3-4060-911e-1348180de29c req-bc1f125b-1490-4318-a9b9-3b966a7a0de6 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Refreshing instance network info cache due to event network-changed-cceec27b-26b9-4954-b5f7-3ca024d6862d. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:40:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da75ba0f-71d3-4060-911e-1348180de29c req-bc1f125b-1490-4318-a9b9-3b966a7a0de6 service nova] Acquiring lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:40:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da75ba0f-71d3-4060-911e-1348180de29c req-bc1f125b-1490-4318-a9b9-3b966a7a0de6 service nova] Acquired lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:40:11 user nova-compute[74980]: DEBUG nova.network.neutron [req-da75ba0f-71d3-4060-911e-1348180de29c req-bc1f125b-1490-4318-a9b9-3b966a7a0de6 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Refreshing network info cache for port cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:40:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-affa4946-55ed-4b4a-83be-2ce25d03ca49 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-affa4946-55ed-4b4a-83be-2ce25d03ca49 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:11 user nova-compute[74980]: INFO nova.compute.manager [None req-affa4946-55ed-4b4a-83be-2ce25d03ca49 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Rebooting instance
Nov 02 17:40:11 user nova-compute[74980]: DEBUG nova.network.neutron [req-da75ba0f-71d3-4060-911e-1348180de29c req-bc1f125b-1490-4318-a9b9-3b966a7a0de6 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Updated VIF entry in instance network info cache for port cceec27b-26b9-4954-b5f7-3ca024d6862d. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:40:11 user nova-compute[74980]: DEBUG nova.network.neutron [req-da75ba0f-71d3-4060-911e-1348180de29c req-bc1f125b-1490-4318-a9b9-3b966a7a0de6 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Updating instance_info_cache with network_info: [{"id": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "address": "fa:16:3e:b4:62:19", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceec27b-26", "ovs_interfaceid": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:40:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-affa4946-55ed-4b4a-83be-2ce25d03ca49 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:40:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da75ba0f-71d3-4060-911e-1348180de29c req-bc1f125b-1490-4318-a9b9-3b966a7a0de6 service nova] Releasing lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:40:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-affa4946-55ed-4b4a-83be-2ce25d03ca49 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquired lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:40:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-affa4946-55ed-4b4a-83be-2ce25d03ca49 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:40:12 user nova-compute[74980]: DEBUG nova.network.neutron [None req-affa4946-55ed-4b4a-83be-2ce25d03ca49 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Updating instance_info_cache with network_info: [{"id": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "address": "fa:16:3e:b4:62:19", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceec27b-26", "ovs_interfaceid": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:40:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-affa4946-55ed-4b4a-83be-2ce25d03ca49 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Releasing lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:40:12 user nova-compute[74980]: DEBUG nova.compute.manager [None req-affa4946-55ed-4b4a-83be-2ce25d03ca49 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:40:13 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:40:13 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:40:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-57252fa9-fac7-487d-824f-93c2f280b053 req-b26a12d6-27a7-4c68-a303-15987ee7884a service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received event network-vif-unplugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:40:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-57252fa9-fac7-487d-824f-93c2f280b053 req-b26a12d6-27a7-4c68-a303-15987ee7884a service nova] Acquiring lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-57252fa9-fac7-487d-824f-93c2f280b053 req-b26a12d6-27a7-4c68-a303-15987ee7884a service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-57252fa9-fac7-487d-824f-93c2f280b053 req-b26a12d6-27a7-4c68-a303-15987ee7884a service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-57252fa9-fac7-487d-824f-93c2f280b053 req-b26a12d6-27a7-4c68-a303-15987ee7884a service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] No waiting events found dispatching network-vif-unplugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:40:14 user nova-compute[74980]: WARNING nova.compute.manager [req-57252fa9-fac7-487d-824f-93c2f280b053 req-b26a12d6-27a7-4c68-a303-15987ee7884a service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received unexpected event network-vif-unplugged-cceec27b-26b9-4954-b5f7-3ca024d6862d for instance with vm_state active and task_state reboot_started.
Nov 02 17:40:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:15 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-affa4946-55ed-4b4a-83be-2ce25d03ca49 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Instance shutdown successfully.
Nov 02 17:40:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-d3adefeb-4dd2-45c1-a175-7aece2104d3e req-37bb94d3-1e6c-4455-8cc8-90a81bbe9444 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received event network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:40:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d3adefeb-4dd2-45c1-a175-7aece2104d3e req-37bb94d3-1e6c-4455-8cc8-90a81bbe9444 service nova] Acquiring lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d3adefeb-4dd2-45c1-a175-7aece2104d3e req-37bb94d3-1e6c-4455-8cc8-90a81bbe9444 service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d3adefeb-4dd2-45c1-a175-7aece2104d3e req-37bb94d3-1e6c-4455-8cc8-90a81bbe9444 service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-d3adefeb-4dd2-45c1-a175-7aece2104d3e req-37bb94d3-1e6c-4455-8cc8-90a81bbe9444 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] No waiting events found dispatching network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:40:16 user nova-compute[74980]: WARNING nova.compute.manager [req-d3adefeb-4dd2-45c1-a175-7aece2104d3e req-37bb94d3-1e6c-4455-8cc8-90a81bbe9444 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received unexpected event network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d for instance with vm_state active and task_state reboot_started.
Nov 02 17:40:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:17 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:40:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:18 user nova-compute[74980]: DEBUG nova.compute.manager [req-d85c47dc-b3aa-4c04-a8df-90f2f6b71b0c req-d0c5c2b2-2b2b-41d8-a6d4-dad890159b85 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received event network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:40:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d85c47dc-b3aa-4c04-a8df-90f2f6b71b0c req-d0c5c2b2-2b2b-41d8-a6d4-dad890159b85 service nova] Acquiring lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d85c47dc-b3aa-4c04-a8df-90f2f6b71b0c req-d0c5c2b2-2b2b-41d8-a6d4-dad890159b85 service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d85c47dc-b3aa-4c04-a8df-90f2f6b71b0c req-d0c5c2b2-2b2b-41d8-a6d4-dad890159b85 service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:18 user nova-compute[74980]: DEBUG nova.compute.manager [req-d85c47dc-b3aa-4c04-a8df-90f2f6b71b0c req-d0c5c2b2-2b2b-41d8-a6d4-dad890159b85 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] No waiting events found dispatching network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:40:18 user nova-compute[74980]: WARNING nova.compute.manager [req-d85c47dc-b3aa-4c04-a8df-90f2f6b71b0c req-d0c5c2b2-2b2b-41d8-a6d4-dad890159b85 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received unexpected event network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d for instance with vm_state active and task_state reboot_started.
Nov 02 17:40:18 user nova-compute[74980]: DEBUG nova.compute.manager [req-d85c47dc-b3aa-4c04-a8df-90f2f6b71b0c req-d0c5c2b2-2b2b-41d8-a6d4-dad890159b85 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received event network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:40:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d85c47dc-b3aa-4c04-a8df-90f2f6b71b0c req-d0c5c2b2-2b2b-41d8-a6d4-dad890159b85 service nova] Acquiring lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d85c47dc-b3aa-4c04-a8df-90f2f6b71b0c req-d0c5c2b2-2b2b-41d8-a6d4-dad890159b85 service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d85c47dc-b3aa-4c04-a8df-90f2f6b71b0c req-d0c5c2b2-2b2b-41d8-a6d4-dad890159b85 service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:18 user nova-compute[74980]: DEBUG nova.compute.manager [req-d85c47dc-b3aa-4c04-a8df-90f2f6b71b0c req-d0c5c2b2-2b2b-41d8-a6d4-dad890159b85 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] No waiting events found dispatching network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:40:18 user nova-compute[74980]: WARNING nova.compute.manager [req-d85c47dc-b3aa-4c04-a8df-90f2f6b71b0c req-d0c5c2b2-2b2b-41d8-a6d4-dad890159b85 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received unexpected event network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d for instance with vm_state active and task_state reboot_started.
Nov 02 17:40:19 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Instance running successfully.
Nov 02 17:40:19 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-affa4946-55ed-4b4a-83be-2ce25d03ca49 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Instance soft rebooted successfully.
Nov 02 17:40:19 user nova-compute[74980]: DEBUG nova.compute.manager [None req-affa4946-55ed-4b4a-83be-2ce25d03ca49 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:40:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-affa4946-55ed-4b4a-83be-2ce25d03ca49 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.622s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:19 user nova-compute[74980]: DEBUG nova.compute.manager [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:40:19 user nova-compute[74980]: INFO nova.compute.manager [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] instance snapshotting
Nov 02 17:40:19 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Beginning live snapshot process
Nov 02 17:40:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json -f qcow2 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json -f qcow2 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json -f qcow2" returned: 0 in 0.204s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.226s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu_zpnr00/fda8069772674b9ebbb7d27ef2690167.delta 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu_zpnr00/fda8069772674b9ebbb7d27ef2690167.delta 1073741824" returned: 0 in 0.049s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:20 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 17:40:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:40:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:40:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:40:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:40:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:40:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] COPY block job progress, current cursor: 26411008 final cursor: 75563008 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:40:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:40:22 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 17:40:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:22 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:40:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu_zpnr00/fda8069772674b9ebbb7d27ef2690167.delta /opt/stack/data/nova/instances/snapshots/tmpu_zpnr00/fda8069772674b9ebbb7d27ef2690167 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu_zpnr00/fda8069772674b9ebbb7d27ef2690167.delta /opt/stack/data/nova/instances/snapshots/tmpu_zpnr00/fda8069772674b9ebbb7d27ef2690167" returned: 0 in 0.587s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:23 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Snapshot extracted, beginning image upload
Nov 02 17:40:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:40:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:24 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:40:24 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:40:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8257MB free_disk=25.146469116210938GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:40:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:40:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:40:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e0a58d05-9dff-4590-a240-64826fc8243e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:40:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 3d5b4f62-2d45-434f-bfc3-a626930b3168 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:40:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:40:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:40:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:40:25 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:40:25 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:40:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:40:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:26 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Snapshot image upload complete
Nov 02 17:40:26 user nova-compute[74980]: INFO nova.compute.manager [None req-251140eb-2d50-41d8-9b4b-30ee3116ab3a tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Took 6.76 seconds to snapshot the instance on the hypervisor.
Nov 02 17:40:27 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:40:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:40:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 17:40:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:40:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:40:27 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:40:27 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid c6bfac8f-3834-4514-9a56-59c293ced966 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:40:28 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Updating instance_info_cache with network_info: [{"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:40:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:40:28 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:40:28 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:40:28 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:40:28 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "f2bd54ca-208e-4437-a875-ba1202589736" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "f2bd54ca-208e-4437-a875-ba1202589736" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:40:29 user nova-compute[74980]: INFO nova.compute.claims [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Claim successful on node user
Nov 02 17:40:29 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:40:29 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:40:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG nova.policy [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87f4ea9506264174bdbcd706e8cc877d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b461c7b3824820a1fd88721ddbebd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:40:29 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Creating image(s)
Nov 02 17:40:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "/opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "/opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4.part --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:31 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Successfully created port: c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:40:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4.part --force-share --output=json" returned: 0 in 0.191s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:31 user nova-compute[74980]: DEBUG nova.virt.images [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] d2f35379-a5bd-45c5-aa72-8da85b56baf1 was qcow2, converting to raw {{(pid=74980) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 17:40:31 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:40:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4.part /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4.converted {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4.part /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4.converted" returned: 0 in 0.337s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4.converted --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.078s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Successfully updated port: c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "refresh_cache-f2bd54ca-208e-4437-a875-ba1202589736" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquired lock "refresh_cache-f2bd54ca-208e-4437-a875-ba1202589736" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.compute.manager [req-8a933278-0bcc-40b2-9f41-8209e5745db8 req-a72cd5fc-5470-43a5-8f1e-f1ef2494df8f service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Received event network-changed-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.compute.manager [req-8a933278-0bcc-40b2-9f41-8209e5745db8 req-a72cd5fc-5470-43a5-8f1e-f1ef2494df8f service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Refreshing instance network info cache due to event network-changed-c856d77a-8cfe-4b1e-bb19-65b2adf989a3. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8a933278-0bcc-40b2-9f41-8209e5745db8 req-a72cd5fc-5470-43a5-8f1e-f1ef2494df8f service nova] Acquiring lock "refresh_cache-f2bd54ca-208e-4437-a875-ba1202589736" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4 --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4 --force-share --output=json" returned: 0 in 0.197s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4,backing_fmt=raw /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4,backing_fmt=raw /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk 1073741824" returned: 0 in 0.046s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.network.neutron [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Updating instance_info_cache with network_info: [{"id": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "address": "fa:16:3e:c6:6e:56", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856d77a-8c", "ovs_interfaceid": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Releasing lock "refresh_cache-f2bd54ca-208e-4437-a875-ba1202589736" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Instance network_info: |[{"id": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "address": "fa:16:3e:c6:6e:56", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856d77a-8c", "ovs_interfaceid": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8a933278-0bcc-40b2-9f41-8209e5745db8 req-a72cd5fc-5470-43a5-8f1e-f1ef2494df8f service nova] Acquired lock "refresh_cache-f2bd54ca-208e-4437-a875-ba1202589736" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.network.neutron [req-8a933278-0bcc-40b2-9f41-8209e5745db8 req-a72cd5fc-5470-43a5-8f1e-f1ef2494df8f service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Refreshing network info cache for port c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4 --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Ensure instance console log exists: /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Start _get_guest_xml network_info=[{"id": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "address": "fa:16:3e:c6:6e:56", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856d77a-8c", "ovs_interfaceid": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1b081f926b1248aebac69429fbbd4bb4',container_format='bare',created_at=2023-11-02T17:40:20Z,direct_url=<?>,disk_format='qcow2',id=d2f35379-a5bd-45c5-aa72-8da85b56baf1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-475958863',owner='45b461c7b3824820a1fd88721ddbebd6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T17:40:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': 'd2f35379-a5bd-45c5-aa72-8da85b56baf1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:40:32 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:40:32 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1b081f926b1248aebac69429fbbd4bb4',container_format='bare',created_at=2023-11-02T17:40:20Z,direct_url=<?>,disk_format='qcow2',id=d2f35379-a5bd-45c5-aa72-8da85b56baf1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-475958863',owner='45b461c7b3824820a1fd88721ddbebd6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T17:40:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:40:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-376902537',display_name='tempest-TestStampPattern-server-376902537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-376902537',id=35,image_ref='d2f35379-a5bd-45c5-aa72-8da85b56baf1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6brPZ2uQ9G456sHLwslPBKMXH8Tx/nIMEedR+0YOFh5yPB/1XbhrPSZGlKxJ15/1VDK+MwShvhsv4pet6TNLtaVxKcGhLuXiTb4JdYXaSjCd+QqbzzQiSp5KWOqpajXQ==',key_name='tempest-TestStampPattern-1458079072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45b461c7b3824820a1fd88721ddbebd6',ramdisk_id='',reservation_id='r-pi0o0ui5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e0a58d05-9dff-4590-a240-64826fc8243e',image_min_disk='1',image_min_ram='0',image_owner_id='45b461c7b3824820a1fd88721ddbebd6',image_owner_project_name='tempest-TestStampPattern-1736614362',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1736614362-project-member',image_user_id='87f4ea9506264174bdbcd706e8cc877d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1736614362',owner_user_name='tempest-TestStampPattern-1736614362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:40:30Z,user_data=None,user_id='87f4ea9506264174bdbcd706e8cc877d',uuid=f2bd54ca-208e-4437-a875-ba1202589736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "address": "fa:16:3e:c6:6e:56", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856d77a-8c", "ovs_interfaceid": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Converting VIF {"id": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "address": "fa:16:3e:c6:6e:56", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856d77a-8c", "ovs_interfaceid": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:6e:56,bridge_name='br-int',has_traffic_filtering=True,id=c856d77a-8cfe-4b1e-bb19-65b2adf989a3,network=Network(067a0d22-4891-42a5-8cf2-d95882454841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc856d77a-8c') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.objects.instance [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lazy-loading 'pci_devices' on Instance uuid f2bd54ca-208e-4437-a875-ba1202589736 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:40:32 user nova-compute[74980]:   <uuid>f2bd54ca-208e-4437-a875-ba1202589736</uuid>
Nov 02 17:40:32 user nova-compute[74980]:   <name>instance-00000023</name>
Nov 02 17:40:32 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:40:32 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:40:32 user nova-compute[74980]:   <metadata>
Nov 02 17:40:32 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:40:32 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:40:32 user nova-compute[74980]:       <nova:name>tempest-TestStampPattern-server-376902537</nova:name>
Nov 02 17:40:32 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:40:32</nova:creationTime>
Nov 02 17:40:32 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:40:32 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:40:32 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:40:32 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:40:32 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:40:32 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:40:32 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:40:32 user nova-compute[74980]:       <nova:owner>
Nov 02 17:40:32 user nova-compute[74980]:         <nova:user uuid="87f4ea9506264174bdbcd706e8cc877d">tempest-TestStampPattern-1736614362-project-member</nova:user>
Nov 02 17:40:32 user nova-compute[74980]:         <nova:project uuid="45b461c7b3824820a1fd88721ddbebd6">tempest-TestStampPattern-1736614362</nova:project>
Nov 02 17:40:32 user nova-compute[74980]:       </nova:owner>
Nov 02 17:40:32 user nova-compute[74980]:       <nova:root type="image" uuid="d2f35379-a5bd-45c5-aa72-8da85b56baf1"/>
Nov 02 17:40:32 user nova-compute[74980]:       <nova:ports>
Nov 02 17:40:32 user nova-compute[74980]:         <nova:port uuid="c856d77a-8cfe-4b1e-bb19-65b2adf989a3">
Nov 02 17:40:32 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 17:40:32 user nova-compute[74980]:         </nova:port>
Nov 02 17:40:32 user nova-compute[74980]:       </nova:ports>
Nov 02 17:40:32 user nova-compute[74980]:     </nova:instance>
Nov 02 17:40:32 user nova-compute[74980]:   </metadata>
Nov 02 17:40:32 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:40:32 user nova-compute[74980]:     <system>
Nov 02 17:40:32 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:40:32 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:40:32 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:40:32 user nova-compute[74980]:       <entry name="serial">f2bd54ca-208e-4437-a875-ba1202589736</entry>
Nov 02 17:40:32 user nova-compute[74980]:       <entry name="uuid">f2bd54ca-208e-4437-a875-ba1202589736</entry>
Nov 02 17:40:32 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:40:32 user nova-compute[74980]:     </system>
Nov 02 17:40:32 user nova-compute[74980]:   </sysinfo>
Nov 02 17:40:32 user nova-compute[74980]:   <os>
Nov 02 17:40:32 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:40:32 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:40:32 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:40:32 user nova-compute[74980]:   </os>
Nov 02 17:40:32 user nova-compute[74980]:   <features>
Nov 02 17:40:32 user nova-compute[74980]:     <acpi/>
Nov 02 17:40:32 user nova-compute[74980]:     <apic/>
Nov 02 17:40:32 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:40:32 user nova-compute[74980]:   </features>
Nov 02 17:40:32 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:40:32 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:40:32 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:40:32 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:40:32 user nova-compute[74980]:   </clock>
Nov 02 17:40:32 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:40:32 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:40:32 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:40:32 user nova-compute[74980]:   </cpu>
Nov 02 17:40:32 user nova-compute[74980]:   <devices>
Nov 02 17:40:32 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:40:32 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:40:32 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk"/>
Nov 02 17:40:32 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:40:32 user nova-compute[74980]:     </disk>
Nov 02 17:40:32 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:40:32 user nova-compute[74980]:       <mac address="fa:16:3e:c6:6e:56"/>
Nov 02 17:40:32 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:40:32 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:40:32 user nova-compute[74980]:       <target dev="tapc856d77a-8c"/>
Nov 02 17:40:32 user nova-compute[74980]:     </interface>
Nov 02 17:40:32 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:40:32 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/console.log" append="off"/>
Nov 02 17:40:32 user nova-compute[74980]:     </serial>
Nov 02 17:40:32 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:40:32 user nova-compute[74980]:     <video>
Nov 02 17:40:32 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:40:32 user nova-compute[74980]:     </video>
Nov 02 17:40:32 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:40:32 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:40:32 user nova-compute[74980]:     </rng>
Nov 02 17:40:32 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:40:32 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:40:32 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:40:32 user nova-compute[74980]:     </memballoon>
Nov 02 17:40:32 user nova-compute[74980]:   </devices>
Nov 02 17:40:32 user nova-compute[74980]: </domain>
Nov 02 17:40:32 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:40:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-376902537',display_name='tempest-TestStampPattern-server-376902537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-376902537',id=35,image_ref='d2f35379-a5bd-45c5-aa72-8da85b56baf1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6brPZ2uQ9G456sHLwslPBKMXH8Tx/nIMEedR+0YOFh5yPB/1XbhrPSZGlKxJ15/1VDK+MwShvhsv4pet6TNLtaVxKcGhLuXiTb4JdYXaSjCd+QqbzzQiSp5KWOqpajXQ==',key_name='tempest-TestStampPattern-1458079072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45b461c7b3824820a1fd88721ddbebd6',ramdisk_id='',reservation_id='r-pi0o0ui5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e0a58d05-9dff-4590-a240-64826fc8243e',image_min_disk='1',image_min_ram='0',image_owner_id='45b461c7b3824820a1fd88721ddbebd6',image_owner_project_name='tempest-TestStampPattern-1736614362',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1736614362-project-member',image_user_id='87f4ea9506264174bdbcd706e8cc877d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1736614362',owner_user_name='tempest-TestStampPattern-1736614362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:40:30Z,user_data=None,user_id='87f4ea9506264174bdbcd706e8cc877d',uuid=f2bd54ca-208e-4437-a875-ba1202589736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "address": "fa:16:3e:c6:6e:56", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856d77a-8c", "ovs_interfaceid": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Converting VIF {"id": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "address": "fa:16:3e:c6:6e:56", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856d77a-8c", "ovs_interfaceid": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:6e:56,bridge_name='br-int',has_traffic_filtering=True,id=c856d77a-8cfe-4b1e-bb19-65b2adf989a3,network=Network(067a0d22-4891-42a5-8cf2-d95882454841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc856d77a-8c') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG os_vif [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:6e:56,bridge_name='br-int',has_traffic_filtering=True,id=c856d77a-8cfe-4b1e-bb19-65b2adf989a3,network=Network(067a0d22-4891-42a5-8cf2-d95882454841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc856d77a-8c') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54c9648b-d1fa-5531-b2c7-772c2a3e05a3', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc856d77a-8c, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc856d77a-8c, col_values=(('qos', UUID('3f21ebbb-b3be-4860-bc88-d414c2245501')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc856d77a-8c, col_values=(('external_ids', {'iface-id': 'c856d77a-8cfe-4b1e-bb19-65b2adf989a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:6e:56', 'vm-uuid': 'f2bd54ca-208e-4437-a875-ba1202589736'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:32 user nova-compute[74980]: INFO os_vif [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:6e:56,bridge_name='br-int',has_traffic_filtering=True,id=c856d77a-8cfe-4b1e-bb19-65b2adf989a3,network=Network(067a0d22-4891-42a5-8cf2-d95882454841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc856d77a-8c')
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] No VIF found with MAC fa:16:3e:c6:6e:56, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.network.neutron [req-8a933278-0bcc-40b2-9f41-8209e5745db8 req-a72cd5fc-5470-43a5-8f1e-f1ef2494df8f service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Updated VIF entry in instance network info cache for port c856d77a-8cfe-4b1e-bb19-65b2adf989a3. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG nova.network.neutron [req-8a933278-0bcc-40b2-9f41-8209e5745db8 req-a72cd5fc-5470-43a5-8f1e-f1ef2494df8f service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Updating instance_info_cache with network_info: [{"id": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "address": "fa:16:3e:c6:6e:56", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856d77a-8c", "ovs_interfaceid": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:40:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8a933278-0bcc-40b2-9f41-8209e5745db8 req-a72cd5fc-5470-43a5-8f1e-f1ef2494df8f service nova] Releasing lock "refresh_cache-f2bd54ca-208e-4437-a875-ba1202589736" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:40:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:34 user nova-compute[74980]: DEBUG nova.compute.manager [req-4b100346-a3f0-4cf5-a27b-4e05067d70d4 req-3e1e1cdc-71fb-4ae6-aef3-6350b2a56855 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Received event network-vif-plugged-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:40:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4b100346-a3f0-4cf5-a27b-4e05067d70d4 req-3e1e1cdc-71fb-4ae6-aef3-6350b2a56855 service nova] Acquiring lock "f2bd54ca-208e-4437-a875-ba1202589736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4b100346-a3f0-4cf5-a27b-4e05067d70d4 req-3e1e1cdc-71fb-4ae6-aef3-6350b2a56855 service nova] Lock "f2bd54ca-208e-4437-a875-ba1202589736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4b100346-a3f0-4cf5-a27b-4e05067d70d4 req-3e1e1cdc-71fb-4ae6-aef3-6350b2a56855 service nova] Lock "f2bd54ca-208e-4437-a875-ba1202589736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:34 user nova-compute[74980]: DEBUG nova.compute.manager [req-4b100346-a3f0-4cf5-a27b-4e05067d70d4 req-3e1e1cdc-71fb-4ae6-aef3-6350b2a56855 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] No waiting events found dispatching network-vif-plugged-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:40:34 user nova-compute[74980]: WARNING nova.compute.manager [req-4b100346-a3f0-4cf5-a27b-4e05067d70d4 req-3e1e1cdc-71fb-4ae6-aef3-6350b2a56855 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Received unexpected event network-vif-plugged-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 for instance with vm_state building and task_state spawning.
Nov 02 17:40:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:36 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:40:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:40:36 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Instance spawned successfully.
Nov 02 17:40:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:40:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:40:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:40:36 user nova-compute[74980]: INFO nova.compute.manager [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 02 17:40:36 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:40:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-75749005-53e6-4270-90f6-957a10c1568e req-27ab6d64-62f8-4f47-8861-705284eb6a02 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Received event network-vif-plugged-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:40:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-75749005-53e6-4270-90f6-957a10c1568e req-27ab6d64-62f8-4f47-8861-705284eb6a02 service nova] Acquiring lock "f2bd54ca-208e-4437-a875-ba1202589736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-75749005-53e6-4270-90f6-957a10c1568e req-27ab6d64-62f8-4f47-8861-705284eb6a02 service nova] Lock "f2bd54ca-208e-4437-a875-ba1202589736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-75749005-53e6-4270-90f6-957a10c1568e req-27ab6d64-62f8-4f47-8861-705284eb6a02 service nova] Lock "f2bd54ca-208e-4437-a875-ba1202589736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-75749005-53e6-4270-90f6-957a10c1568e req-27ab6d64-62f8-4f47-8861-705284eb6a02 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] No waiting events found dispatching network-vif-plugged-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:40:36 user nova-compute[74980]: WARNING nova.compute.manager [req-75749005-53e6-4270-90f6-957a10c1568e req-27ab6d64-62f8-4f47-8861-705284eb6a02 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Received unexpected event network-vif-plugged-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 for instance with vm_state active and task_state None.
Nov 02 17:40:36 user nova-compute[74980]: INFO nova.compute.manager [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Took 7.15 seconds to build instance.
Nov 02 17:40:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8f6df702-e554-48fe-b9d1-604f9dd756d1 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "f2bd54ca-208e-4437-a875-ba1202589736" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.246s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:40:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:55 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:40:55 user nova-compute[74980]: INFO nova.compute.claims [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Claim successful on node user
Nov 02 17:40:56 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:40:56 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:40:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:40:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:40:56 user nova-compute[74980]: DEBUG nova.network.neutron [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:40:56 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:40:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:40:56 user nova-compute[74980]: DEBUG nova.policy [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '985386b6880e4b07bdad162c7860d7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc26ef1932f1408c860b3b9edb4925a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:40:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:40:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:40:56 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Creating image(s)
Nov 02 17:40:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "/opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "/opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.189s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.213s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk 1073741824" returned: 0 in 0.049s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG nova.network.neutron [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Successfully created port: 5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.204s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Cannot resize image /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Ensure instance console log exists: /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:40:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.network.neutron [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Successfully updated port: 5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquired lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.network.neutron [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-97ed6589-c511-4add-8482-bc3bff18453c req-31fc04e7-8a9d-4d85-9172-8f0b7ba28600 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-changed-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-97ed6589-c511-4add-8482-bc3bff18453c req-31fc04e7-8a9d-4d85-9172-8f0b7ba28600 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Refreshing instance network info cache due to event network-changed-5c2fcde8-42ac-4ce6-a511-2221327973b0. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-97ed6589-c511-4add-8482-bc3bff18453c req-31fc04e7-8a9d-4d85-9172-8f0b7ba28600 service nova] Acquiring lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.network.neutron [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.network.neutron [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Updating instance_info_cache with network_info: [{"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Releasing lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Instance network_info: |[{"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-97ed6589-c511-4add-8482-bc3bff18453c req-31fc04e7-8a9d-4d85-9172-8f0b7ba28600 service nova] Acquired lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.network.neutron [req-97ed6589-c511-4add-8482-bc3bff18453c req-31fc04e7-8a9d-4d85-9172-8f0b7ba28600 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Refreshing network info cache for port 5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Start _get_guest_xml network_info=[{"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:40:58 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:40:58 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-138862382',display_name='tempest-ServerRescueNegativeTestJSON-server-138862382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-138862382',id=36,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuKStpw7DFbvE328Zxz9Ykoa6CbmGKIXVv7rsiKwiyCOeuaJ+jFMFcOErWQ4L9ovcgKgiR4rEnBp5BAytU14OHeYTIQY2iDkgxpilQGkmZHmFvAu7SJaLIUa1aKbiX3/Q==',key_name='tempest-keypair-1369605087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc26ef1932f1408c860b3b9edb4925a4',ramdisk_id='',reservation_id='r-spzm07ce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-86632079',owner_user_name='tempest-ServerRescueNegativeTestJSON-86632079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='985386b6880e4b07bdad162c7860d7a3',uuid=e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converting VIF {"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:47:7d,bridge_name='br-int',has_traffic_filtering=True,id=5c2fcde8-42ac-4ce6-a511-2221327973b0,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2fcde8-42') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.objects.instance [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'pci_devices' on Instance uuid e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:40:58 user nova-compute[74980]:   <uuid>e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e</uuid>
Nov 02 17:40:58 user nova-compute[74980]:   <name>instance-00000024</name>
Nov 02 17:40:58 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:40:58 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:40:58 user nova-compute[74980]:   <metadata>
Nov 02 17:40:58 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:40:58 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:40:58 user nova-compute[74980]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-138862382</nova:name>
Nov 02 17:40:58 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:40:58</nova:creationTime>
Nov 02 17:40:58 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:40:58 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:40:58 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:40:58 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:40:58 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:40:58 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:40:58 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:40:58 user nova-compute[74980]:       <nova:owner>
Nov 02 17:40:58 user nova-compute[74980]:         <nova:user uuid="985386b6880e4b07bdad162c7860d7a3">tempest-ServerRescueNegativeTestJSON-86632079-project-member</nova:user>
Nov 02 17:40:58 user nova-compute[74980]:         <nova:project uuid="dc26ef1932f1408c860b3b9edb4925a4">tempest-ServerRescueNegativeTestJSON-86632079</nova:project>
Nov 02 17:40:58 user nova-compute[74980]:       </nova:owner>
Nov 02 17:40:58 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:40:58 user nova-compute[74980]:       <nova:ports>
Nov 02 17:40:58 user nova-compute[74980]:         <nova:port uuid="5c2fcde8-42ac-4ce6-a511-2221327973b0">
Nov 02 17:40:58 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 17:40:58 user nova-compute[74980]:         </nova:port>
Nov 02 17:40:58 user nova-compute[74980]:       </nova:ports>
Nov 02 17:40:58 user nova-compute[74980]:     </nova:instance>
Nov 02 17:40:58 user nova-compute[74980]:   </metadata>
Nov 02 17:40:58 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:40:58 user nova-compute[74980]:     <system>
Nov 02 17:40:58 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:40:58 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:40:58 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:40:58 user nova-compute[74980]:       <entry name="serial">e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e</entry>
Nov 02 17:40:58 user nova-compute[74980]:       <entry name="uuid">e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e</entry>
Nov 02 17:40:58 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:40:58 user nova-compute[74980]:     </system>
Nov 02 17:40:58 user nova-compute[74980]:   </sysinfo>
Nov 02 17:40:58 user nova-compute[74980]:   <os>
Nov 02 17:40:58 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:40:58 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:40:58 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:40:58 user nova-compute[74980]:   </os>
Nov 02 17:40:58 user nova-compute[74980]:   <features>
Nov 02 17:40:58 user nova-compute[74980]:     <acpi/>
Nov 02 17:40:58 user nova-compute[74980]:     <apic/>
Nov 02 17:40:58 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:40:58 user nova-compute[74980]:   </features>
Nov 02 17:40:58 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:40:58 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:40:58 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:40:58 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:40:58 user nova-compute[74980]:   </clock>
Nov 02 17:40:58 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:40:58 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:40:58 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:40:58 user nova-compute[74980]:   </cpu>
Nov 02 17:40:58 user nova-compute[74980]:   <devices>
Nov 02 17:40:58 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:40:58 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:40:58 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk"/>
Nov 02 17:40:58 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:40:58 user nova-compute[74980]:     </disk>
Nov 02 17:40:58 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:40:58 user nova-compute[74980]:       <mac address="fa:16:3e:fb:47:7d"/>
Nov 02 17:40:58 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:40:58 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:40:58 user nova-compute[74980]:       <target dev="tap5c2fcde8-42"/>
Nov 02 17:40:58 user nova-compute[74980]:     </interface>
Nov 02 17:40:58 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:40:58 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/console.log" append="off"/>
Nov 02 17:40:58 user nova-compute[74980]:     </serial>
Nov 02 17:40:58 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:40:58 user nova-compute[74980]:     <video>
Nov 02 17:40:58 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:40:58 user nova-compute[74980]:     </video>
Nov 02 17:40:58 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:40:58 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:40:58 user nova-compute[74980]:     </rng>
Nov 02 17:40:58 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:40:58 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:40:58 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:40:58 user nova-compute[74980]:     </memballoon>
Nov 02 17:40:58 user nova-compute[74980]:   </devices>
Nov 02 17:40:58 user nova-compute[74980]: </domain>
Nov 02 17:40:58 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-138862382',display_name='tempest-ServerRescueNegativeTestJSON-server-138862382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-138862382',id=36,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuKStpw7DFbvE328Zxz9Ykoa6CbmGKIXVv7rsiKwiyCOeuaJ+jFMFcOErWQ4L9ovcgKgiR4rEnBp5BAytU14OHeYTIQY2iDkgxpilQGkmZHmFvAu7SJaLIUa1aKbiX3/Q==',key_name='tempest-keypair-1369605087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc26ef1932f1408c860b3b9edb4925a4',ramdisk_id='',reservation_id='r-spzm07ce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-86632079',owner_user_name='tempest-ServerRescueNegativeTestJSON-86632079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='985386b6880e4b07bdad162c7860d7a3',uuid=e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converting VIF {"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:47:7d,bridge_name='br-int',has_traffic_filtering=True,id=5c2fcde8-42ac-4ce6-a511-2221327973b0,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2fcde8-42') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG os_vif [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:47:7d,bridge_name='br-int',has_traffic_filtering=True,id=5c2fcde8-42ac-4ce6-a511-2221327973b0,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2fcde8-42') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9eb7cda8-88dd-5257-9087-3a6b6aca7c96', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c2fcde8-42, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c2fcde8-42, col_values=(('qos', UUID('75fc9150-427a-4417-8873-3923327a8778')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c2fcde8-42, col_values=(('external_ids', {'iface-id': '5c2fcde8-42ac-4ce6-a511-2221327973b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:47:7d', 'vm-uuid': 'e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:40:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:40:58 user nova-compute[74980]: INFO os_vif [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:47:7d,bridge_name='br-int',has_traffic_filtering=True,id=5c2fcde8-42ac-4ce6-a511-2221327973b0,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2fcde8-42')
Nov 02 17:40:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:40:59 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No VIF found with MAC fa:16:3e:fb:47:7d, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:40:59 user nova-compute[74980]: DEBUG nova.network.neutron [req-97ed6589-c511-4add-8482-bc3bff18453c req-31fc04e7-8a9d-4d85-9172-8f0b7ba28600 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Updated VIF entry in instance network info cache for port 5c2fcde8-42ac-4ce6-a511-2221327973b0. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:40:59 user nova-compute[74980]: DEBUG nova.network.neutron [req-97ed6589-c511-4add-8482-bc3bff18453c req-31fc04e7-8a9d-4d85-9172-8f0b7ba28600 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Updating instance_info_cache with network_info: [{"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:40:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-97ed6589-c511-4add-8482-bc3bff18453c req-31fc04e7-8a9d-4d85-9172-8f0b7ba28600 service nova] Releasing lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:41:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:00 user nova-compute[74980]: DEBUG nova.compute.manager [req-83a045a5-9124-4a62-9cfe-d874103ccf05 req-8c3bde53-dc48-4607-abe2-64bc3bc809c8 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:41:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-83a045a5-9124-4a62-9cfe-d874103ccf05 req-8c3bde53-dc48-4607-abe2-64bc3bc809c8 service nova] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-83a045a5-9124-4a62-9cfe-d874103ccf05 req-8c3bde53-dc48-4607-abe2-64bc3bc809c8 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-83a045a5-9124-4a62-9cfe-d874103ccf05 req-8c3bde53-dc48-4607-abe2-64bc3bc809c8 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:00 user nova-compute[74980]: DEBUG nova.compute.manager [req-83a045a5-9124-4a62-9cfe-d874103ccf05 req-8c3bde53-dc48-4607-abe2-64bc3bc809c8 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] No waiting events found dispatching network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:41:00 user nova-compute[74980]: WARNING nova.compute.manager [req-83a045a5-9124-4a62-9cfe-d874103ccf05 req-8c3bde53-dc48-4607-abe2-64bc3bc809c8 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received unexpected event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 for instance with vm_state building and task_state spawning.
Nov 02 17:41:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:02 user nova-compute[74980]: DEBUG nova.compute.manager [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:41:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:41:02 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Instance spawned successfully.
Nov 02 17:41:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:41:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:41:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:41:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:41:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:41:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:41:02 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:41:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:02 user nova-compute[74980]: INFO nova.compute.manager [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 02 17:41:02 user nova-compute[74980]: DEBUG nova.compute.manager [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:41:02 user nova-compute[74980]: DEBUG nova.compute.manager [req-2d89c88e-4de9-43da-9ba9-e500d580db55 req-f5904a1a-4118-4689-846c-5d94d6adc8fe service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:41:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2d89c88e-4de9-43da-9ba9-e500d580db55 req-f5904a1a-4118-4689-846c-5d94d6adc8fe service nova] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2d89c88e-4de9-43da-9ba9-e500d580db55 req-f5904a1a-4118-4689-846c-5d94d6adc8fe service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2d89c88e-4de9-43da-9ba9-e500d580db55 req-f5904a1a-4118-4689-846c-5d94d6adc8fe service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:02 user nova-compute[74980]: DEBUG nova.compute.manager [req-2d89c88e-4de9-43da-9ba9-e500d580db55 req-f5904a1a-4118-4689-846c-5d94d6adc8fe service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] No waiting events found dispatching network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:41:02 user nova-compute[74980]: WARNING nova.compute.manager [req-2d89c88e-4de9-43da-9ba9-e500d580db55 req-f5904a1a-4118-4689-846c-5d94d6adc8fe service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received unexpected event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 for instance with vm_state active and task_state None.
Nov 02 17:41:02 user nova-compute[74980]: INFO nova.compute.manager [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Took 6.99 seconds to build instance.
Nov 02 17:41:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-535a2cb2-2880-4e01-afc0-2ab4dede29f2 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.155s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "b774dda1-5000-4323-aaee-24e9a4029617" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:04 user nova-compute[74980]: INFO nova.compute.manager [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Unshelving
Nov 02 17:41:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:04 user nova-compute[74980]: DEBUG nova.objects.instance [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lazy-loading 'pci_requests' on Instance uuid b774dda1-5000-4323-aaee-24e9a4029617 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:41:04 user nova-compute[74980]: DEBUG nova.objects.instance [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lazy-loading 'numa_topology' on Instance uuid b774dda1-5000-4323-aaee-24e9a4029617 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:41:04 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:41:04 user nova-compute[74980]: INFO nova.compute.claims [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Claim successful on node user
Nov 02 17:41:04 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:41:04 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:41:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:04 user nova-compute[74980]: INFO nova.network.neutron [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Updating port 1f4b9759-99d5-4507-b639-c9755c5da9c2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquired lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG nova.network.neutron [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-d077427e-bf28-472e-99f0-67cbc2b5ff28 req-74685a55-98c2-4c43-b82b-510f8acb863b service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-changed-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-d077427e-bf28-472e-99f0-67cbc2b5ff28 req-74685a55-98c2-4c43-b82b-510f8acb863b service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Refreshing instance network info cache due to event network-changed-1f4b9759-99d5-4507-b639-c9755c5da9c2. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d077427e-bf28-472e-99f0-67cbc2b5ff28 req-74685a55-98c2-4c43-b82b-510f8acb863b service nova] Acquiring lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG nova.network.neutron [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Updating instance_info_cache with network_info: [{"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Releasing lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:41:05 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Creating image(s)
Nov 02 17:41:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "/opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "/opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "/opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG nova.objects.instance [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lazy-loading 'trusted_certs' on Instance uuid b774dda1-5000-4323-aaee-24e9a4029617 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d077427e-bf28-472e-99f0-67cbc2b5ff28 req-74685a55-98c2-4c43-b82b-510f8acb863b service nova] Acquired lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG nova.network.neutron [req-d077427e-bf28-472e-99f0-67cbc2b5ff28 req-74685a55-98c2-4c43-b82b-510f8acb863b service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Refreshing network info cache for port 1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG nova.objects.base [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Object Instance<b774dda1-5000-4323-aaee-24e9a4029617> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1.part --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG nova.virt.images [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] 658bd214-b9fe-42e9-bfbd-0a05b0a955ea was qcow2, converting to raw {{(pid=74980) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1.part /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1.converted {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG nova.network.neutron [req-d077427e-bf28-472e-99f0-67cbc2b5ff28 req-74685a55-98c2-4c43-b82b-510f8acb863b service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Updated VIF entry in instance network info cache for port 1f4b9759-99d5-4507-b639-c9755c5da9c2. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG nova.network.neutron [req-d077427e-bf28-472e-99f0-67cbc2b5ff28 req-74685a55-98c2-4c43-b82b-510f8acb863b service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Updating instance_info_cache with network_info: [{"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d077427e-bf28-472e-99f0-67cbc2b5ff28 req-74685a55-98c2-4c43-b82b-510f8acb863b service nova] Releasing lock "refresh_cache-b774dda1-5000-4323-aaee-24e9a4029617" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1.part /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1.converted" returned: 0 in 0.293s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1.converted --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.771s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1 --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1 --force-share --output=json" returned: 0 in 0.191s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1,backing_fmt=raw /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1,backing_fmt=raw /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk 1073741824" returned: 0 in 0.055s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1 --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:08 user nova-compute[74980]: DEBUG nova.objects.instance [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lazy-loading 'migration_context' on Instance uuid b774dda1-5000-4323-aaee-24e9a4029617 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:41:08 user nova-compute[74980]: DEBUG nova.objects.base [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Object Instance<b774dda1-5000-4323-aaee-24e9a4029617> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:41:08 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Rebasing disk image.
Nov 02 17:41:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 -F raw /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 -F raw /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk" returned: 0 in 2.292s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Ensure instance console log exists: /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Start _get_guest_xml network_info=[{"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='2d2e31f06a2dc57c51f9da4b418d614a',container_format='bare',created_at=2023-11-02T17:39:11Z,direct_url=<?>,disk_format='qcow2',id=658bd214-b9fe-42e9-bfbd-0a05b0a955ea,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1725912966-shelved',owner='ccb03b0bde444fbc82be742d0027c0ec',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T17:39:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:41:10 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:41:10 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2d2e31f06a2dc57c51f9da4b418d614a',container_format='bare',created_at=2023-11-02T17:39:11Z,direct_url=<?>,disk_format='qcow2',id=658bd214-b9fe-42e9-bfbd-0a05b0a955ea,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1725912966-shelved',owner='ccb03b0bde444fbc82be742d0027c0ec',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T17:39:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lazy-loading 'vcpu_model' on Instance uuid b774dda1-5000-4323-aaee-24e9a4029617 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.objects.base [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Object Instance<b774dda1-5000-4323-aaee-24e9a4029617> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T17:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1725912966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1725912966',id=31,image_ref='658bd214-b9fe-42e9-bfbd-0a05b0a955ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-679286581',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:37:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ccb03b0bde444fbc82be742d0027c0ec',ramdisk_id='',reservation_id='r-rwm0tx71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1991165793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1991165793-project-member',shelved_at='2023-11-02T17:39:15.597287',shelved_host='user',shelved_image_id='658bd214-b9fe-42e9-bfbd-0a05b0a955ea'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1f92dd53761465592b6d5390090f59f',uuid=b774dda1-5000-4323-aaee-24e9a4029617,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converting VIF {"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:ec:ff,bridge_name='br-int',has_traffic_filtering=True,id=1f4b9759-99d5-4507-b639-c9755c5da9c2,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4b9759-99') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lazy-loading 'pci_devices' on Instance uuid b774dda1-5000-4323-aaee-24e9a4029617 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.objects.base [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Object Instance<b774dda1-5000-4323-aaee-24e9a4029617> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:41:10 user nova-compute[74980]:   <uuid>b774dda1-5000-4323-aaee-24e9a4029617</uuid>
Nov 02 17:41:10 user nova-compute[74980]:   <name>instance-0000001f</name>
Nov 02 17:41:10 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:41:10 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:41:10 user nova-compute[74980]:   <metadata>
Nov 02 17:41:10 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:41:10 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:41:10 user nova-compute[74980]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1725912966</nova:name>
Nov 02 17:41:10 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:41:10</nova:creationTime>
Nov 02 17:41:10 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:41:10 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:41:10 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:41:10 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:41:10 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:41:10 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:41:10 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:41:10 user nova-compute[74980]:       <nova:owner>
Nov 02 17:41:10 user nova-compute[74980]:         <nova:user uuid="f1f92dd53761465592b6d5390090f59f">tempest-AttachVolumeShelveTestJSON-1991165793-project-member</nova:user>
Nov 02 17:41:10 user nova-compute[74980]:         <nova:project uuid="ccb03b0bde444fbc82be742d0027c0ec">tempest-AttachVolumeShelveTestJSON-1991165793</nova:project>
Nov 02 17:41:10 user nova-compute[74980]:       </nova:owner>
Nov 02 17:41:10 user nova-compute[74980]:       <nova:root type="image" uuid="658bd214-b9fe-42e9-bfbd-0a05b0a955ea"/>
Nov 02 17:41:10 user nova-compute[74980]:       <nova:ports>
Nov 02 17:41:10 user nova-compute[74980]:         <nova:port uuid="1f4b9759-99d5-4507-b639-c9755c5da9c2">
Nov 02 17:41:10 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 17:41:10 user nova-compute[74980]:         </nova:port>
Nov 02 17:41:10 user nova-compute[74980]:       </nova:ports>
Nov 02 17:41:10 user nova-compute[74980]:     </nova:instance>
Nov 02 17:41:10 user nova-compute[74980]:   </metadata>
Nov 02 17:41:10 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:41:10 user nova-compute[74980]:     <system>
Nov 02 17:41:10 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:41:10 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:41:10 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:41:10 user nova-compute[74980]:       <entry name="serial">b774dda1-5000-4323-aaee-24e9a4029617</entry>
Nov 02 17:41:10 user nova-compute[74980]:       <entry name="uuid">b774dda1-5000-4323-aaee-24e9a4029617</entry>
Nov 02 17:41:10 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:41:10 user nova-compute[74980]:     </system>
Nov 02 17:41:10 user nova-compute[74980]:   </sysinfo>
Nov 02 17:41:10 user nova-compute[74980]:   <os>
Nov 02 17:41:10 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:41:10 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:41:10 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:41:10 user nova-compute[74980]:   </os>
Nov 02 17:41:10 user nova-compute[74980]:   <features>
Nov 02 17:41:10 user nova-compute[74980]:     <acpi/>
Nov 02 17:41:10 user nova-compute[74980]:     <apic/>
Nov 02 17:41:10 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:41:10 user nova-compute[74980]:   </features>
Nov 02 17:41:10 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:41:10 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:41:10 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:41:10 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:41:10 user nova-compute[74980]:   </clock>
Nov 02 17:41:10 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:41:10 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:41:10 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:41:10 user nova-compute[74980]:   </cpu>
Nov 02 17:41:10 user nova-compute[74980]:   <devices>
Nov 02 17:41:10 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:41:10 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:41:10 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk"/>
Nov 02 17:41:10 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:41:10 user nova-compute[74980]:     </disk>
Nov 02 17:41:10 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:41:10 user nova-compute[74980]:       <mac address="fa:16:3e:51:ec:ff"/>
Nov 02 17:41:10 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:41:10 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:41:10 user nova-compute[74980]:       <target dev="tap1f4b9759-99"/>
Nov 02 17:41:10 user nova-compute[74980]:     </interface>
Nov 02 17:41:10 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:41:10 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/console.log" append="off"/>
Nov 02 17:41:10 user nova-compute[74980]:     </serial>
Nov 02 17:41:10 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:41:10 user nova-compute[74980]:     <video>
Nov 02 17:41:10 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:41:10 user nova-compute[74980]:     </video>
Nov 02 17:41:10 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:41:10 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:41:10 user nova-compute[74980]:     </rng>
Nov 02 17:41:10 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:41:10 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:41:10 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:41:10 user nova-compute[74980]:     </memballoon>
Nov 02 17:41:10 user nova-compute[74980]:   </devices>
Nov 02 17:41:10 user nova-compute[74980]: </domain>
Nov 02 17:41:10 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T17:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1725912966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1725912966',id=31,image_ref='658bd214-b9fe-42e9-bfbd-0a05b0a955ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-679286581',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:37:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ccb03b0bde444fbc82be742d0027c0ec',ramdisk_id='',reservation_id='r-rwm0tx71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1991165793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1991165793-project-member',shelved_at='2023-11-02T17:39:15.597287',shelved_host='user',shelved_image_id='658bd214-b9fe-42e9-bfbd-0a05b0a955ea'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1f92dd53761465592b6d5390090f59f',uuid=b774dda1-5000-4323-aaee-24e9a4029617,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converting VIF {"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:ec:ff,bridge_name='br-int',has_traffic_filtering=True,id=1f4b9759-99d5-4507-b639-c9755c5da9c2,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4b9759-99') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG os_vif [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:ec:ff,bridge_name='br-int',has_traffic_filtering=True,id=1f4b9759-99d5-4507-b639-c9755c5da9c2,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4b9759-99') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '974d5fd4-6b11-53e1-b15c-c5e75ecca030', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f4b9759-99, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f4b9759-99, col_values=(('qos', UUID('76463a93-13f0-46b2-9ab3-1a2930e9c342')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f4b9759-99, col_values=(('external_ids', {'iface-id': '1f4b9759-99d5-4507-b639-c9755c5da9c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:ec:ff', 'vm-uuid': 'b774dda1-5000-4323-aaee-24e9a4029617'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:41:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:10 user nova-compute[74980]: INFO os_vif [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:ec:ff,bridge_name='br-int',has_traffic_filtering=True,id=1f4b9759-99d5-4507-b639-c9755c5da9c2,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4b9759-99')
Nov 02 17:41:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:41:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] No VIF found with MAC fa:16:3e:51:ec:ff, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:41:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:12 user nova-compute[74980]: DEBUG nova.compute.manager [req-3caa3753-72c7-4211-bbf1-33424ae33b7f req-598b847d-ead0-497a-a780-2301489be924 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:41:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3caa3753-72c7-4211-bbf1-33424ae33b7f req-598b847d-ead0-497a-a780-2301489be924 service nova] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3caa3753-72c7-4211-bbf1-33424ae33b7f req-598b847d-ead0-497a-a780-2301489be924 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3caa3753-72c7-4211-bbf1-33424ae33b7f req-598b847d-ead0-497a-a780-2301489be924 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:12 user nova-compute[74980]: DEBUG nova.compute.manager [req-3caa3753-72c7-4211-bbf1-33424ae33b7f req-598b847d-ead0-497a-a780-2301489be924 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] No waiting events found dispatching network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:41:12 user nova-compute[74980]: WARNING nova.compute.manager [req-3caa3753-72c7-4211-bbf1-33424ae33b7f req-598b847d-ead0-497a-a780-2301489be924 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received unexpected event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 17:41:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-761f9801-f91a-4750-8923-583781a5117f req-b5c86637-95cd-438f-bade-79cc90614eca service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:41:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-761f9801-f91a-4750-8923-583781a5117f req-b5c86637-95cd-438f-bade-79cc90614eca service nova] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-761f9801-f91a-4750-8923-583781a5117f req-b5c86637-95cd-438f-bade-79cc90614eca service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-761f9801-f91a-4750-8923-583781a5117f req-b5c86637-95cd-438f-bade-79cc90614eca service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-761f9801-f91a-4750-8923-583781a5117f req-b5c86637-95cd-438f-bade-79cc90614eca service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] No waiting events found dispatching network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:41:14 user nova-compute[74980]: WARNING nova.compute.manager [req-761f9801-f91a-4750-8923-583781a5117f req-b5c86637-95cd-438f-bade-79cc90614eca service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received unexpected event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 17:41:14 user nova-compute[74980]: DEBUG nova.compute.manager [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:41:14 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:41:14 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Instance spawned successfully.
Nov 02 17:41:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:15 user nova-compute[74980]: DEBUG nova.compute.manager [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:41:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5b5bee16-5598-4764-8763-4456dcdf93ce tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "b774dda1-5000-4323-aaee-24e9a4029617" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.039s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:15 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:41:15 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:41:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:17 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:41:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:41:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:41:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:41:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:41:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:41:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:25 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:41:25 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:41:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=7821MB free_disk=24.94220733642578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e0a58d05-9dff-4590-a240-64826fc8243e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 3d5b4f62-2d45-434f-bfc3-a626930b3168 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance f2bd54ca-208e-4437-a875-ba1202589736 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance b774dda1-5000-4323-aaee-24e9a4029617 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:41:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:41:26 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:41:26 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:41:26 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:41:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "47ba09bb-4865-414d-a287-300c813b8576" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "47ba09bb-4865-414d-a287-300c813b8576" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:41:27 user nova-compute[74980]: INFO nova.compute.claims [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Claim successful on node user
Nov 02 17:41:27 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:41:27 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:41:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG nova.policy [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd183edfc18ad4a6f91bff1e33db290c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8acec542cb1462996e6545c6f350e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:41:27 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Creating image(s)
Nov 02 17:41:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "/opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "/opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "/opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.187s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk 1073741824" returned: 0 in 0.049s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.190s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Successfully created port: 8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Cannot resize image /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Ensure instance console log exists: /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Successfully updated port: 8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "refresh_cache-47ba09bb-4865-414d-a287-300c813b8576" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquired lock "refresh_cache-47ba09bb-4865-414d-a287-300c813b8576" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.compute.manager [req-c1dd9c86-b0d7-476c-9276-cd41373ad5af req-e2307ed3-7c19-467b-b7b1-29656d7e488d service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received event network-changed-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.compute.manager [req-c1dd9c86-b0d7-476c-9276-cd41373ad5af req-e2307ed3-7c19-467b-b7b1-29656d7e488d service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Refreshing instance network info cache due to event network-changed-8211d299-5825-4934-88ca-51ac34dca390. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c1dd9c86-b0d7-476c-9276-cd41373ad5af req-e2307ed3-7c19-467b-b7b1-29656d7e488d service nova] Acquiring lock "refresh_cache-47ba09bb-4865-414d-a287-300c813b8576" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.network.neutron [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Updating instance_info_cache with network_info: [{"id": "8211d299-5825-4934-88ca-51ac34dca390", "address": "fa:16:3e:f1:61:10", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8211d299-58", "ovs_interfaceid": "8211d299-5825-4934-88ca-51ac34dca390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Releasing lock "refresh_cache-47ba09bb-4865-414d-a287-300c813b8576" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Instance network_info: |[{"id": "8211d299-5825-4934-88ca-51ac34dca390", "address": "fa:16:3e:f1:61:10", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8211d299-58", "ovs_interfaceid": "8211d299-5825-4934-88ca-51ac34dca390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c1dd9c86-b0d7-476c-9276-cd41373ad5af req-e2307ed3-7c19-467b-b7b1-29656d7e488d service nova] Acquired lock "refresh_cache-47ba09bb-4865-414d-a287-300c813b8576" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.network.neutron [req-c1dd9c86-b0d7-476c-9276-cd41373ad5af req-e2307ed3-7c19-467b-b7b1-29656d7e488d service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Refreshing network info cache for port 8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Start _get_guest_xml network_info=[{"id": "8211d299-5825-4934-88ca-51ac34dca390", "address": "fa:16:3e:f1:61:10", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8211d299-58", "ovs_interfaceid": "8211d299-5825-4934-88ca-51ac34dca390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:41:29 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:41:29 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2079837321',display_name='tempest-VolumesSnapshotTestJSON-instance-2079837321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2079837321',id=37,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0BifwA2qOaXwY28dNiUl9FKOF8bWpdILzYGCzZAwKqjOU46koug9PzWUuA8Wf751nzcYFrAyb5HYxFCaunTOoDnpBVo98l2f6qxySuoYLKUWoMhwZlIGddZOY7EX3lDg==',key_name='tempest-keypair-440002291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8acec542cb1462996e6545c6f350e9f',ramdisk_id='',reservation_id='r-ri30h596',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2140770747',owner_user_name='tempest-VolumesSnapshotTestJSON-2140770747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:41:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d183edfc18ad4a6f91bff1e33db290c8',uuid=47ba09bb-4865-414d-a287-300c813b8576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8211d299-5825-4934-88ca-51ac34dca390", "address": "fa:16:3e:f1:61:10", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8211d299-58", "ovs_interfaceid": "8211d299-5825-4934-88ca-51ac34dca390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Converting VIF {"id": "8211d299-5825-4934-88ca-51ac34dca390", "address": "fa:16:3e:f1:61:10", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8211d299-58", "ovs_interfaceid": "8211d299-5825-4934-88ca-51ac34dca390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:61:10,bridge_name='br-int',has_traffic_filtering=True,id=8211d299-5825-4934-88ca-51ac34dca390,network=Network(61d9ee24-0604-4a72-aebc-ff80ff1f35c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8211d299-58') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.objects.instance [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lazy-loading 'pci_devices' on Instance uuid 47ba09bb-4865-414d-a287-300c813b8576 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:41:29 user nova-compute[74980]:   <uuid>47ba09bb-4865-414d-a287-300c813b8576</uuid>
Nov 02 17:41:29 user nova-compute[74980]:   <name>instance-00000025</name>
Nov 02 17:41:29 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:41:29 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:41:29 user nova-compute[74980]:   <metadata>
Nov 02 17:41:29 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:41:29 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:41:29 user nova-compute[74980]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2079837321</nova:name>
Nov 02 17:41:29 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:41:29</nova:creationTime>
Nov 02 17:41:29 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:41:29 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:41:29 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:41:29 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:41:29 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:41:29 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:41:29 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:41:29 user nova-compute[74980]:       <nova:owner>
Nov 02 17:41:29 user nova-compute[74980]:         <nova:user uuid="d183edfc18ad4a6f91bff1e33db290c8">tempest-VolumesSnapshotTestJSON-2140770747-project-member</nova:user>
Nov 02 17:41:29 user nova-compute[74980]:         <nova:project uuid="b8acec542cb1462996e6545c6f350e9f">tempest-VolumesSnapshotTestJSON-2140770747</nova:project>
Nov 02 17:41:29 user nova-compute[74980]:       </nova:owner>
Nov 02 17:41:29 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:41:29 user nova-compute[74980]:       <nova:ports>
Nov 02 17:41:29 user nova-compute[74980]:         <nova:port uuid="8211d299-5825-4934-88ca-51ac34dca390">
Nov 02 17:41:29 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 17:41:29 user nova-compute[74980]:         </nova:port>
Nov 02 17:41:29 user nova-compute[74980]:       </nova:ports>
Nov 02 17:41:29 user nova-compute[74980]:     </nova:instance>
Nov 02 17:41:29 user nova-compute[74980]:   </metadata>
Nov 02 17:41:29 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:41:29 user nova-compute[74980]:     <system>
Nov 02 17:41:29 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:41:29 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:41:29 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:41:29 user nova-compute[74980]:       <entry name="serial">47ba09bb-4865-414d-a287-300c813b8576</entry>
Nov 02 17:41:29 user nova-compute[74980]:       <entry name="uuid">47ba09bb-4865-414d-a287-300c813b8576</entry>
Nov 02 17:41:29 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:41:29 user nova-compute[74980]:     </system>
Nov 02 17:41:29 user nova-compute[74980]:   </sysinfo>
Nov 02 17:41:29 user nova-compute[74980]:   <os>
Nov 02 17:41:29 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:41:29 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:41:29 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:41:29 user nova-compute[74980]:   </os>
Nov 02 17:41:29 user nova-compute[74980]:   <features>
Nov 02 17:41:29 user nova-compute[74980]:     <acpi/>
Nov 02 17:41:29 user nova-compute[74980]:     <apic/>
Nov 02 17:41:29 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:41:29 user nova-compute[74980]:   </features>
Nov 02 17:41:29 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:41:29 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:41:29 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:41:29 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:41:29 user nova-compute[74980]:   </clock>
Nov 02 17:41:29 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:41:29 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:41:29 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:41:29 user nova-compute[74980]:   </cpu>
Nov 02 17:41:29 user nova-compute[74980]:   <devices>
Nov 02 17:41:29 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:41:29 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:41:29 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk"/>
Nov 02 17:41:29 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:41:29 user nova-compute[74980]:     </disk>
Nov 02 17:41:29 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:41:29 user nova-compute[74980]:       <mac address="fa:16:3e:f1:61:10"/>
Nov 02 17:41:29 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:41:29 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:41:29 user nova-compute[74980]:       <target dev="tap8211d299-58"/>
Nov 02 17:41:29 user nova-compute[74980]:     </interface>
Nov 02 17:41:29 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:41:29 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/console.log" append="off"/>
Nov 02 17:41:29 user nova-compute[74980]:     </serial>
Nov 02 17:41:29 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:41:29 user nova-compute[74980]:     <video>
Nov 02 17:41:29 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:41:29 user nova-compute[74980]:     </video>
Nov 02 17:41:29 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:41:29 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:41:29 user nova-compute[74980]:     </rng>
Nov 02 17:41:29 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:41:29 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:41:29 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:41:29 user nova-compute[74980]:     </memballoon>
Nov 02 17:41:29 user nova-compute[74980]:   </devices>
Nov 02 17:41:29 user nova-compute[74980]: </domain>
Nov 02 17:41:29 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2079837321',display_name='tempest-VolumesSnapshotTestJSON-instance-2079837321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2079837321',id=37,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0BifwA2qOaXwY28dNiUl9FKOF8bWpdILzYGCzZAwKqjOU46koug9PzWUuA8Wf751nzcYFrAyb5HYxFCaunTOoDnpBVo98l2f6qxySuoYLKUWoMhwZlIGddZOY7EX3lDg==',key_name='tempest-keypair-440002291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8acec542cb1462996e6545c6f350e9f',ramdisk_id='',reservation_id='r-ri30h596',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2140770747',owner_user_name='tempest-VolumesSnapshotTestJSON-2140770747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:41:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d183edfc18ad4a6f91bff1e33db290c8',uuid=47ba09bb-4865-414d-a287-300c813b8576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8211d299-5825-4934-88ca-51ac34dca390", "address": "fa:16:3e:f1:61:10", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8211d299-58", "ovs_interfaceid": "8211d299-5825-4934-88ca-51ac34dca390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Converting VIF {"id": "8211d299-5825-4934-88ca-51ac34dca390", "address": "fa:16:3e:f1:61:10", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8211d299-58", "ovs_interfaceid": "8211d299-5825-4934-88ca-51ac34dca390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:61:10,bridge_name='br-int',has_traffic_filtering=True,id=8211d299-5825-4934-88ca-51ac34dca390,network=Network(61d9ee24-0604-4a72-aebc-ff80ff1f35c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8211d299-58') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG os_vif [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:61:10,bridge_name='br-int',has_traffic_filtering=True,id=8211d299-5825-4934-88ca-51ac34dca390,network=Network(61d9ee24-0604-4a72-aebc-ff80ff1f35c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8211d299-58') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70c1d9b1-8a37-572a-b253-5e48400e8c4c', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8211d299-58, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8211d299-58, col_values=(('qos', UUID('ac253790-c36b-4959-bb1c-4a818db7ec6a')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8211d299-58, col_values=(('external_ids', {'iface-id': '8211d299-5825-4934-88ca-51ac34dca390', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:61:10', 'vm-uuid': '47ba09bb-4865-414d-a287-300c813b8576'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:29 user nova-compute[74980]: INFO os_vif [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:61:10,bridge_name='br-int',has_traffic_filtering=True,id=8211d299-5825-4934-88ca-51ac34dca390,network=Network(61d9ee24-0604-4a72-aebc-ff80ff1f35c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8211d299-58')
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] No VIF found with MAC fa:16:3e:f1:61:10, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.network.neutron [req-c1dd9c86-b0d7-476c-9276-cd41373ad5af req-e2307ed3-7c19-467b-b7b1-29656d7e488d service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Updated VIF entry in instance network info cache for port 8211d299-5825-4934-88ca-51ac34dca390. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG nova.network.neutron [req-c1dd9c86-b0d7-476c-9276-cd41373ad5af req-e2307ed3-7c19-467b-b7b1-29656d7e488d service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Updating instance_info_cache with network_info: [{"id": "8211d299-5825-4934-88ca-51ac34dca390", "address": "fa:16:3e:f1:61:10", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8211d299-58", "ovs_interfaceid": "8211d299-5825-4934-88ca-51ac34dca390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:41:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c1dd9c86-b0d7-476c-9276-cd41373ad5af req-e2307ed3-7c19-467b-b7b1-29656d7e488d service nova] Releasing lock "refresh_cache-47ba09bb-4865-414d-a287-300c813b8576" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Updating instance_info_cache with network_info: [{"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:31 user nova-compute[74980]: DEBUG nova.compute.manager [req-55ea1d53-f548-44ba-a951-944fd60a8d77 req-87e1cabf-14a0-4873-9064-4b66121fd497 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received event network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:41:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-55ea1d53-f548-44ba-a951-944fd60a8d77 req-87e1cabf-14a0-4873-9064-4b66121fd497 service nova] Acquiring lock "47ba09bb-4865-414d-a287-300c813b8576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-55ea1d53-f548-44ba-a951-944fd60a8d77 req-87e1cabf-14a0-4873-9064-4b66121fd497 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-55ea1d53-f548-44ba-a951-944fd60a8d77 req-87e1cabf-14a0-4873-9064-4b66121fd497 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:31 user nova-compute[74980]: DEBUG nova.compute.manager [req-55ea1d53-f548-44ba-a951-944fd60a8d77 req-87e1cabf-14a0-4873-9064-4b66121fd497 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] No waiting events found dispatching network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:41:31 user nova-compute[74980]: WARNING nova.compute.manager [req-55ea1d53-f548-44ba-a951-944fd60a8d77 req-87e1cabf-14a0-4873-9064-4b66121fd497 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received unexpected event network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 for instance with vm_state building and task_state spawning.
Nov 02 17:41:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:41:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:41:33 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Instance spawned successfully.
Nov 02 17:41:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:41:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:41:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:41:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:41:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:41:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:41:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:41:33 user nova-compute[74980]: INFO nova.compute.manager [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 02 17:41:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:41:33 user nova-compute[74980]: INFO nova.compute.manager [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Took 6.05 seconds to build instance.
Nov 02 17:41:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-1f2a688e-8732-4ca3-8cff-94d1b3165766 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "47ba09bb-4865-414d-a287-300c813b8576" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.152s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-a0110ce4-f904-4630-8d92-3428cd5bbf61 req-403d4c62-e4d5-4ee2-95b3-2bdc8f2b43d9 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received event network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:41:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a0110ce4-f904-4630-8d92-3428cd5bbf61 req-403d4c62-e4d5-4ee2-95b3-2bdc8f2b43d9 service nova] Acquiring lock "47ba09bb-4865-414d-a287-300c813b8576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:41:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a0110ce4-f904-4630-8d92-3428cd5bbf61 req-403d4c62-e4d5-4ee2-95b3-2bdc8f2b43d9 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:41:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a0110ce4-f904-4630-8d92-3428cd5bbf61 req-403d4c62-e4d5-4ee2-95b3-2bdc8f2b43d9 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:41:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-a0110ce4-f904-4630-8d92-3428cd5bbf61 req-403d4c62-e4d5-4ee2-95b3-2bdc8f2b43d9 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] No waiting events found dispatching network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:41:33 user nova-compute[74980]: WARNING nova.compute.manager [req-a0110ce4-f904-4630-8d92-3428cd5bbf61 req-403d4c62-e4d5-4ee2-95b3-2bdc8f2b43d9 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received unexpected event network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 for instance with vm_state active and task_state None.
Nov 02 17:41:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:39 user nova-compute[74980]: DEBUG nova.compute.manager [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:41:39 user nova-compute[74980]: INFO nova.compute.manager [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] instance snapshotting
Nov 02 17:41:39 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Beginning live snapshot process
Nov 02 17:41:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json -f qcow2 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json -f qcow2" returned: 0 in 0.204s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json -f qcow2 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv52al9i2/0593df6e8948477d90dbdf34053c0034.delta 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv52al9i2/0593df6e8948477d90dbdf34053c0034.delta 1073741824" returned: 0 in 0.048s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:40 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 17:41:41 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:41:41 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:41:41 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 17:41:41 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:41:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv52al9i2/0593df6e8948477d90dbdf34053c0034.delta /opt/stack/data/nova/instances/snapshots/tmpv52al9i2/0593df6e8948477d90dbdf34053c0034 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:41:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv52al9i2/0593df6e8948477d90dbdf34053c0034.delta /opt/stack/data/nova/instances/snapshots/tmpv52al9i2/0593df6e8948477d90dbdf34053c0034" returned: 0 in 0.524s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:41:42 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Snapshot extracted, beginning image upload
Nov 02 17:41:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:44 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Snapshot image upload complete
Nov 02 17:41:44 user nova-compute[74980]: INFO nova.compute.manager [None req-f284b8f2-ee9d-421f-ad52-30dba535ca7e tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Took 5.11 seconds to snapshot the instance on the hypervisor.
Nov 02 17:41:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:41:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-7ee004b6-442c-4fac-9c0e-58fe6260e128 req-31d998ab-5fac-4c15-8a37-8358afb60e92 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received event network-changed-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:42:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-7ee004b6-442c-4fac-9c0e-58fe6260e128 req-31d998ab-5fac-4c15-8a37-8358afb60e92 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Refreshing instance network info cache due to event network-changed-cceec27b-26b9-4954-b5f7-3ca024d6862d. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:42:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7ee004b6-442c-4fac-9c0e-58fe6260e128 req-31d998ab-5fac-4c15-8a37-8358afb60e92 service nova] Acquiring lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:42:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7ee004b6-442c-4fac-9c0e-58fe6260e128 req-31d998ab-5fac-4c15-8a37-8358afb60e92 service nova] Acquired lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:42:03 user nova-compute[74980]: DEBUG nova.network.neutron [req-7ee004b6-442c-4fac-9c0e-58fe6260e128 req-31d998ab-5fac-4c15-8a37-8358afb60e92 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Refreshing network info cache for port cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:42:03 user nova-compute[74980]: DEBUG nova.network.neutron [req-7ee004b6-442c-4fac-9c0e-58fe6260e128 req-31d998ab-5fac-4c15-8a37-8358afb60e92 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Updated VIF entry in instance network info cache for port cceec27b-26b9-4954-b5f7-3ca024d6862d. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:42:03 user nova-compute[74980]: DEBUG nova.network.neutron [req-7ee004b6-442c-4fac-9c0e-58fe6260e128 req-31d998ab-5fac-4c15-8a37-8358afb60e92 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Updating instance_info_cache with network_info: [{"id": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "address": "fa:16:3e:b4:62:19", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceec27b-26", "ovs_interfaceid": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:42:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7ee004b6-442c-4fac-9c0e-58fe6260e128 req-31d998ab-5fac-4c15-8a37-8358afb60e92 service nova] Releasing lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:42:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-c5c5d9c4-41ed-4134-81c6-ceb6e72d9394 req-ca5cd61e-eb20-44a2-85ce-f534302ee8df service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received event network-changed-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:42:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-c5c5d9c4-41ed-4134-81c6-ceb6e72d9394 req-ca5cd61e-eb20-44a2-85ce-f534302ee8df service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Refreshing instance network info cache due to event network-changed-cceec27b-26b9-4954-b5f7-3ca024d6862d. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:42:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c5c5d9c4-41ed-4134-81c6-ceb6e72d9394 req-ca5cd61e-eb20-44a2-85ce-f534302ee8df service nova] Acquiring lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:42:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c5c5d9c4-41ed-4134-81c6-ceb6e72d9394 req-ca5cd61e-eb20-44a2-85ce-f534302ee8df service nova] Acquired lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:42:04 user nova-compute[74980]: DEBUG nova.network.neutron [req-c5c5d9c4-41ed-4134-81c6-ceb6e72d9394 req-ca5cd61e-eb20-44a2-85ce-f534302ee8df service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Refreshing network info cache for port cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:42:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:42:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:42:04 user nova-compute[74980]: INFO nova.compute.manager [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Detaching volume 81ab47ad-734a-4db0-9a1b-85a60bcf1b16
Nov 02 17:42:04 user nova-compute[74980]: INFO nova.virt.block_device [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Attempting to driver detach volume 81ab47ad-734a-4db0-9a1b-85a60bcf1b16 from mountpoint /dev/vdb
Nov 02 17:42:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Attempting to detach device vdb from instance 3d5b4f62-2d45-434f-bfc3-a626930b3168 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:42:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:42:04 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:42:04 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:42:04 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:42:04 user nova-compute[74980]:   <serial>81ab47ad-734a-4db0-9a1b-85a60bcf1b16</serial>
Nov 02 17:42:04 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:42:04 user nova-compute[74980]: </disk>
Nov 02 17:42:04 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:42:04 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Successfully detached device vdb from instance 3d5b4f62-2d45-434f-bfc3-a626930b3168 from the persistent domain config.
Nov 02 17:42:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d5b4f62-2d45-434f-bfc3-a626930b3168 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:42:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:42:04 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:42:04 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:42:04 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:42:04 user nova-compute[74980]:   <serial>81ab47ad-734a-4db0-9a1b-85a60bcf1b16</serial>
Nov 02 17:42:04 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:42:04 user nova-compute[74980]: </disk>
Nov 02 17:42:04 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:42:04 user nova-compute[74980]: DEBUG nova.network.neutron [req-c5c5d9c4-41ed-4134-81c6-ceb6e72d9394 req-ca5cd61e-eb20-44a2-85ce-f534302ee8df service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Updated VIF entry in instance network info cache for port cceec27b-26b9-4954-b5f7-3ca024d6862d. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:42:04 user nova-compute[74980]: DEBUG nova.network.neutron [req-c5c5d9c4-41ed-4134-81c6-ceb6e72d9394 req-ca5cd61e-eb20-44a2-85ce-f534302ee8df service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Updating instance_info_cache with network_info: [{"id": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "address": "fa:16:3e:b4:62:19", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceec27b-26", "ovs_interfaceid": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:42:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c5c5d9c4-41ed-4134-81c6-ceb6e72d9394 req-ca5cd61e-eb20-44a2-85ce-f534302ee8df service nova] Releasing lock "refresh_cache-3d5b4f62-2d45-434f-bfc3-a626930b3168" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:42:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d5b4f62-2d45-434f-bfc3-a626930b3168 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:42:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:15 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:42:17 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:42:19 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:42:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:42:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:42:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:42:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:42:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG nova.compute.manager [req-0ff105e6-841e-4f87-8412-be582727fdf4 req-b07f3631-08a2-435b-b8c3-4aff582db4af service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Received event network-changed-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG nova.compute.manager [req-0ff105e6-841e-4f87-8412-be582727fdf4 req-b07f3631-08a2-435b-b8c3-4aff582db4af service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Refreshing instance network info cache due to event network-changed-c856d77a-8cfe-4b1e-bb19-65b2adf989a3. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0ff105e6-841e-4f87-8412-be582727fdf4 req-b07f3631-08a2-435b-b8c3-4aff582db4af service nova] Acquiring lock "refresh_cache-f2bd54ca-208e-4437-a875-ba1202589736" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0ff105e6-841e-4f87-8412-be582727fdf4 req-b07f3631-08a2-435b-b8c3-4aff582db4af service nova] Acquired lock "refresh_cache-f2bd54ca-208e-4437-a875-ba1202589736" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG nova.network.neutron [req-0ff105e6-841e-4f87-8412-be582727fdf4 req-b07f3631-08a2-435b-b8c3-4aff582db4af service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Refreshing network info cache for port c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "f2bd54ca-208e-4437-a875-ba1202589736" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "f2bd54ca-208e-4437-a875-ba1202589736" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG nova.objects.instance [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lazy-loading 'flavor' on Instance uuid f2bd54ca-208e-4437-a875-ba1202589736 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "f2bd54ca-208e-4437-a875-ba1202589736" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "f2bd54ca-208e-4437-a875-ba1202589736" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "f2bd54ca-208e-4437-a875-ba1202589736" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:42:21 user nova-compute[74980]: INFO nova.compute.manager [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Attaching volume 24d3bad6-b2b4-4b0f-8133-3699531bfd34 to /dev/vdb
Nov 02 17:42:21 user nova-compute[74980]: DEBUG os_brick.utils [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4cf80e-cce9-4e21-ba8d-935ecc30baa8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG nova.network.neutron [req-0ff105e6-841e-4f87-8412-be582727fdf4 req-b07f3631-08a2-435b-b8c3-4aff582db4af service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Updated VIF entry in instance network info cache for port c856d77a-8cfe-4b1e-bb19-65b2adf989a3. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG nova.network.neutron [req-0ff105e6-841e-4f87-8412-be582727fdf4 req-b07f3631-08a2-435b-b8c3-4aff582db4af service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Updating instance_info_cache with network_info: [{"id": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "address": "fa:16:3e:c6:6e:56", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856d77a-8c", "ovs_interfaceid": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0ff105e6-841e-4f87-8412-be582727fdf4 req-b07f3631-08a2-435b-b8c3-4aff582db4af service nova] Releasing lock "refresh_cache-f2bd54ca-208e-4437-a875-ba1202589736" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[23574392-64c8-46b4-abca-c9f3483b9328]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[24385e16-44ef-4769-900b-04e75a4ae9b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8013ff-7373-46dc-bd58-291d36745568]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:42:21 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:42:21 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eebdf98-5200-480c-b3c1-bb403764d374]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG os_brick.utils [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:42:21 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Updating existing volume attachment record: 4dbb69a1-99f9-4b91-9d50-fcf5cbec5a88 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:42:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:24 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3d5b4f62-2d45-434f-bfc3-a626930b3168 is timed out.
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:24 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Successfully detached device vdb from instance 3d5b4f62-2d45-434f-bfc3-a626930b3168 from the live domain config.
Nov 02 17:42:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SagYcsHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:42:24 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:42:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f6894f-0e5f-49f7-b86f-70680318f867]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:42:24 user nova-compute[74980]: No targets found.
Nov 02 17:42:24 user nova-compute[74980]: iSNS:
Nov 02 17:42:24 user nova-compute[74980]: No targets found.
Nov 02 17:42:24 user nova-compute[74980]: STATIC:
Nov 02 17:42:24 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16
Nov 02 17:42:24 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:42:24 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:42:24 user nova-compute[74980]: FIRMWARE:
Nov 02 17:42:24 user nova-compute[74980]: No targets found.
Nov 02 17:42:24 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:42:24 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:42:24 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cb19f4-14be-4459-83a8-f2259907f173]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ca3b33-606c-4600-9b60-770a5eddd956]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 (non-flash)
Nov 02 17:42:24 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 (non-flash)
Nov 02 17:42:24 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5994569870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:42:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c2df63-4f87-4868-8527-ff0f3a17a141]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[974b9548-8e4f-409b-ae0a-7b21fbc39761]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cc4d20-c9c6-4f18-89a0-e6b4b4eefd6c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83d2e7b-4e09-4411-b5c6-5948d71453cc]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7e1ef4-4644-4961-ab15-04d845ff6fdf]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc9bc5c-5482-47c9-92e0-d73699eb5783]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16, portal: 172.16.0.220,3260]
Nov 02 17:42:25 user nova-compute[74980]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16, portal: 172.16.0.220,3260] successful.
Nov 02 17:42:25 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81ab47ad-734a-4db0-9a1b-85a60bcf1b16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c591a5d-044c-4145-a028-3322c457761a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] <== disconnect_volume: return (365ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:42:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:26 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:42:26 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=7786MB free_disk=24.861228942871094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e0a58d05-9dff-4590-a240-64826fc8243e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 3d5b4f62-2d45-434f-bfc3-a626930b3168 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance f2bd54ca-208e-4437-a875-ba1202589736 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance b774dda1-5000-4323-aaee-24e9a4029617 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 47ba09bb-4865-414d-a287-300c813b8576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.objects.instance [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lazy-loading 'flavor' on Instance uuid 3d5b4f62-2d45-434f-bfc3-a626930b3168 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-64a2549b-40f5-490b-9fdd-83ce61640c62 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.159s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:42:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:42:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:32 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:42:32 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:42:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-e0a58d05-9dff-4590-a240-64826fc8243e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:42:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-e0a58d05-9dff-4590-a240-64826fc8243e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:42:32 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:42:33 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Updating instance_info_cache with network_info: [{"id": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "address": "fa:16:3e:ad:6a:3d", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9e080b-5c", "ovs_interfaceid": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:42:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-e0a58d05-9dff-4590-a240-64826fc8243e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:42:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:42:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:42:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:42:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:42:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOiSpLWY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:42:40 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:42:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:42:40 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:42:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:42:40 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b772c3c2-2726-46cd-9b14-a38508af8e2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:42:40 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[11150e64-d718-4900-9767-46df9eb1f0ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34] added
Nov 02 17:42:40 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ee46d3-2745-4ca5-bbce-0b9e099789fb]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ae0c04-988d-4df4-8c72-753d49e54429]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOiSpLWY {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOiSpLWY" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2cf0b3-328e-472b-97bc-ac6e31c20923]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zOiSpLWY'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff53ced4-dea7-4dee-8fda-16de650d00dd]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[54995b54-9141-42df-9e03-f373a2cefe0e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:42:40 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:42:40 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:42:40 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 17:42:40 user nova-compute[74980]: 
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f135f90-d3d3-4cef-ba9e-3a85000a8887]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34, portal: 172.16.0.220,3260]
Nov 02 17:42:40 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34, portal: 172.16.0.220,3260] successful.
Nov 02 17:42:40 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:42:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c99aa94-6a96-4525-a98a-2563e1d5e06d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[779096ee-e5f4-4c79-b256-fde08d21d384]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 (non-flash)
Nov 02 17:42:41 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 (non-flash)
Nov 02 17:42:41 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb6a74e-5880-485f-bfea-fa67e97a8556]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:41 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:42:42 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:42:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOiSpLWY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:42:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:42:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23435373461663530', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:42:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435373461663530', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:42:42 user nova-compute[74980]: DEBUG nova.objects.instance [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lazy-loading 'flavor' on Instance uuid f2bd54ca-208e-4437-a875-ba1202589736 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:42:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:42:42 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:42:42 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:42:42 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:42:42 user nova-compute[74980]:   <serial>24d3bad6-b2b4-4b0f-8133-3699531bfd34</serial>
Nov 02 17:42:42 user nova-compute[74980]: </disk>
Nov 02 17:42:42 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:42:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:42:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:42:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] No VIF found with MAC fa:16:3e:c6:6e:56, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:42:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d04316aa-c1b9-448e-9c25-0bb1b37607e4 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "f2bd54ca-208e-4437-a875-ba1202589736" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.882s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:42:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "f2bd54ca-208e-4437-a875-ba1202589736" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:42:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "f2bd54ca-208e-4437-a875-ba1202589736" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:42:44 user nova-compute[74980]: INFO nova.compute.manager [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Detaching volume 24d3bad6-b2b4-4b0f-8133-3699531bfd34
Nov 02 17:42:44 user nova-compute[74980]: INFO nova.virt.block_device [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Attempting to driver detach volume 24d3bad6-b2b4-4b0f-8133-3699531bfd34 from mountpoint /dev/vdb
Nov 02 17:42:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Attempting to detach device vdb from instance f2bd54ca-208e-4437-a875-ba1202589736 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:42:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:42:44 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:42:44 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:42:44 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:42:44 user nova-compute[74980]:   <serial>24d3bad6-b2b4-4b0f-8133-3699531bfd34</serial>
Nov 02 17:42:44 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:42:44 user nova-compute[74980]: </disk>
Nov 02 17:42:44 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:42:44 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Successfully detached device vdb from instance f2bd54ca-208e-4437-a875-ba1202589736 from the persistent domain config.
Nov 02 17:42:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2bd54ca-208e-4437-a875-ba1202589736 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:42:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:42:44 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:42:44 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:42:44 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:42:44 user nova-compute[74980]:   <serial>24d3bad6-b2b4-4b0f-8133-3699531bfd34</serial>
Nov 02 17:42:44 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:42:44 user nova-compute[74980]: </disk>
Nov 02 17:42:44 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:42:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2bd54ca-208e-4437-a875-ba1202589736 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:42:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-6492e68e-8068-49a5-9e97-13120d054ac8 req-28d71c19-b87b-44b6-ba7d-e8b118c279fd service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-changed-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-6492e68e-8068-49a5-9e97-13120d054ac8 req-28d71c19-b87b-44b6-ba7d-e8b118c279fd service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Refreshing instance network info cache due to event network-changed-5c2fcde8-42ac-4ce6-a511-2221327973b0. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6492e68e-8068-49a5-9e97-13120d054ac8 req-28d71c19-b87b-44b6-ba7d-e8b118c279fd service nova] Acquiring lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6492e68e-8068-49a5-9e97-13120d054ac8 req-28d71c19-b87b-44b6-ba7d-e8b118c279fd service nova] Acquired lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG nova.network.neutron [req-6492e68e-8068-49a5-9e97-13120d054ac8 req-28d71c19-b87b-44b6-ba7d-e8b118c279fd service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Refreshing network info cache for port 5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG nova.objects.instance [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'flavor' on Instance uuid e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:42:46 user nova-compute[74980]: INFO nova.compute.manager [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Attaching volume 868973ef-76d3-4a26-ab36-414477731e07 to /dev/vdb
Nov 02 17:42:46 user nova-compute[74980]: DEBUG os_brick.utils [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3890b62-bedc-4bce-a025-d3167eb04a47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG nova.network.neutron [req-6492e68e-8068-49a5-9e97-13120d054ac8 req-28d71c19-b87b-44b6-ba7d-e8b118c279fd service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Updated VIF entry in instance network info cache for port 5c2fcde8-42ac-4ce6-a511-2221327973b0. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG nova.network.neutron [req-6492e68e-8068-49a5-9e97-13120d054ac8 req-28d71c19-b87b-44b6-ba7d-e8b118c279fd service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Updating instance_info_cache with network_info: [{"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2daaf0-df99-4266-97df-e64a13fd5e1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6492e68e-8068-49a5-9e97-13120d054ac8 req-28d71c19-b87b-44b6-ba7d-e8b118c279fd service nova] Releasing lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8150e6-dfa7-4ffe-b138-76182dd3d560]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e243ff-54ec-4694-95e5-42769a904d50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:42:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:42:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:42:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:42:47 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:42:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a5848e-085d-4aaf-b260-9e32c473bce3]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:42:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:42:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:42:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:42:47 user nova-compute[74980]: DEBUG os_brick.utils [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:42:47 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Updating existing volume attachment record: 5d845c50-76aa-462a-a44a-adf9a3163730 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:42:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "b774dda1-5000-4323-aaee-24e9a4029617" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:42:54 user nova-compute[74980]: INFO nova.compute.manager [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Terminating instance
Nov 02 17:42:54 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-e92f9e3a-107d-4518-8427-0f9286c867e6 req-4740b09f-eb67-40fe-9c6a-88e8f9384786 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-vif-unplugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e92f9e3a-107d-4518-8427-0f9286c867e6 req-4740b09f-eb67-40fe-9c6a-88e8f9384786 service nova] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e92f9e3a-107d-4518-8427-0f9286c867e6 req-4740b09f-eb67-40fe-9c6a-88e8f9384786 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e92f9e3a-107d-4518-8427-0f9286c867e6 req-4740b09f-eb67-40fe-9c6a-88e8f9384786 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-e92f9e3a-107d-4518-8427-0f9286c867e6 req-4740b09f-eb67-40fe-9c6a-88e8f9384786 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] No waiting events found dispatching network-vif-unplugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-e92f9e3a-107d-4518-8427-0f9286c867e6 req-4740b09f-eb67-40fe-9c6a-88e8f9384786 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-vif-unplugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:54 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Instance destroyed successfully.
Nov 02 17:42:54 user nova-compute[74980]: DEBUG nova.objects.instance [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lazy-loading 'resources' on Instance uuid b774dda1-5000-4323-aaee-24e9a4029617 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T17:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1725912966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1725912966',id=31,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAZ17h7BgjKLxayL4IULgvz69q0ubD3+/FIejtFzmXMm9MT0Q3A7LFHZOmkzYCIb3IhyQexjD0uZ7nJlfpErVS87eBHrOqOw2GrQ5LYutL7QUVe8umSQ8yBmUtiSWCgkw==',key_name='tempest-keypair-679286581',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:41:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccb03b0bde444fbc82be742d0027c0ec',ramdisk_id='',reservation_id='r-rwm0tx71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1991165793',owner_user_name='tempest-AttachVolumeShelveTestJSON-1991165793-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:41:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1f92dd53761465592b6d5390090f59f',uuid=b774dda1-5000-4323-aaee-24e9a4029617,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converting VIF {"id": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "address": "fa:16:3e:51:ec:ff", "network": {"id": "d441b8be-1bf4-4143-b3b5-bfcc521272e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1500891392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb03b0bde444fbc82be742d0027c0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4b9759-99", "ovs_interfaceid": "1f4b9759-99d5-4507-b639-c9755c5da9c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:ec:ff,bridge_name='br-int',has_traffic_filtering=True,id=1f4b9759-99d5-4507-b639-c9755c5da9c2,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4b9759-99') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG os_vif [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:ec:ff,bridge_name='br-int',has_traffic_filtering=True,id=1f4b9759-99d5-4507-b639-c9755c5da9c2,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4b9759-99') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f4b9759-99, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76463a93-13f0-46b2-9ab3-1a2930e9c342) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:54 user nova-compute[74980]: INFO os_vif [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:ec:ff,bridge_name='br-int',has_traffic_filtering=True,id=1f4b9759-99d5-4507-b639-c9755c5da9c2,network=Network(d441b8be-1bf4-4143-b3b5-bfcc521272e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4b9759-99')
Nov 02 17:42:54 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Deleting instance files /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617_del
Nov 02 17:42:54 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Deletion of /opt/stack/data/nova/instances/b774dda1-5000-4323-aaee-24e9a4029617_del complete
Nov 02 17:42:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:55 user nova-compute[74980]: INFO nova.compute.manager [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 02 17:42:55 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:42:55 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:42:55 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: b774dda1-5000-4323-aaee-24e9a4029617] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:42:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:42:55 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:42:55 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Took 0.81 seconds to deallocate network for instance.
Nov 02 17:42:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-db49c5ed-b7ad-4c43-aee8-79c3cb60f080 req-1d46507e-8c23-4dd8-a929-2d9b28511808 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-vif-deleted-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:42:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:42:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:42:56 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:42:56 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:42:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:42:56 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Deleted allocations for instance b774dda1-5000-4323-aaee-24e9a4029617
Nov 02 17:42:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d32e7214-752b-487e-8fe1-33abd4406d09 tempest-AttachVolumeShelveTestJSON-1991165793 tempest-AttachVolumeShelveTestJSON-1991165793-project-member] Lock "b774dda1-5000-4323-aaee-24e9a4029617" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.210s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:42:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-2042842c-7ca3-4953-a209-74ba2e14fe31 req-76f30e43-96c9-4491-a89a-64c41a3341a3 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:42:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2042842c-7ca3-4953-a209-74ba2e14fe31 req-76f30e43-96c9-4491-a89a-64c41a3341a3 service nova] Acquiring lock "b774dda1-5000-4323-aaee-24e9a4029617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:42:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2042842c-7ca3-4953-a209-74ba2e14fe31 req-76f30e43-96c9-4491-a89a-64c41a3341a3 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:42:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2042842c-7ca3-4953-a209-74ba2e14fe31 req-76f30e43-96c9-4491-a89a-64c41a3341a3 service nova] Lock "b774dda1-5000-4323-aaee-24e9a4029617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:42:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-2042842c-7ca3-4953-a209-74ba2e14fe31 req-76f30e43-96c9-4491-a89a-64c41a3341a3 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] No waiting events found dispatching network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:42:56 user nova-compute[74980]: WARNING nova.compute.manager [req-2042842c-7ca3-4953-a209-74ba2e14fe31 req-76f30e43-96c9-4491-a89a-64c41a3341a3 service nova] [instance: b774dda1-5000-4323-aaee-24e9a4029617] Received unexpected event network-vif-plugged-1f4b9759-99d5-4507-b639-c9755c5da9c2 for instance with vm_state deleted and task_state None.
Nov 02 17:42:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:04 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f2bd54ca-208e-4437-a875-ba1202589736 is timed out.
Nov 02 17:43:04 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Successfully detached device vdb from instance f2bd54ca-208e-4437-a875-ba1202589736 from the live domain config.
Nov 02 17:43:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:43:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOiSpLWY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:43:04 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:43:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:43:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:43:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd12a1a9-f2a1-4c19-a49d-54561eb12a51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:43:05 user nova-compute[74980]: No targets found.
Nov 02 17:43:05 user nova-compute[74980]: iSNS:
Nov 02 17:43:05 user nova-compute[74980]: No targets found.
Nov 02 17:43:05 user nova-compute[74980]: STATIC:
Nov 02 17:43:05 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34
Nov 02 17:43:05 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:43:05 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:43:05 user nova-compute[74980]: FIRMWARE:
Nov 02 17:43:05 user nova-compute[74980]: No targets found.
Nov 02 17:43:05 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:43:05 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:43:05 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6763af-d57b-40b8-9e7e-b497843852d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8888e404-9922-47e2-ac27-47c2c3ab9d06]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 (non-flash)
Nov 02 17:43:05 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 (non-flash)
Nov 02 17:43:05 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b4610790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb416ed-e1e7-48ae-91a8-0a1652ae5242]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3d5bb3-9e7d-447f-abc9-58b957d4d2fd]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[806bf07e-a8aa-4cbd-9f82-153595b4be32]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[256e6317-8e96-4f3d-b275-cc00b0fa55f5]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfc5062-a4d9-42ed-a9d1-c12b6fb7ecb4]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb5fd25-febd-4f0c-a528-93174654ba07]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34, portal: 172.16.0.220,3260]
Nov 02 17:43:05 user nova-compute[74980]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34, portal: 172.16.0.220,3260] successful.
Nov 02 17:43:05 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24d3bad6-b2b4-4b0f-8133-3699531bfd34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af988aa-ac9c-4a66-b3f5-d76c1d1db4dd]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] <== disconnect_volume: return (292ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:05 user nova-compute[74980]: INFO nova.compute.manager [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Terminating instance
Nov 02 17:43:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-fd4684db-e00c-4bc3-8035-3d6c8ba45226 req-918746d5-5393-4709-bad6-82af89c4ecf1 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received event network-vif-unplugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fd4684db-e00c-4bc3-8035-3d6c8ba45226 req-918746d5-5393-4709-bad6-82af89c4ecf1 service nova] Acquiring lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fd4684db-e00c-4bc3-8035-3d6c8ba45226 req-918746d5-5393-4709-bad6-82af89c4ecf1 service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fd4684db-e00c-4bc3-8035-3d6c8ba45226 req-918746d5-5393-4709-bad6-82af89c4ecf1 service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-fd4684db-e00c-4bc3-8035-3d6c8ba45226 req-918746d5-5393-4709-bad6-82af89c4ecf1 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] No waiting events found dispatching network-vif-unplugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:43:05 user nova-compute[74980]: DEBUG nova.compute.manager [req-fd4684db-e00c-4bc3-8035-3d6c8ba45226 req-918746d5-5393-4709-bad6-82af89c4ecf1 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received event network-vif-unplugged-cceec27b-26b9-4954-b5f7-3ca024d6862d for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG nova.objects.instance [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lazy-loading 'flavor' on Instance uuid f2bd54ca-208e-4437-a875-ba1202589736 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-7a1f4b65-05a7-41cf-bca9-27a199d4277c tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "f2bd54ca-208e-4437-a875-ba1202589736" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.796s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvFkMhnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:43:06 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:43:06 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:43:06 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Instance destroyed successfully.
Nov 02 17:43:06 user nova-compute[74980]: DEBUG nova.objects.instance [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lazy-loading 'resources' on Instance uuid 3d5b4f62-2d45-434f-bfc3-a626930b3168 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-14048985',display_name='tempest-TestMinimumBasicScenario-server-14048985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-14048985',id=32,image_ref='76cac6b4-4c51-42d2-93b6-849aead8e2bf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIjb3Y87hHQhBb3pfcRe2JyREOLL5k96Z8E6gGjgvqQ/X1WF9InmCeMhiqeDOCYLfnjsVLFxyitfQTTSdDsgiopYKZTUk2O5pY3bIsJ+pnrbu7F3Z7rctmHSqZ3yiZnog==',key_name='tempest-TestMinimumBasicScenario-1717062256',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad1b48d7070548bdae52f005ce12d606',ramdisk_id='',reservation_id='r-d1jqxwo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='76cac6b4-4c51-42d2-93b6-849aead8e2bf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-487832598',owner_user_name='tempest-TestMinimumBasicScenario-487832598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:40:19Z,user_data=None,user_id='46cbf858998242a1a5d8b14b0e56cace',uuid=3d5b4f62-2d45-434f-bfc3-a626930b3168,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "address": "fa:16:3e:b4:62:19", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceec27b-26", "ovs_interfaceid": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converting VIF {"id": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "address": "fa:16:3e:b4:62:19", "network": {"id": "cc725416-9eaa-4543-979a-068b4cbe8fd1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-947473324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad1b48d7070548bdae52f005ce12d606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcceec27b-26", "ovs_interfaceid": "cceec27b-26b9-4954-b5f7-3ca024d6862d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:62:19,bridge_name='br-int',has_traffic_filtering=True,id=cceec27b-26b9-4954-b5f7-3ca024d6862d,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcceec27b-26') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_vif [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:62:19,bridge_name='br-int',has_traffic_filtering=True,id=cceec27b-26b9-4954-b5f7-3ca024d6862d,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcceec27b-26') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a66bb3-d6b3-4eae-b7d4-aa61cefc4d94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:43:06 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcceec27b-26, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfe1669e-f1ba-4b76-9a7f-1813acd048d5) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:43:06 user nova-compute[74980]: INFO os_vif [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:62:19,bridge_name='br-int',has_traffic_filtering=True,id=cceec27b-26b9-4954-b5f7-3ca024d6862d,network=Network(cc725416-9eaa-4543-979a-068b4cbe8fd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcceec27b-26')
Nov 02 17:43:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Deleting instance files /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168_del
Nov 02 17:43:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Deletion of /opt/stack/data/nova/instances/3d5b4f62-2d45-434f-bfc3-a626930b3168_del complete
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1271e5-a64b-4eca-ae24-96be86ad2f38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07] added
Nov 02 17:43:06 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd18a56-8d97-4f42-b1b7-49e8b86f273a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ccb177-86b0-47b8-89ec-8c43f4837c94]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvFkMhnP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:06 user nova-compute[74980]: INFO nova.compute.manager [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvFkMhnP" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9191133b-8d8b-4a99-b33d-afec640d9436]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LvFkMhnP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99ca180-acfa-435f-9849-6f1bfed6a9e8]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dfc6ae-f794-4a29-a375-40d35a3b0f3b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:43:06 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 17:43:06 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:43:06 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 17:43:06 user nova-compute[74980]: 
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f0fe5e-7cfc-48b1-8f16-04ca2867e321]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07, portal: 172.16.0.220,3260]
Nov 02 17:43:06 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07, portal: 172.16.0.220,3260] successful.
Nov 02 17:43:06 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9be148f-f498-4022-98f1-5828a5bf488e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2457053c-60c6-4c0d-b3e9-d9d85a88fa2b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:43:06 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:43:06 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6326d4b6-cd91-456d-b4f7-b9fe5c92178f]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvFkMhnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:43:06 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Took 0.46 seconds to deallocate network for instance.
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:07 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Deleted allocations for instance 3d5b4f62-2d45-434f-bfc3-a626930b3168
Nov 02 17:43:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5ab4e75a-ecbc-4034-8b11-f6fe8a3dc1a3 tempest-TestMinimumBasicScenario-487832598 tempest-TestMinimumBasicScenario-487832598-project-member] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.789s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26133383330306161', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133383330306161', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG nova.objects.instance [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'flavor' on Instance uuid e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:43:07 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:43:07 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:43:07 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:43:07 user nova-compute[74980]:   <serial>868973ef-76d3-4a26-ab36-414477731e07</serial>
Nov 02 17:43:07 user nova-compute[74980]: </disk>
Nov 02 17:43:07 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG nova.compute.manager [req-4f67ed69-a198-4661-bea7-6cc579373e38 req-777e97a4-9d32-4783-9458-326d13ff3454 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received event network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4f67ed69-a198-4661-bea7-6cc579373e38 req-777e97a4-9d32-4783-9458-326d13ff3454 service nova] Acquiring lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4f67ed69-a198-4661-bea7-6cc579373e38 req-777e97a4-9d32-4783-9458-326d13ff3454 service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4f67ed69-a198-4661-bea7-6cc579373e38 req-777e97a4-9d32-4783-9458-326d13ff3454 service nova] Lock "3d5b4f62-2d45-434f-bfc3-a626930b3168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG nova.compute.manager [req-4f67ed69-a198-4661-bea7-6cc579373e38 req-777e97a4-9d32-4783-9458-326d13ff3454 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] No waiting events found dispatching network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:43:07 user nova-compute[74980]: WARNING nova.compute.manager [req-4f67ed69-a198-4661-bea7-6cc579373e38 req-777e97a4-9d32-4783-9458-326d13ff3454 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received unexpected event network-vif-plugged-cceec27b-26b9-4954-b5f7-3ca024d6862d for instance with vm_state deleted and task_state None.
Nov 02 17:43:07 user nova-compute[74980]: DEBUG nova.compute.manager [req-4f67ed69-a198-4661-bea7-6cc579373e38 req-777e97a4-9d32-4783-9458-326d13ff3454 service nova] [instance: 3d5b4f62-2d45-434f-bfc3-a626930b3168] Received event network-vif-deleted-cceec27b-26b9-4954-b5f7-3ca024d6862d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:43:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No VIF found with MAC fa:16:3e:fb:47:7d, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:43:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-81487934-78c9-4a53-952f-f0e7920e6fb6 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.249s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:08 user nova-compute[74980]: INFO nova.compute.manager [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Rescuing
Nov 02 17:43:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:43:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquired lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:43:08 user nova-compute[74980]: DEBUG nova.network.neutron [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:43:08 user nova-compute[74980]: DEBUG nova.network.neutron [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Updating instance_info_cache with network_info: [{"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:43:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Releasing lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:09 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Instance destroyed successfully.
Nov 02 17:43:09 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Attempting rescue
Nov 02 17:43:09 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74980) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Instance directory exists: not creating {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 17:43:09 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Creating image(s)
Nov 02 17:43:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "/opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "/opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG nova.objects.instance [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'trusted_certs' on Instance uuid e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-bba8fcce-7498-4431-acd7-7a5107a88501 req-fb5ba3d8-474a-4979-a3a4-3768e94e22a1 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-vif-unplugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bba8fcce-7498-4431-acd7-7a5107a88501 req-fb5ba3d8-474a-4979-a3a4-3768e94e22a1 service nova] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bba8fcce-7498-4431-acd7-7a5107a88501 req-fb5ba3d8-474a-4979-a3a4-3768e94e22a1 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bba8fcce-7498-4431-acd7-7a5107a88501 req-fb5ba3d8-474a-4979-a3a4-3768e94e22a1 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-bba8fcce-7498-4431-acd7-7a5107a88501 req-fb5ba3d8-474a-4979-a3a4-3768e94e22a1 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] No waiting events found dispatching network-vif-unplugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:43:09 user nova-compute[74980]: WARNING nova.compute.manager [req-bba8fcce-7498-4431-acd7-7a5107a88501 req-fb5ba3d8-474a-4979-a3a4-3768e94e22a1 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received unexpected event network-vif-unplugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 for instance with vm_state active and task_state rescuing.
Nov 02 17:43:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-bba8fcce-7498-4431-acd7-7a5107a88501 req-fb5ba3d8-474a-4979-a3a4-3768e94e22a1 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bba8fcce-7498-4431-acd7-7a5107a88501 req-fb5ba3d8-474a-4979-a3a4-3768e94e22a1 service nova] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bba8fcce-7498-4431-acd7-7a5107a88501 req-fb5ba3d8-474a-4979-a3a4-3768e94e22a1 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bba8fcce-7498-4431-acd7-7a5107a88501 req-fb5ba3d8-474a-4979-a3a4-3768e94e22a1 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-bba8fcce-7498-4431-acd7-7a5107a88501 req-fb5ba3d8-474a-4979-a3a4-3768e94e22a1 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] No waiting events found dispatching network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:43:09 user nova-compute[74980]: WARNING nova.compute.manager [req-bba8fcce-7498-4431-acd7-7a5107a88501 req-fb5ba3d8-474a-4979-a3a4-3768e94e22a1 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received unexpected event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 for instance with vm_state active and task_state rescuing.
Nov 02 17:43:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.rescue {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.rescue" returned: 0 in 0.064s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'migration_context' on Instance uuid e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.objects.base [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Object Instance<e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Start _get_guest_xml network_info=[{"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "vif_mac": "fa:16:3e:fb:47:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'resources' on Instance uuid e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.objects.base [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Object Instance<e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'numa_topology' on Instance uuid e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.objects.base [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Object Instance<e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:43:10 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:43:10 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'vcpu_model' on Instance uuid e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.objects.base [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Object Instance<e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-138862382',display_name='tempest-ServerRescueNegativeTestJSON-server-138862382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-138862382',id=36,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuKStpw7DFbvE328Zxz9Ykoa6CbmGKIXVv7rsiKwiyCOeuaJ+jFMFcOErWQ4L9ovcgKgiR4rEnBp5BAytU14OHeYTIQY2iDkgxpilQGkmZHmFvAu7SJaLIUa1aKbiX3/Q==',key_name='tempest-keypair-1369605087',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:41:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc26ef1932f1408c860b3b9edb4925a4',ramdisk_id='',reservation_id='r-spzm07ce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-86632079',owner_user_name='tempest-ServerRescueNegativeTestJSON-86632079-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:41:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='985386b6880e4b07bdad162c7860d7a3',uuid=e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "vif_mac": "fa:16:3e:fb:47:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converting VIF {"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "vif_mac": "fa:16:3e:fb:47:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:47:7d,bridge_name='br-int',has_traffic_filtering=True,id=5c2fcde8-42ac-4ce6-a511-2221327973b0,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2fcde8-42') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'pci_devices' on Instance uuid e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.objects.base [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Object Instance<e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:43:10 user nova-compute[74980]:   <uuid>e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e</uuid>
Nov 02 17:43:10 user nova-compute[74980]:   <name>instance-00000024</name>
Nov 02 17:43:10 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:43:10 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:43:10 user nova-compute[74980]:   <metadata>
Nov 02 17:43:10 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:43:10 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:43:10 user nova-compute[74980]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-138862382</nova:name>
Nov 02 17:43:10 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:43:10</nova:creationTime>
Nov 02 17:43:10 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:43:10 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:43:10 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:43:10 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:43:10 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:43:10 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:43:10 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:43:10 user nova-compute[74980]:       <nova:owner>
Nov 02 17:43:10 user nova-compute[74980]:         <nova:user uuid="985386b6880e4b07bdad162c7860d7a3">tempest-ServerRescueNegativeTestJSON-86632079-project-member</nova:user>
Nov 02 17:43:10 user nova-compute[74980]:         <nova:project uuid="dc26ef1932f1408c860b3b9edb4925a4">tempest-ServerRescueNegativeTestJSON-86632079</nova:project>
Nov 02 17:43:10 user nova-compute[74980]:       </nova:owner>
Nov 02 17:43:10 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:43:10 user nova-compute[74980]:       <nova:ports>
Nov 02 17:43:10 user nova-compute[74980]:         <nova:port uuid="5c2fcde8-42ac-4ce6-a511-2221327973b0">
Nov 02 17:43:10 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 17:43:10 user nova-compute[74980]:         </nova:port>
Nov 02 17:43:10 user nova-compute[74980]:       </nova:ports>
Nov 02 17:43:10 user nova-compute[74980]:     </nova:instance>
Nov 02 17:43:10 user nova-compute[74980]:   </metadata>
Nov 02 17:43:10 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:43:10 user nova-compute[74980]:     <system>
Nov 02 17:43:10 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:43:10 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:43:10 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:43:10 user nova-compute[74980]:       <entry name="serial">e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e</entry>
Nov 02 17:43:10 user nova-compute[74980]:       <entry name="uuid">e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e</entry>
Nov 02 17:43:10 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:43:10 user nova-compute[74980]:     </system>
Nov 02 17:43:10 user nova-compute[74980]:   </sysinfo>
Nov 02 17:43:10 user nova-compute[74980]:   <os>
Nov 02 17:43:10 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:43:10 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:43:10 user nova-compute[74980]:   </os>
Nov 02 17:43:10 user nova-compute[74980]:   <features>
Nov 02 17:43:10 user nova-compute[74980]:     <acpi/>
Nov 02 17:43:10 user nova-compute[74980]:     <apic/>
Nov 02 17:43:10 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:43:10 user nova-compute[74980]:   </features>
Nov 02 17:43:10 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:43:10 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:43:10 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:43:10 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:43:10 user nova-compute[74980]:   </clock>
Nov 02 17:43:10 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:43:10 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:43:10 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:43:10 user nova-compute[74980]:   </cpu>
Nov 02 17:43:10 user nova-compute[74980]:   <devices>
Nov 02 17:43:10 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:43:10 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:43:10 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.rescue"/>
Nov 02 17:43:10 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:43:10 user nova-compute[74980]:     </disk>
Nov 02 17:43:10 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:43:10 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:43:10 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk"/>
Nov 02 17:43:10 user nova-compute[74980]:       <target dev="vdb" bus="virtio"/>
Nov 02 17:43:10 user nova-compute[74980]:     </disk>
Nov 02 17:43:10 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:43:10 user nova-compute[74980]:       <mac address="fa:16:3e:fb:47:7d"/>
Nov 02 17:43:10 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:43:10 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:43:10 user nova-compute[74980]:       <target dev="tap5c2fcde8-42"/>
Nov 02 17:43:10 user nova-compute[74980]:     </interface>
Nov 02 17:43:10 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:43:10 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/console.log" append="off"/>
Nov 02 17:43:10 user nova-compute[74980]:     </serial>
Nov 02 17:43:10 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:43:10 user nova-compute[74980]:     <video>
Nov 02 17:43:10 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:43:10 user nova-compute[74980]:     </video>
Nov 02 17:43:10 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:43:10 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:43:10 user nova-compute[74980]:     </rng>
Nov 02 17:43:10 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:43:10 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:43:10 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:43:10 user nova-compute[74980]:     </memballoon>
Nov 02 17:43:10 user nova-compute[74980]:   </devices>
Nov 02 17:43:10 user nova-compute[74980]: </domain>
Nov 02 17:43:10 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:43:10 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Instance destroyed successfully.
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:43:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] No VIF found with MAC fa:16:3e:fb:47:7d, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:43:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-082dbbcc-6f30-4daa-a81d-0ba6abb145e1 req-d0742750-7dc6-484d-b5cd-58d397424c24 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:43:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-082dbbcc-6f30-4daa-a81d-0ba6abb145e1 req-d0742750-7dc6-484d-b5cd-58d397424c24 service nova] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-082dbbcc-6f30-4daa-a81d-0ba6abb145e1 req-d0742750-7dc6-484d-b5cd-58d397424c24 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-082dbbcc-6f30-4daa-a81d-0ba6abb145e1 req-d0742750-7dc6-484d-b5cd-58d397424c24 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-082dbbcc-6f30-4daa-a81d-0ba6abb145e1 req-d0742750-7dc6-484d-b5cd-58d397424c24 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] No waiting events found dispatching network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:43:11 user nova-compute[74980]: WARNING nova.compute.manager [req-082dbbcc-6f30-4daa-a81d-0ba6abb145e1 req-d0742750-7dc6-484d-b5cd-58d397424c24 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received unexpected event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 for instance with vm_state active and task_state rescuing.
Nov 02 17:43:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-9e428035-68e8-4ba3-8768-001c293ed440 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:43:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-fcfb7381-102d-4ee6-a24d-d4dceae4ce23 req-c3b41aeb-4bba-4e1e-9fcb-bb87c1efc5f5 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:43:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fcfb7381-102d-4ee6-a24d-d4dceae4ce23 req-c3b41aeb-4bba-4e1e-9fcb-bb87c1efc5f5 service nova] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fcfb7381-102d-4ee6-a24d-d4dceae4ce23 req-c3b41aeb-4bba-4e1e-9fcb-bb87c1efc5f5 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fcfb7381-102d-4ee6-a24d-d4dceae4ce23 req-c3b41aeb-4bba-4e1e-9fcb-bb87c1efc5f5 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-fcfb7381-102d-4ee6-a24d-d4dceae4ce23 req-c3b41aeb-4bba-4e1e-9fcb-bb87c1efc5f5 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] No waiting events found dispatching network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:43:13 user nova-compute[74980]: WARNING nova.compute.manager [req-fcfb7381-102d-4ee6-a24d-d4dceae4ce23 req-c3b41aeb-4bba-4e1e-9fcb-bb87c1efc5f5 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received unexpected event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 for instance with vm_state rescued and task_state None.
Nov 02 17:43:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:17 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:43:17 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG nova.compute.manager [req-dd1c5ae1-26bf-42cc-8ee3-64e6b646bb3e req-0916bef9-dd92-4909-8c47-a7a52463b981 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received event network-changed-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG nova.compute.manager [req-dd1c5ae1-26bf-42cc-8ee3-64e6b646bb3e req-0916bef9-dd92-4909-8c47-a7a52463b981 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Refreshing instance network info cache due to event network-changed-8211d299-5825-4934-88ca-51ac34dca390. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd1c5ae1-26bf-42cc-8ee3-64e6b646bb3e req-0916bef9-dd92-4909-8c47-a7a52463b981 service nova] Acquiring lock "refresh_cache-47ba09bb-4865-414d-a287-300c813b8576" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd1c5ae1-26bf-42cc-8ee3-64e6b646bb3e req-0916bef9-dd92-4909-8c47-a7a52463b981 service nova] Acquired lock "refresh_cache-47ba09bb-4865-414d-a287-300c813b8576" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG nova.network.neutron [req-dd1c5ae1-26bf-42cc-8ee3-64e6b646bb3e req-0916bef9-dd92-4909-8c47-a7a52463b981 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Refreshing network info cache for port 8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "47ba09bb-4865-414d-a287-300c813b8576" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "47ba09bb-4865-414d-a287-300c813b8576" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG nova.objects.instance [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lazy-loading 'flavor' on Instance uuid 47ba09bb-4865-414d-a287-300c813b8576 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:43:18 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Ignoring supplied device name: /dev/vdb
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "47ba09bb-4865-414d-a287-300c813b8576" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "47ba09bb-4865-414d-a287-300c813b8576" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "47ba09bb-4865-414d-a287-300c813b8576" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:18 user nova-compute[74980]: INFO nova.compute.manager [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Attaching volume 34884392-f416-4929-b042-089c8f7d2e74 to /dev/vdb
Nov 02 17:43:18 user nova-compute[74980]: DEBUG nova.network.neutron [req-dd1c5ae1-26bf-42cc-8ee3-64e6b646bb3e req-0916bef9-dd92-4909-8c47-a7a52463b981 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Updated VIF entry in instance network info cache for port 8211d299-5825-4934-88ca-51ac34dca390. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG nova.network.neutron [req-dd1c5ae1-26bf-42cc-8ee3-64e6b646bb3e req-0916bef9-dd92-4909-8c47-a7a52463b981 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Updating instance_info_cache with network_info: [{"id": "8211d299-5825-4934-88ca-51ac34dca390", "address": "fa:16:3e:f1:61:10", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8211d299-58", "ovs_interfaceid": "8211d299-5825-4934-88ca-51ac34dca390", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dd1c5ae1-26bf-42cc-8ee3-64e6b646bb3e req-0916bef9-dd92-4909-8c47-a7a52463b981 service nova] Releasing lock "refresh_cache-47ba09bb-4865-414d-a287-300c813b8576" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG os_brick.utils [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2df972-e055-4397-8da8-68ab8ffd577b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8483a15a-396c-4c2e-9607-8043ab7f5e61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[841b515e-be7f-4d70-85b2-eabca8cb2b36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83a1fcc-9479-4b6a-910d-431c03ea9e04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:43:18 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:43:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9a2ac7-b671-46f6-ae65-655b6c6f3198]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG os_brick.utils [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:43:18 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Updating existing volume attachment record: 3be4fa75-f5bf-40d7-aedf-cec37911e3cd {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:43:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:20 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:43:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:43:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:21 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:43:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:22 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:43:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:25 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:43:25 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:43:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8226MB free_disk=24.914451599121094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e0a58d05-9dff-4590-a240-64826fc8243e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance f2bd54ca-208e-4437-a875-ba1202589736 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 47ba09bb-4865-414d-a287-300c813b8576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing inventories for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating ProviderTree inventory for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating inventory in ProviderTree for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing aggregate associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, aggregates: None {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 17:43:25 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing trait associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 17:43:26 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:43:26 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:43:26 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:43:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.964s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:26 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:43:26 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 17:43:26 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] There are 0 instances to clean {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 17:43:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:27 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:43:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:43:27 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:43:28 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:43:28 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:43:29 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:43:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:30 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:43:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:32 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:43:32 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:43:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:43:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:43:32 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:43:33 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Updating instance_info_cache with network_info: [{"id": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "address": "fa:16:3e:7c:b8:1b", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6fd444-02", "ovs_interfaceid": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:43:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:43:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-1591ee90-f8cf-4c77-ac78-ca76e0a25b38 req-d570cd19-197c-4330-83e8-57d64d5c7de1 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Received event network-changed-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-1591ee90-f8cf-4c77-ac78-ca76e0a25b38 req-d570cd19-197c-4330-83e8-57d64d5c7de1 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Refreshing instance network info cache due to event network-changed-c856d77a-8cfe-4b1e-bb19-65b2adf989a3. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1591ee90-f8cf-4c77-ac78-ca76e0a25b38 req-d570cd19-197c-4330-83e8-57d64d5c7de1 service nova] Acquiring lock "refresh_cache-f2bd54ca-208e-4437-a875-ba1202589736" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1591ee90-f8cf-4c77-ac78-ca76e0a25b38 req-d570cd19-197c-4330-83e8-57d64d5c7de1 service nova] Acquired lock "refresh_cache-f2bd54ca-208e-4437-a875-ba1202589736" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG nova.network.neutron [req-1591ee90-f8cf-4c77-ac78-ca76e0a25b38 req-d570cd19-197c-4330-83e8-57d64d5c7de1 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Refreshing network info cache for port c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "f2bd54ca-208e-4437-a875-ba1202589736" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "f2bd54ca-208e-4437-a875-ba1202589736" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "f2bd54ca-208e-4437-a875-ba1202589736-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "f2bd54ca-208e-4437-a875-ba1202589736-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "f2bd54ca-208e-4437-a875-ba1202589736-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:35 user nova-compute[74980]: INFO nova.compute.manager [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Terminating instance
Nov 02 17:43:35 user nova-compute[74980]: DEBUG nova.compute.manager [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG nova.network.neutron [req-1591ee90-f8cf-4c77-ac78-ca76e0a25b38 req-d570cd19-197c-4330-83e8-57d64d5c7de1 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Updated VIF entry in instance network info cache for port c856d77a-8cfe-4b1e-bb19-65b2adf989a3. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG nova.network.neutron [req-1591ee90-f8cf-4c77-ac78-ca76e0a25b38 req-d570cd19-197c-4330-83e8-57d64d5c7de1 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Updating instance_info_cache with network_info: [{"id": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "address": "fa:16:3e:c6:6e:56", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856d77a-8c", "ovs_interfaceid": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:43:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1591ee90-f8cf-4c77-ac78-ca76e0a25b38 req-d570cd19-197c-4330-83e8-57d64d5c7de1 service nova] Releasing lock "refresh_cache-f2bd54ca-208e-4437-a875-ba1202589736" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:43:36 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Instance destroyed successfully.
Nov 02 17:43:36 user nova-compute[74980]: DEBUG nova.objects.instance [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lazy-loading 'resources' on Instance uuid f2bd54ca-208e-4437-a875-ba1202589736 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:40:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-376902537',display_name='tempest-TestStampPattern-server-376902537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-376902537',id=35,image_ref='d2f35379-a5bd-45c5-aa72-8da85b56baf1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6brPZ2uQ9G456sHLwslPBKMXH8Tx/nIMEedR+0YOFh5yPB/1XbhrPSZGlKxJ15/1VDK+MwShvhsv4pet6TNLtaVxKcGhLuXiTb4JdYXaSjCd+QqbzzQiSp5KWOqpajXQ==',key_name='tempest-TestStampPattern-1458079072',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:40:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45b461c7b3824820a1fd88721ddbebd6',ramdisk_id='',reservation_id='r-pi0o0ui5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e0a58d05-9dff-4590-a240-64826fc8243e',image_min_disk='1',image_min_ram='0',image_owner_id='45b461c7b3824820a1fd88721ddbebd6',image_owner_project_name='tempest-TestStampPattern-1736614362',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1736614362-project-member',image_user_id='87f4ea9506264174bdbcd706e8cc877d',owner_project_name='tempest-TestStampPattern-1736614362',owner_user_name='tempest-TestStampPattern-1736614362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:40:36Z,user_data=None,user_id='87f4ea9506264174bdbcd706e8cc877d',uuid=f2bd54ca-208e-4437-a875-ba1202589736,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "address": "fa:16:3e:c6:6e:56", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856d77a-8c", "ovs_interfaceid": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Converting VIF {"id": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "address": "fa:16:3e:c6:6e:56", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc856d77a-8c", "ovs_interfaceid": "c856d77a-8cfe-4b1e-bb19-65b2adf989a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:6e:56,bridge_name='br-int',has_traffic_filtering=True,id=c856d77a-8cfe-4b1e-bb19-65b2adf989a3,network=Network(067a0d22-4891-42a5-8cf2-d95882454841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc856d77a-8c') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG os_vif [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:6e:56,bridge_name='br-int',has_traffic_filtering=True,id=c856d77a-8cfe-4b1e-bb19-65b2adf989a3,network=Network(067a0d22-4891-42a5-8cf2-d95882454841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc856d77a-8c') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc856d77a-8c, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f21ebbb-b3be-4860-bc88-d414c2245501) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:36 user nova-compute[74980]: INFO os_vif [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:6e:56,bridge_name='br-int',has_traffic_filtering=True,id=c856d77a-8cfe-4b1e-bb19-65b2adf989a3,network=Network(067a0d22-4891-42a5-8cf2-d95882454841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc856d77a-8c')
Nov 02 17:43:36 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Deleting instance files /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736_del
Nov 02 17:43:36 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Deletion of /opt/stack/data/nova/instances/f2bd54ca-208e-4437-a875-ba1202589736_del complete
Nov 02 17:43:36 user nova-compute[74980]: INFO nova.compute.manager [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 02 17:43:36 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: f2bd54ca-208e-4437-a875-ba1202589736] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:36 user nova-compute[74980]: DEBUG nova.compute.manager [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:43:37 user nova-compute[74980]: INFO nova.compute.claims [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Claim successful on node user
Nov 02 17:43:37 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Took 0.62 seconds to deallocate network for instance.
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.compute.manager [req-71999ce5-389e-449a-92d2-8ee42ff0693f req-9fec94ea-6d49-4a9c-89f2-6775dbe013ce service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Received event network-vif-deleted-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:43:37 user nova-compute[74980]: INFO nova.compute.manager [req-71999ce5-389e-449a-92d2-8ee42ff0693f req-9fec94ea-6d49-4a9c-89f2-6775dbe013ce service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Neutron deleted interface c856d77a-8cfe-4b1e-bb19-65b2adf989a3; detaching it from the instance and deleting it from the info cache
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.network.neutron [req-71999ce5-389e-449a-92d2-8ee42ff0693f req-9fec94ea-6d49-4a9c-89f2-6775dbe013ce service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.compute.manager [req-71999ce5-389e-449a-92d2-8ee42ff0693f req-9fec94ea-6d49-4a9c-89f2-6775dbe013ce service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Detach interface failed, port_id=c856d77a-8cfe-4b1e-bb19-65b2adf989a3, reason: Instance f2bd54ca-208e-4437-a875-ba1202589736 could not be found. {{(pid=74980) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.compute.manager [req-7301d08d-7af6-452c-ad2e-296090e46b4e req-e88e7e4d-a86d-4263-a13a-b1e2c8f17ed3 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Received event network-vif-unplugged-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7301d08d-7af6-452c-ad2e-296090e46b4e req-e88e7e4d-a86d-4263-a13a-b1e2c8f17ed3 service nova] Acquiring lock "f2bd54ca-208e-4437-a875-ba1202589736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7301d08d-7af6-452c-ad2e-296090e46b4e req-e88e7e4d-a86d-4263-a13a-b1e2c8f17ed3 service nova] Lock "f2bd54ca-208e-4437-a875-ba1202589736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7301d08d-7af6-452c-ad2e-296090e46b4e req-e88e7e4d-a86d-4263-a13a-b1e2c8f17ed3 service nova] Lock "f2bd54ca-208e-4437-a875-ba1202589736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.compute.manager [req-7301d08d-7af6-452c-ad2e-296090e46b4e req-e88e7e4d-a86d-4263-a13a-b1e2c8f17ed3 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] No waiting events found dispatching network-vif-unplugged-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:43:37 user nova-compute[74980]: WARNING nova.compute.manager [req-7301d08d-7af6-452c-ad2e-296090e46b4e req-e88e7e4d-a86d-4263-a13a-b1e2c8f17ed3 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Received unexpected event network-vif-unplugged-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 for instance with vm_state deleted and task_state None.
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.compute.manager [req-7301d08d-7af6-452c-ad2e-296090e46b4e req-e88e7e4d-a86d-4263-a13a-b1e2c8f17ed3 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Received event network-vif-plugged-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7301d08d-7af6-452c-ad2e-296090e46b4e req-e88e7e4d-a86d-4263-a13a-b1e2c8f17ed3 service nova] Acquiring lock "f2bd54ca-208e-4437-a875-ba1202589736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7301d08d-7af6-452c-ad2e-296090e46b4e req-e88e7e4d-a86d-4263-a13a-b1e2c8f17ed3 service nova] Lock "f2bd54ca-208e-4437-a875-ba1202589736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7301d08d-7af6-452c-ad2e-296090e46b4e req-e88e7e4d-a86d-4263-a13a-b1e2c8f17ed3 service nova] Lock "f2bd54ca-208e-4437-a875-ba1202589736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.compute.manager [req-7301d08d-7af6-452c-ad2e-296090e46b4e req-e88e7e4d-a86d-4263-a13a-b1e2c8f17ed3 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] No waiting events found dispatching network-vif-plugged-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:43:37 user nova-compute[74980]: WARNING nova.compute.manager [req-7301d08d-7af6-452c-ad2e-296090e46b4e req-e88e7e4d-a86d-4263-a13a-b1e2c8f17ed3 service nova] [instance: f2bd54ca-208e-4437-a875-ba1202589736] Received unexpected event network-vif-plugged-c856d77a-8cfe-4b1e-bb19-65b2adf989a3 for instance with vm_state deleted and task_state None.
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.308s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.network.neutron [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:43:37 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.policy [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fef01429fb294195984431fd3699f78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11e1bb23618243ddb099bc6855aa2f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:43:37 user nova-compute[74980]: INFO nova.virt.block_device [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Booting with blank volume at /dev/vda
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:43:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:37 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Deleted allocations for instance f2bd54ca-208e-4437-a875-ba1202589736
Nov 02 17:43:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f53c4eb7-f6ce-478f-8d96-4007390d54a5 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "f2bd54ca-208e-4437-a875-ba1202589736" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.605s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edJFWVHt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:43:38 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:43:38 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:43:38 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[682b8786-803f-4e3b-8390-3fe9595c29e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:43:38 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6713629f-ba31-4389-9490-05e0e4728421]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74] added
Nov 02 17:43:38 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[667d9286-1854-4202-ab1b-4f7248d4635b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d26f2b-6484-4cc0-bd8c-db9b9f4f110d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edJFWVHt {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG nova.network.neutron [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Successfully created port: c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edJFWVHt" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[371e0edd-51e1-4d41-81c1-68dfa4e097df]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'edJFWVHt'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a411819-5550-497c-a06e-c9ba3a0a5f0e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bc1391-e1d8-4ec8-ae71-370248f5ace4]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:43:38 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:43:38 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0a9662-a264-4855-8853-3309265ba6ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74, portal: 172.16.0.220,3260]
Nov 02 17:43:38 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74, portal: 172.16.0.220,3260] successful.
Nov 02 17:43:38 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[884ac3b5-189a-47cb-82db-10cdafd89144]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a6c9ee-9814-410f-91a0-1734aa148b52]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:43:38 user nova-compute[74980]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 (non-flash)
Nov 02 17:43:38 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:43:38 user nova-compute[74980]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 (non-flash)
Nov 02 17:43:38 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8476909-55e2-4ece-b804-ff9983466aa1]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edJFWVHt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG nova.network.neutron [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Successfully updated port: c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquired lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:43:38 user nova-compute[74980]: DEBUG nova.network.neutron [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG nova.network.neutron [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG nova.compute.manager [req-81036f04-c5aa-4c33-bb36-b959b673dada req-d9f2d3ee-1f65-4415-9ddc-000856c1cb1c service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received event network-changed-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG nova.compute.manager [req-81036f04-c5aa-4c33-bb36-b959b673dada req-d9f2d3ee-1f65-4415-9ddc-000856c1cb1c service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Refreshing instance network info cache due to event network-changed-c27b6981-9e85-4496-a959-a3ae4e377b34. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-81036f04-c5aa-4c33-bb36-b959b673dada req-d9f2d3ee-1f65-4415-9ddc-000856c1cb1c service nova] Acquiring lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG nova.network.neutron [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Updating instance_info_cache with network_info: [{"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Releasing lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG nova.compute.manager [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Instance network_info: |[{"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-81036f04-c5aa-4c33-bb36-b959b673dada req-d9f2d3ee-1f65-4415-9ddc-000856c1cb1c service nova] Acquired lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG nova.network.neutron [req-81036f04-c5aa-4c33-bb36-b959b673dada req-d9f2d3ee-1f65-4415-9ddc-000856c1cb1c service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Refreshing network info cache for port c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23733313564373661', 'path': '/dev/sdc'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733313564373661', 'path': '/dev/sdc'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG nova.objects.instance [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lazy-loading 'flavor' on Instance uuid 47ba09bb-4865-414d-a287-300c813b8576 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:43:39 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:43:39 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:43:39 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:43:39 user nova-compute[74980]:   <serial>34884392-f416-4929-b042-089c8f7d2e74</serial>
Nov 02 17:43:39 user nova-compute[74980]: </disk>
Nov 02 17:43:39 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG nova.network.neutron [req-81036f04-c5aa-4c33-bb36-b959b673dada req-d9f2d3ee-1f65-4415-9ddc-000856c1cb1c service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Updated VIF entry in instance network info cache for port c27b6981-9e85-4496-a959-a3ae4e377b34. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG nova.network.neutron [req-81036f04-c5aa-4c33-bb36-b959b673dada req-d9f2d3ee-1f65-4415-9ddc-000856c1cb1c service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Updating instance_info_cache with network_info: [{"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-81036f04-c5aa-4c33-bb36-b959b673dada req-d9f2d3ee-1f65-4415-9ddc-000856c1cb1c service nova] Releasing lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:43:39 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] No VIF found with MAC fa:16:3e:f1:61:10, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:43:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-abbe2a04-084c-4e8a-87fa-601b765a238a tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "47ba09bb-4865-414d-a287-300c813b8576" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.445s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:43:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:42 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:43:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74980) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG os_brick.utils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a9257d-4484-47fa-b691-31b29122ed0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb40423-cc28-4bef-9304-f07c58a8b09a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc323e4-5d0c-4c8e-b93a-371255c2a732]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3cca69-6d90-41c1-8aea-2299192d9bd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:43:43 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:43:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10c3e29-36d4-4594-aeaf-332aa631ff65]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG os_brick.utils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:43:43 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Updating existing volume attachment record: cf1714f7-fa59-453d-bad5-6b5804b4584c {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:43:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:43:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:43:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:44:03 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Creating image(s)
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Ensure instance console log exists: /opt/stack/data/nova/instances/6ea56f31-932f-42f8-987c-13ef46d2d9f7/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Start _get_guest_xml network_info=[{"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgGUnODw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6ea56f31-932f-42f8-987c-13ef46d2d9f7', 'attached_at': '', 'detached_at': '', 'volume_id': '53f2f947-128b-4fb6-a7ae-b47bb2f37187', 'serial': '53f2f947-128b-4fb6-a7ae-b47bb2f37187'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'cf1714f7-fa59-453d-bad5-6b5804b4584c', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:44:03 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:44:03 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgGUnODw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:44:03 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:44:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:44:03 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:44:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:44:03 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f1ee63-dce6-4c91-a0ed-c8a098996f20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:44:03 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b359f685-581b-41e6-b104-6aff102087fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187] added
Nov 02 17:44:03 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1073d754-4ea8-4594-bc52-161ad1c7e808]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cee712d-d54f-4725-93da-d73111db43d2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fgGUnODw {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fgGUnODw" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b864917e-c853-44e8-8e01-d414ee2964a3]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fgGUnODw'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d32c00-1424-4f5f-aa07-f493ceceb6ff]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a51627-c0b8-4085-8c6c-52a6ae140fbc]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:44:03 user nova-compute[74980]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 (non-flash)
Nov 02 17:44:03 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:44:03 user nova-compute[74980]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 (non-flash)
Nov 02 17:44:03 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[702882b3-acf7-4264-846b-6ddcec7ce121]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187, portal: 172.16.0.220,3260]
Nov 02 17:44:03 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187, portal: 172.16.0.220,3260] successful.
Nov 02 17:44:03 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:44:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.063s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7113df5-8f95-487b-99c0-72d29b0ea76c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ec0dca-1d90-40f2-a188-3998d99f5963]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:44:04 user nova-compute[74980]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 (non-flash)
Nov 02 17:44:04 user nova-compute[74980]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:44:04 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:44:04 user nova-compute[74980]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 (non-flash)
Nov 02 17:44:04 user nova-compute[74980]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:44:04 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ecbc56-a619-40d7-b8a0-5c855aafb4bd]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:44:04 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgGUnODw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23138336336656137', 'path': '/dev/sdd'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138336336656137', 'path': '/dev/sdd'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-463257605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-463257605',id=38,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11e1bb23618243ddb099bc6855aa2f64',ramdisk_id='',reservation_id='r-9drnnags',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-36491096',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:43:38Z,user_data=None,user_id='fef01429fb294195984431fd3699f78b',uuid=6ea56f31-932f-42f8-987c-13ef46d2d9f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converting VIF {"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ca:e6,bridge_name='br-int',has_traffic_filtering=True,id=c27b6981-9e85-4496-a959-a3ae4e377b34,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc27b6981-9e') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG nova.objects.instance [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ea56f31-932f-42f8-987c-13ef46d2d9f7 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:44:05 user nova-compute[74980]:   <uuid>6ea56f31-932f-42f8-987c-13ef46d2d9f7</uuid>
Nov 02 17:44:05 user nova-compute[74980]:   <name>instance-00000026</name>
Nov 02 17:44:05 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:44:05 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:44:05 user nova-compute[74980]:   <metadata>
Nov 02 17:44:05 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:44:05 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:44:05 user nova-compute[74980]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-463257605</nova:name>
Nov 02 17:44:05 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:44:03</nova:creationTime>
Nov 02 17:44:05 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:44:05 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:44:05 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:44:05 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:44:05 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:44:05 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:44:05 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:44:05 user nova-compute[74980]:       <nova:owner>
Nov 02 17:44:05 user nova-compute[74980]:         <nova:user uuid="fef01429fb294195984431fd3699f78b">tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member</nova:user>
Nov 02 17:44:05 user nova-compute[74980]:         <nova:project uuid="11e1bb23618243ddb099bc6855aa2f64">tempest-ServerBootFromVolumeStableRescueTest-36491096</nova:project>
Nov 02 17:44:05 user nova-compute[74980]:       </nova:owner>
Nov 02 17:44:05 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:44:05 user nova-compute[74980]:       <nova:ports>
Nov 02 17:44:05 user nova-compute[74980]:         <nova:port uuid="c27b6981-9e85-4496-a959-a3ae4e377b34">
Nov 02 17:44:05 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 17:44:05 user nova-compute[74980]:         </nova:port>
Nov 02 17:44:05 user nova-compute[74980]:       </nova:ports>
Nov 02 17:44:05 user nova-compute[74980]:     </nova:instance>
Nov 02 17:44:05 user nova-compute[74980]:   </metadata>
Nov 02 17:44:05 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:44:05 user nova-compute[74980]:     <system>
Nov 02 17:44:05 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:44:05 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:44:05 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:44:05 user nova-compute[74980]:       <entry name="serial">6ea56f31-932f-42f8-987c-13ef46d2d9f7</entry>
Nov 02 17:44:05 user nova-compute[74980]:       <entry name="uuid">6ea56f31-932f-42f8-987c-13ef46d2d9f7</entry>
Nov 02 17:44:05 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:44:05 user nova-compute[74980]:     </system>
Nov 02 17:44:05 user nova-compute[74980]:   </sysinfo>
Nov 02 17:44:05 user nova-compute[74980]:   <os>
Nov 02 17:44:05 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:44:05 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:44:05 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:44:05 user nova-compute[74980]:   </os>
Nov 02 17:44:05 user nova-compute[74980]:   <features>
Nov 02 17:44:05 user nova-compute[74980]:     <acpi/>
Nov 02 17:44:05 user nova-compute[74980]:     <apic/>
Nov 02 17:44:05 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:44:05 user nova-compute[74980]:   </features>
Nov 02 17:44:05 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:44:05 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:44:05 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:44:05 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:44:05 user nova-compute[74980]:   </clock>
Nov 02 17:44:05 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:44:05 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:44:05 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:44:05 user nova-compute[74980]:   </cpu>
Nov 02 17:44:05 user nova-compute[74980]:   <devices>
Nov 02 17:44:05 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:44:05 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:44:05 user nova-compute[74980]:       <source dev="/dev/sdd"/>
Nov 02 17:44:05 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:44:05 user nova-compute[74980]:       <serial>53f2f947-128b-4fb6-a7ae-b47bb2f37187</serial>
Nov 02 17:44:05 user nova-compute[74980]:     </disk>
Nov 02 17:44:05 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:44:05 user nova-compute[74980]:       <mac address="fa:16:3e:da:ca:e6"/>
Nov 02 17:44:05 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:44:05 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:44:05 user nova-compute[74980]:       <target dev="tapc27b6981-9e"/>
Nov 02 17:44:05 user nova-compute[74980]:     </interface>
Nov 02 17:44:05 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:44:05 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/6ea56f31-932f-42f8-987c-13ef46d2d9f7/console.log" append="off"/>
Nov 02 17:44:05 user nova-compute[74980]:     </serial>
Nov 02 17:44:05 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:44:05 user nova-compute[74980]:     <video>
Nov 02 17:44:05 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:44:05 user nova-compute[74980]:     </video>
Nov 02 17:44:05 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:44:05 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:44:05 user nova-compute[74980]:     </rng>
Nov 02 17:44:05 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:44:05 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:44:05 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:44:05 user nova-compute[74980]:     </memballoon>
Nov 02 17:44:05 user nova-compute[74980]:   </devices>
Nov 02 17:44:05 user nova-compute[74980]: </domain>
Nov 02 17:44:05 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-463257605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-463257605',id=38,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11e1bb23618243ddb099bc6855aa2f64',ramdisk_id='',reservation_id='r-9drnnags',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-36491096',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:43:38Z,user_data=None,user_id='fef01429fb294195984431fd3699f78b',uuid=6ea56f31-932f-42f8-987c-13ef46d2d9f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converting VIF {"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ca:e6,bridge_name='br-int',has_traffic_filtering=True,id=c27b6981-9e85-4496-a959-a3ae4e377b34,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc27b6981-9e') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG os_vif [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ca:e6,bridge_name='br-int',has_traffic_filtering=True,id=c27b6981-9e85-4496-a959-a3ae4e377b34,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc27b6981-9e') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e43e4b07-840b-5191-884b-2bda2052b68d', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc27b6981-9e, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc27b6981-9e, col_values=(('qos', UUID('5571764b-2359-44cf-b26c-ae9f689a02de')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc27b6981-9e, col_values=(('external_ids', {'iface-id': 'c27b6981-9e85-4496-a959-a3ae4e377b34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:ca:e6', 'vm-uuid': '6ea56f31-932f-42f8-987c-13ef46d2d9f7'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:05 user nova-compute[74980]: INFO os_vif [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ca:e6,bridge_name='br-int',has_traffic_filtering=True,id=c27b6981-9e85-4496-a959-a3ae4e377b34,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc27b6981-9e')
Nov 02 17:44:05 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:44:05 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] No VIF found with MAC fa:16:3e:da:ca:e6, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:44:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:07 user nova-compute[74980]: DEBUG nova.compute.manager [req-1d8bc202-2a18-465c-afbd-0304dc450a6a req-0b50c1a7-4415-4fac-9f1d-6a3c18202a06 service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:44:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1d8bc202-2a18-465c-afbd-0304dc450a6a req-0b50c1a7-4415-4fac-9f1d-6a3c18202a06 service nova] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1d8bc202-2a18-465c-afbd-0304dc450a6a req-0b50c1a7-4415-4fac-9f1d-6a3c18202a06 service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1d8bc202-2a18-465c-afbd-0304dc450a6a req-0b50c1a7-4415-4fac-9f1d-6a3c18202a06 service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:07 user nova-compute[74980]: DEBUG nova.compute.manager [req-1d8bc202-2a18-465c-afbd-0304dc450a6a req-0b50c1a7-4415-4fac-9f1d-6a3c18202a06 service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] No waiting events found dispatching network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:44:07 user nova-compute[74980]: WARNING nova.compute.manager [req-1d8bc202-2a18-465c-afbd-0304dc450a6a req-0b50c1a7-4415-4fac-9f1d-6a3c18202a06 service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received unexpected event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 for instance with vm_state building and task_state spawning.
Nov 02 17:44:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:44:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:44:08 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Instance spawned successfully.
Nov 02 17:44:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:44:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:44:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:44:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:44:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:44:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:44:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:44:08 user nova-compute[74980]: INFO nova.compute.manager [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 02 17:44:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:44:09 user nova-compute[74980]: INFO nova.compute.manager [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Took 32.02 seconds to build instance.
Nov 02 17:44:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-beb577bf-1b40-49b0-997c-189029b09608 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.166s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-239f08d2-1c01-4644-ad7a-7254d492410a req-f549daae-dd2e-4080-b1c9-149074c28467 service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:44:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-239f08d2-1c01-4644-ad7a-7254d492410a req-f549daae-dd2e-4080-b1c9-149074c28467 service nova] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-239f08d2-1c01-4644-ad7a-7254d492410a req-f549daae-dd2e-4080-b1c9-149074c28467 service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-239f08d2-1c01-4644-ad7a-7254d492410a req-f549daae-dd2e-4080-b1c9-149074c28467 service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-239f08d2-1c01-4644-ad7a-7254d492410a req-f549daae-dd2e-4080-b1c9-149074c28467 service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] No waiting events found dispatching network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:44:09 user nova-compute[74980]: WARNING nova.compute.manager [req-239f08d2-1c01-4644-ad7a-7254d492410a req-f549daae-dd2e-4080-b1c9-149074c28467 service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received unexpected event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 for instance with vm_state active and task_state None.
Nov 02 17:44:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:17 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:44:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:18 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG nova.compute.manager [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:44:20 user nova-compute[74980]: INFO nova.compute.claims [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Claim successful on node user
Nov 02 17:44:20 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG nova.compute.manager [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG nova.compute.manager [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG nova.network.neutron [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:44:20 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:44:20 user nova-compute[74980]: DEBUG nova.compute.manager [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG nova.policy [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dea42f332a54314a6ffc0790bd66240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8271dee2adb499dae5bbd63662036e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG nova.compute.manager [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:44:20 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Creating image(s)
Nov 02 17:44:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "/opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "/opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:20 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.165s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk 1073741824" returned: 0 in 0.045s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG nova.network.neutron [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Successfully created port: ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Cannot resize image /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Ensure instance console log exists: /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.network.neutron [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Successfully updated port: ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquired lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.network.neutron [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.compute.manager [req-2c270211-af6e-457d-a28f-5f78e6fcc092 req-de9110b2-ba1c-4fa0-9654-49087f386130 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-changed-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.compute.manager [req-2c270211-af6e-457d-a28f-5f78e6fcc092 req-de9110b2-ba1c-4fa0-9654-49087f386130 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Refreshing instance network info cache due to event network-changed-ea0afd21-0732-4572-97d1-63b55c6e5655. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2c270211-af6e-457d-a28f-5f78e6fcc092 req-de9110b2-ba1c-4fa0-9654-49087f386130 service nova] Acquiring lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.network.neutron [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.network.neutron [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Updating instance_info_cache with network_info: [{"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Releasing lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Instance network_info: |[{"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2c270211-af6e-457d-a28f-5f78e6fcc092 req-de9110b2-ba1c-4fa0-9654-49087f386130 service nova] Acquired lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.network.neutron [req-2c270211-af6e-457d-a28f-5f78e6fcc092 req-de9110b2-ba1c-4fa0-9654-49087f386130 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Refreshing network info cache for port ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Start _get_guest_xml network_info=[{"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:44:22 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:44:22 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-250854749',display_name='tempest-AttachVolumeTestJSON-server-250854749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-250854749',id=39,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6JAtpXxXAMk37Fjkmu/ZPyEKNAoZCsurgqR46mBWz93eP3XOv624lEH1cEe8AD13EovSi2qgytX7qPhQWZ2yoWROF90MH23x4k9KH5UB+HXi+XcSNSHRnM1ZBy5kZltQ==',key_name='tempest-keypair-503867642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8271dee2adb499dae5bbd63662036e0',ramdisk_id='',reservation_id='r-l2gruwx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-847432967',owner_user_name='tempest-AttachVolumeTestJSON-847432967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:44:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dea42f332a54314a6ffc0790bd66240',uuid=cfef8d27-a749-4469-912b-b272c0080f03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converting VIF {"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.objects.instance [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'pci_devices' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:44:22 user nova-compute[74980]:   <uuid>cfef8d27-a749-4469-912b-b272c0080f03</uuid>
Nov 02 17:44:22 user nova-compute[74980]:   <name>instance-00000027</name>
Nov 02 17:44:22 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:44:22 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:44:22 user nova-compute[74980]:   <metadata>
Nov 02 17:44:22 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:44:22 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:44:22 user nova-compute[74980]:       <nova:name>tempest-AttachVolumeTestJSON-server-250854749</nova:name>
Nov 02 17:44:22 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:44:22</nova:creationTime>
Nov 02 17:44:22 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:44:22 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:44:22 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:44:22 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:44:22 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:44:22 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:44:22 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:44:22 user nova-compute[74980]:       <nova:owner>
Nov 02 17:44:22 user nova-compute[74980]:         <nova:user uuid="3dea42f332a54314a6ffc0790bd66240">tempest-AttachVolumeTestJSON-847432967-project-member</nova:user>
Nov 02 17:44:22 user nova-compute[74980]:         <nova:project uuid="d8271dee2adb499dae5bbd63662036e0">tempest-AttachVolumeTestJSON-847432967</nova:project>
Nov 02 17:44:22 user nova-compute[74980]:       </nova:owner>
Nov 02 17:44:22 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:44:22 user nova-compute[74980]:       <nova:ports>
Nov 02 17:44:22 user nova-compute[74980]:         <nova:port uuid="ea0afd21-0732-4572-97d1-63b55c6e5655">
Nov 02 17:44:22 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 17:44:22 user nova-compute[74980]:         </nova:port>
Nov 02 17:44:22 user nova-compute[74980]:       </nova:ports>
Nov 02 17:44:22 user nova-compute[74980]:     </nova:instance>
Nov 02 17:44:22 user nova-compute[74980]:   </metadata>
Nov 02 17:44:22 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:44:22 user nova-compute[74980]:     <system>
Nov 02 17:44:22 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:44:22 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:44:22 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:44:22 user nova-compute[74980]:       <entry name="serial">cfef8d27-a749-4469-912b-b272c0080f03</entry>
Nov 02 17:44:22 user nova-compute[74980]:       <entry name="uuid">cfef8d27-a749-4469-912b-b272c0080f03</entry>
Nov 02 17:44:22 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:44:22 user nova-compute[74980]:     </system>
Nov 02 17:44:22 user nova-compute[74980]:   </sysinfo>
Nov 02 17:44:22 user nova-compute[74980]:   <os>
Nov 02 17:44:22 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:44:22 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:44:22 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:44:22 user nova-compute[74980]:   </os>
Nov 02 17:44:22 user nova-compute[74980]:   <features>
Nov 02 17:44:22 user nova-compute[74980]:     <acpi/>
Nov 02 17:44:22 user nova-compute[74980]:     <apic/>
Nov 02 17:44:22 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:44:22 user nova-compute[74980]:   </features>
Nov 02 17:44:22 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:44:22 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:44:22 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:44:22 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:44:22 user nova-compute[74980]:   </clock>
Nov 02 17:44:22 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:44:22 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:44:22 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:44:22 user nova-compute[74980]:   </cpu>
Nov 02 17:44:22 user nova-compute[74980]:   <devices>
Nov 02 17:44:22 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:44:22 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:44:22 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk"/>
Nov 02 17:44:22 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:44:22 user nova-compute[74980]:     </disk>
Nov 02 17:44:22 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:44:22 user nova-compute[74980]:       <mac address="fa:16:3e:d9:e5:54"/>
Nov 02 17:44:22 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:44:22 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:44:22 user nova-compute[74980]:       <target dev="tapea0afd21-07"/>
Nov 02 17:44:22 user nova-compute[74980]:     </interface>
Nov 02 17:44:22 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:44:22 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/console.log" append="off"/>
Nov 02 17:44:22 user nova-compute[74980]:     </serial>
Nov 02 17:44:22 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:44:22 user nova-compute[74980]:     <video>
Nov 02 17:44:22 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:44:22 user nova-compute[74980]:     </video>
Nov 02 17:44:22 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:44:22 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:44:22 user nova-compute[74980]:     </rng>
Nov 02 17:44:22 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:44:22 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:44:22 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:44:22 user nova-compute[74980]:     </memballoon>
Nov 02 17:44:22 user nova-compute[74980]:   </devices>
Nov 02 17:44:22 user nova-compute[74980]: </domain>
Nov 02 17:44:22 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-250854749',display_name='tempest-AttachVolumeTestJSON-server-250854749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-250854749',id=39,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6JAtpXxXAMk37Fjkmu/ZPyEKNAoZCsurgqR46mBWz93eP3XOv624lEH1cEe8AD13EovSi2qgytX7qPhQWZ2yoWROF90MH23x4k9KH5UB+HXi+XcSNSHRnM1ZBy5kZltQ==',key_name='tempest-keypair-503867642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8271dee2adb499dae5bbd63662036e0',ramdisk_id='',reservation_id='r-l2gruwx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-847432967',owner_user_name='tempest-AttachVolumeTestJSON-847432967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:44:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dea42f332a54314a6ffc0790bd66240',uuid=cfef8d27-a749-4469-912b-b272c0080f03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converting VIF {"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG os_vif [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85dfbe5a-5fb1-52fe-8d55-631a0e2a843e', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea0afd21-07, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea0afd21-07, col_values=(('qos', UUID('e4a5eb55-771a-47fb-84ec-42c99f5cfcc6')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea0afd21-07, col_values=(('external_ids', {'iface-id': 'ea0afd21-0732-4572-97d1-63b55c6e5655', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:e5:54', 'vm-uuid': 'cfef8d27-a749-4469-912b-b272c0080f03'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:22 user nova-compute[74980]: INFO os_vif [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07')
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] No VIF found with MAC fa:16:3e:d9:e5:54, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.network.neutron [req-2c270211-af6e-457d-a28f-5f78e6fcc092 req-de9110b2-ba1c-4fa0-9654-49087f386130 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Updated VIF entry in instance network info cache for port ea0afd21-0732-4572-97d1-63b55c6e5655. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG nova.network.neutron [req-2c270211-af6e-457d-a28f-5f78e6fcc092 req-de9110b2-ba1c-4fa0-9654-49087f386130 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Updating instance_info_cache with network_info: [{"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:44:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2c270211-af6e-457d-a28f-5f78e6fcc092 req-de9110b2-ba1c-4fa0-9654-49087f386130 service nova] Releasing lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:44:23 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:44:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:23 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:44:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-0b1af882-5066-4122-a3c1-a0764e7b5c28 req-d7977ed5-0f68-4dae-8c99-6d7f24218287 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:44:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0b1af882-5066-4122-a3c1-a0764e7b5c28 req-d7977ed5-0f68-4dae-8c99-6d7f24218287 service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0b1af882-5066-4122-a3c1-a0764e7b5c28 req-d7977ed5-0f68-4dae-8c99-6d7f24218287 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0b1af882-5066-4122-a3c1-a0764e7b5c28 req-d7977ed5-0f68-4dae-8c99-6d7f24218287 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-0b1af882-5066-4122-a3c1-a0764e7b5c28 req-d7977ed5-0f68-4dae-8c99-6d7f24218287 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:44:24 user nova-compute[74980]: WARNING nova.compute.manager [req-0b1af882-5066-4122-a3c1-a0764e7b5c28 req-d7977ed5-0f68-4dae-8c99-6d7f24218287 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received unexpected event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with vm_state building and task_state spawning.
Nov 02 17:44:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG nova.compute.manager [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:44:26 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Instance spawned successfully.
Nov 02 17:44:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-4657dcc6-2268-40e1-a5b4-3398a3a92bb2 req-078be0ce-8420-456e-9fee-ebfdd0c88020 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4657dcc6-2268-40e1-a5b4-3398a3a92bb2 req-078be0ce-8420-456e-9fee-ebfdd0c88020 service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4657dcc6-2268-40e1-a5b4-3398a3a92bb2 req-078be0ce-8420-456e-9fee-ebfdd0c88020 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4657dcc6-2268-40e1-a5b4-3398a3a92bb2 req-078be0ce-8420-456e-9fee-ebfdd0c88020 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-4657dcc6-2268-40e1-a5b4-3398a3a92bb2 req-078be0ce-8420-456e-9fee-ebfdd0c88020 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:44:26 user nova-compute[74980]: WARNING nova.compute.manager [req-4657dcc6-2268-40e1-a5b4-3398a3a92bb2 req-078be0ce-8420-456e-9fee-ebfdd0c88020 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received unexpected event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with vm_state building and task_state spawning.
Nov 02 17:44:26 user nova-compute[74980]: INFO nova.compute.manager [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 02 17:44:26 user nova-compute[74980]: DEBUG nova.compute.manager [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:26 user nova-compute[74980]: INFO nova.compute.manager [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Took 6.34 seconds to build instance.
Nov 02 17:44:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-574695e6-9ac0-498f-8918-17c3d65af72c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.454s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:44:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:44:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:44:28 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:44:28 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:44:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8248MB free_disk=24.94310760498047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e0a58d05-9dff-4590-a240-64826fc8243e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 47ba09bb-4865-414d-a287-300c813b8576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cfef8d27-a749-4469-912b-b272c0080f03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:44:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid c6bfac8f-3834-4514-9a56-59c293ced966 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid 91bccf34-87a9-48f3-bbc7-4a70b9753036 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid e0a58d05-9dff-4590-a240-64826fc8243e {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid a1f33052-902f-44ef-b758-67cfc144416c {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid 47ba09bb-4865-414d-a287-300c813b8576 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid 6ea56f31-932f-42f8-987c-13ef46d2d9f7 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "c6bfac8f-3834-4514-9a56-59c293ced966" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "e0a58d05-9dff-4590-a240-64826fc8243e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "e0a58d05-9dff-4590-a240-64826fc8243e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "a1f33052-902f-44ef-b758-67cfc144416c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "a1f33052-902f-44ef-b758-67cfc144416c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "47ba09bb-4865-414d-a287-300c813b8576" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "47ba09bb-4865-414d-a287-300c813b8576" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "cfef8d27-a749-4469-912b-b272c0080f03" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "e0a58d05-9dff-4590-a240-64826fc8243e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "47ba09bb-4865-414d-a287-300c813b8576" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "cfef8d27-a749-4469-912b-b272c0080f03" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "c6bfac8f-3834-4514-9a56-59c293ced966" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "a1f33052-902f-44ef-b758-67cfc144416c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:30 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:44:32 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:44:32 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:44:32 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 17:44:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:44:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:44:32 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:44:32 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid c6bfac8f-3834-4514-9a56-59c293ced966 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:44:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:33 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Updating instance_info_cache with network_info: [{"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:44:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-c6bfac8f-3834-4514-9a56-59c293ced966" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:44:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:44:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "47ba09bb-4865-414d-a287-300c813b8576" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "47ba09bb-4865-414d-a287-300c813b8576" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:47 user nova-compute[74980]: INFO nova.compute.manager [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Detaching volume 34884392-f416-4929-b042-089c8f7d2e74
Nov 02 17:44:47 user nova-compute[74980]: INFO nova.virt.block_device [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Attempting to driver detach volume 34884392-f416-4929-b042-089c8f7d2e74 from mountpoint /dev/vdb
Nov 02 17:44:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Attempting to detach device vdb from instance 47ba09bb-4865-414d-a287-300c813b8576 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:44:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:44:47 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:44:47 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:44:47 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:44:47 user nova-compute[74980]:   <serial>34884392-f416-4929-b042-089c8f7d2e74</serial>
Nov 02 17:44:47 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:44:47 user nova-compute[74980]: </disk>
Nov 02 17:44:47 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:44:47 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Successfully detached device vdb from instance 47ba09bb-4865-414d-a287-300c813b8576 from the persistent domain config.
Nov 02 17:44:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 47ba09bb-4865-414d-a287-300c813b8576 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:44:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:44:47 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:44:47 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:44:47 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:44:47 user nova-compute[74980]:   <serial>34884392-f416-4929-b042-089c8f7d2e74</serial>
Nov 02 17:44:47 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:44:47 user nova-compute[74980]: </disk>
Nov 02 17:44:47 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:44:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "47ba09bb-4865-414d-a287-300c813b8576" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 47ba09bb-4865-414d-a287-300c813b8576 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:44:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-b977b804-71da-41ea-82f2-13622a019fb8 req-e9bef579-f646-4d04-aa5e-32e399f4f4e7 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Received event network-changed-2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG nova.compute.manager [req-b977b804-71da-41ea-82f2-13622a019fb8 req-e9bef579-f646-4d04-aa5e-32e399f4f4e7 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Refreshing instance network info cache due to event network-changed-2d9e080b-5c93-4e9a-bbaa-a354d9056614. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b977b804-71da-41ea-82f2-13622a019fb8 req-e9bef579-f646-4d04-aa5e-32e399f4f4e7 service nova] Acquiring lock "refresh_cache-e0a58d05-9dff-4590-a240-64826fc8243e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b977b804-71da-41ea-82f2-13622a019fb8 req-e9bef579-f646-4d04-aa5e-32e399f4f4e7 service nova] Acquired lock "refresh_cache-e0a58d05-9dff-4590-a240-64826fc8243e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG nova.network.neutron [req-b977b804-71da-41ea-82f2-13622a019fb8 req-e9bef579-f646-4d04-aa5e-32e399f4f4e7 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Refreshing network info cache for port 2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "e0a58d05-9dff-4590-a240-64826fc8243e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "e0a58d05-9dff-4590-a240-64826fc8243e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "e0a58d05-9dff-4590-a240-64826fc8243e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "e0a58d05-9dff-4590-a240-64826fc8243e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "e0a58d05-9dff-4590-a240-64826fc8243e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:49 user nova-compute[74980]: INFO nova.compute.manager [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Terminating instance
Nov 02 17:44:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG nova.network.neutron [req-b977b804-71da-41ea-82f2-13622a019fb8 req-e9bef579-f646-4d04-aa5e-32e399f4f4e7 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Updated VIF entry in instance network info cache for port 2d9e080b-5c93-4e9a-bbaa-a354d9056614. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG nova.network.neutron [req-b977b804-71da-41ea-82f2-13622a019fb8 req-e9bef579-f646-4d04-aa5e-32e399f4f4e7 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Updating instance_info_cache with network_info: [{"id": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "address": "fa:16:3e:ad:6a:3d", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9e080b-5c", "ovs_interfaceid": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:44:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b977b804-71da-41ea-82f2-13622a019fb8 req-e9bef579-f646-4d04-aa5e-32e399f4f4e7 service nova] Releasing lock "refresh_cache-e0a58d05-9dff-4590-a240-64826fc8243e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:44:50 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Instance destroyed successfully.
Nov 02 17:44:50 user nova-compute[74980]: DEBUG nova.objects.instance [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lazy-loading 'resources' on Instance uuid e0a58d05-9dff-4590-a240-64826fc8243e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-868553513',display_name='tempest-TestStampPattern-server-868553513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-868553513',id=30,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6brPZ2uQ9G456sHLwslPBKMXH8Tx/nIMEedR+0YOFh5yPB/1XbhrPSZGlKxJ15/1VDK+MwShvhsv4pet6TNLtaVxKcGhLuXiTb4JdYXaSjCd+QqbzzQiSp5KWOqpajXQ==',key_name='tempest-TestStampPattern-1458079072',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45b461c7b3824820a1fd88721ddbebd6',ramdisk_id='',reservation_id='r-cnudubnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1736614362',owner_user_name='tempest-TestStampPattern-1736614362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:40:27Z,user_data=None,user_id='87f4ea9506264174bdbcd706e8cc877d',uuid=e0a58d05-9dff-4590-a240-64826fc8243e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "address": "fa:16:3e:ad:6a:3d", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9e080b-5c", "ovs_interfaceid": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Converting VIF {"id": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "address": "fa:16:3e:ad:6a:3d", "network": {"id": "067a0d22-4891-42a5-8cf2-d95882454841", "bridge": "br-int", "label": "tempest-TestStampPattern-280197883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45b461c7b3824820a1fd88721ddbebd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d9e080b-5c", "ovs_interfaceid": "2d9e080b-5c93-4e9a-bbaa-a354d9056614", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:6a:3d,bridge_name='br-int',has_traffic_filtering=True,id=2d9e080b-5c93-4e9a-bbaa-a354d9056614,network=Network(067a0d22-4891-42a5-8cf2-d95882454841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d9e080b-5c') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG os_vif [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:6a:3d,bridge_name='br-int',has_traffic_filtering=True,id=2d9e080b-5c93-4e9a-bbaa-a354d9056614,network=Network(067a0d22-4891-42a5-8cf2-d95882454841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d9e080b-5c') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d9e080b-5c, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc9a922e-973d-4916-8d33-e06697d9cdf4) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:50 user nova-compute[74980]: INFO os_vif [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:6a:3d,bridge_name='br-int',has_traffic_filtering=True,id=2d9e080b-5c93-4e9a-bbaa-a354d9056614,network=Network(067a0d22-4891-42a5-8cf2-d95882454841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d9e080b-5c')
Nov 02 17:44:50 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Deleting instance files /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e_del
Nov 02 17:44:50 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Deletion of /opt/stack/data/nova/instances/e0a58d05-9dff-4590-a240-64826fc8243e_del complete
Nov 02 17:44:50 user nova-compute[74980]: INFO nova.compute.manager [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 02 17:44:50 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:44:50 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Took 0.47 seconds to deallocate network for instance.
Nov 02 17:44:50 user nova-compute[74980]: DEBUG nova.compute.manager [req-4e38e945-0227-4278-8385-6b4191b658f5 req-ced2476f-f33f-42e0-93dd-e2743c7e0f36 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Received event network-vif-deleted-2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:44:50 user nova-compute[74980]: INFO nova.compute.manager [req-4e38e945-0227-4278-8385-6b4191b658f5 req-ced2476f-f33f-42e0-93dd-e2743c7e0f36 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Neutron deleted interface 2d9e080b-5c93-4e9a-bbaa-a354d9056614; detaching it from the instance and deleting it from the info cache
Nov 02 17:44:50 user nova-compute[74980]: DEBUG nova.network.neutron [req-4e38e945-0227-4278-8385-6b4191b658f5 req-ced2476f-f33f-42e0-93dd-e2743c7e0f36 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG nova.compute.manager [req-4e38e945-0227-4278-8385-6b4191b658f5 req-ced2476f-f33f-42e0-93dd-e2743c7e0f36 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Detach interface failed, port_id=2d9e080b-5c93-4e9a-bbaa-a354d9056614, reason: Instance e0a58d05-9dff-4590-a240-64826fc8243e could not be found. {{(pid=74980) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:44:50 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:44:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:51 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Deleted allocations for instance e0a58d05-9dff-4590-a240-64826fc8243e
Nov 02 17:44:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9ec613b3-f869-48ca-bcf4-c30a1a3edaa0 tempest-TestStampPattern-1736614362 tempest-TestStampPattern-1736614362-project-member] Lock "e0a58d05-9dff-4590-a240-64826fc8243e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.781s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-7a9c367d-2c5a-450e-8d84-15d8ef4e48dc req-0cb969a8-2900-4689-ae95-fb3cc973a0b9 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Received event network-vif-unplugged-2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:44:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7a9c367d-2c5a-450e-8d84-15d8ef4e48dc req-0cb969a8-2900-4689-ae95-fb3cc973a0b9 service nova] Acquiring lock "e0a58d05-9dff-4590-a240-64826fc8243e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7a9c367d-2c5a-450e-8d84-15d8ef4e48dc req-0cb969a8-2900-4689-ae95-fb3cc973a0b9 service nova] Lock "e0a58d05-9dff-4590-a240-64826fc8243e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7a9c367d-2c5a-450e-8d84-15d8ef4e48dc req-0cb969a8-2900-4689-ae95-fb3cc973a0b9 service nova] Lock "e0a58d05-9dff-4590-a240-64826fc8243e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-7a9c367d-2c5a-450e-8d84-15d8ef4e48dc req-0cb969a8-2900-4689-ae95-fb3cc973a0b9 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] No waiting events found dispatching network-vif-unplugged-2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:44:51 user nova-compute[74980]: WARNING nova.compute.manager [req-7a9c367d-2c5a-450e-8d84-15d8ef4e48dc req-0cb969a8-2900-4689-ae95-fb3cc973a0b9 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Received unexpected event network-vif-unplugged-2d9e080b-5c93-4e9a-bbaa-a354d9056614 for instance with vm_state deleted and task_state None.
Nov 02 17:44:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-7a9c367d-2c5a-450e-8d84-15d8ef4e48dc req-0cb969a8-2900-4689-ae95-fb3cc973a0b9 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Received event network-vif-plugged-2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:44:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7a9c367d-2c5a-450e-8d84-15d8ef4e48dc req-0cb969a8-2900-4689-ae95-fb3cc973a0b9 service nova] Acquiring lock "e0a58d05-9dff-4590-a240-64826fc8243e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:44:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7a9c367d-2c5a-450e-8d84-15d8ef4e48dc req-0cb969a8-2900-4689-ae95-fb3cc973a0b9 service nova] Lock "e0a58d05-9dff-4590-a240-64826fc8243e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:44:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7a9c367d-2c5a-450e-8d84-15d8ef4e48dc req-0cb969a8-2900-4689-ae95-fb3cc973a0b9 service nova] Lock "e0a58d05-9dff-4590-a240-64826fc8243e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:44:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-7a9c367d-2c5a-450e-8d84-15d8ef4e48dc req-0cb969a8-2900-4689-ae95-fb3cc973a0b9 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] No waiting events found dispatching network-vif-plugged-2d9e080b-5c93-4e9a-bbaa-a354d9056614 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:44:51 user nova-compute[74980]: WARNING nova.compute.manager [req-7a9c367d-2c5a-450e-8d84-15d8ef4e48dc req-0cb969a8-2900-4689-ae95-fb3cc973a0b9 service nova] [instance: e0a58d05-9dff-4590-a240-64826fc8243e] Received unexpected event network-vif-plugged-2d9e080b-5c93-4e9a-bbaa-a354d9056614 for instance with vm_state deleted and task_state None.
Nov 02 17:44:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:44:59 user nova-compute[74980]: INFO nova.compute.manager [None req-0b88f164-004e-4842-b75c-0c1f33b0b25f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Unrescuing
Nov 02 17:44:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0b88f164-004e-4842-b75c-0c1f33b0b25f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:44:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0b88f164-004e-4842-b75c-0c1f33b0b25f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquired lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:44:59 user nova-compute[74980]: DEBUG nova.network.neutron [None req-0b88f164-004e-4842-b75c-0c1f33b0b25f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:45:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-0b88f164-004e-4842-b75c-0c1f33b0b25f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Updating instance_info_cache with network_info: [{"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:45:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0b88f164-004e-4842-b75c-0c1f33b0b25f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Releasing lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:45:00 user nova-compute[74980]: DEBUG nova.objects.instance [None req-0b88f164-004e-4842-b75c-0c1f33b0b25f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'flavor' on Instance uuid e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:45:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:00 user nova-compute[74980]: DEBUG nova.compute.manager [req-67117527-0b75-4b01-8284-658eac857999 req-b86bb8a6-7f76-4715-a9a1-5d192fb2366a service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-vif-unplugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:45:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-67117527-0b75-4b01-8284-658eac857999 req-b86bb8a6-7f76-4715-a9a1-5d192fb2366a service nova] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-67117527-0b75-4b01-8284-658eac857999 req-b86bb8a6-7f76-4715-a9a1-5d192fb2366a service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-67117527-0b75-4b01-8284-658eac857999 req-b86bb8a6-7f76-4715-a9a1-5d192fb2366a service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:00 user nova-compute[74980]: DEBUG nova.compute.manager [req-67117527-0b75-4b01-8284-658eac857999 req-b86bb8a6-7f76-4715-a9a1-5d192fb2366a service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] No waiting events found dispatching network-vif-unplugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:45:00 user nova-compute[74980]: WARNING nova.compute.manager [req-67117527-0b75-4b01-8284-658eac857999 req-b86bb8a6-7f76-4715-a9a1-5d192fb2366a service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received unexpected event network-vif-unplugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:45:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:00 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Instance destroyed successfully.
Nov 02 17:45:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG nova.compute.manager [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG nova.compute.manager [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] No waiting events found dispatching network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:45:02 user nova-compute[74980]: WARNING nova.compute.manager [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received unexpected event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:45:02 user nova-compute[74980]: DEBUG nova.compute.manager [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG nova.compute.manager [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] No waiting events found dispatching network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:45:02 user nova-compute[74980]: WARNING nova.compute.manager [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received unexpected event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:45:02 user nova-compute[74980]: DEBUG nova.compute.manager [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:02 user nova-compute[74980]: DEBUG nova.compute.manager [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] No waiting events found dispatching network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:45:02 user nova-compute[74980]: WARNING nova.compute.manager [req-c93cbf4d-711d-4a74-9f9c-b04b7bb438a1 req-18b300d0-05ee-4a61-8d13-ca7babe50e44 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received unexpected event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:45:04 user nova-compute[74980]: DEBUG nova.compute.manager [None req-0b88f164-004e-4842-b75c-0c1f33b0b25f tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:45:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:08 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 47ba09bb-4865-414d-a287-300c813b8576 is timed out.
Nov 02 17:45:08 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Successfully detached device vdb from instance 47ba09bb-4865-414d-a287-300c813b8576 from the live domain config.
Nov 02 17:45:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edJFWVHt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:45:08 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1f7c0d-80b6-4d21-b417-6c28e51a7490]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:45:08 user nova-compute[74980]: No targets found.
Nov 02 17:45:08 user nova-compute[74980]: iSNS:
Nov 02 17:45:08 user nova-compute[74980]: No targets found.
Nov 02 17:45:08 user nova-compute[74980]: STATIC:
Nov 02 17:45:08 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74
Nov 02 17:45:08 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:45:08 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:45:08 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187
Nov 02 17:45:08 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:45:08 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:45:08 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07
Nov 02 17:45:08 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:45:08 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:45:08 user nova-compute[74980]: FIRMWARE:
Nov 02 17:45:08 user nova-compute[74980]: No targets found.
Nov 02 17:45:08 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:45:08 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:45:08 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a45b0a8-ba28-4f2e-b40a-9e4ca6cbf2da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6b26cf-8f42-4073-9654-b1b17fcfd604]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:45:08 user nova-compute[74980]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 (non-flash)
Nov 02 17:45:08 user nova-compute[74980]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:45:08 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:45:08 user nova-compute[74980]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 (non-flash)
Nov 02 17:45:08 user nova-compute[74980]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:45:08 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5994772680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74'): ({'sdc'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Removing single pathed devices sdc {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ee298e-5e0f-433b-be44-07e891060c99]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8894fb1-fbdb-497f-a775-f05d2ee831d7]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Flushing IO for device /dev/sdc {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[08172a1e-7250-4795-b8c2-b496d2fcec99]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e656c43a-2ecf-44d7-be5c-c0a191247357]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0cf44c-ca17-47d1-a3b3-694e8a7d4ac2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d91a9c-4349-4f25-bdd5-5a3d34b5f68b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74, portal: 172.16.0.220,3260]
Nov 02 17:45:08 user nova-compute[74980]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74, portal: 172.16.0.220,3260] successful.
Nov 02 17:45:08 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[84afa6bb-58f6-4d00-a856-4e8d53fba2ca]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] <== disconnect_volume: return (324ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:45:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG nova.objects.instance [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lazy-loading 'flavor' on Instance uuid 47ba09bb-4865-414d-a287-300c813b8576 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-486e7faa-d4cc-4735-b316-f83bf8c29531 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "47ba09bb-4865-414d-a287-300c813b8576" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.817s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "47ba09bb-4865-414d-a287-300c813b8576" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.696s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "47ba09bb-4865-414d-a287-300c813b8576-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:09 user nova-compute[74980]: INFO nova.compute.manager [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Terminating instance
Nov 02 17:45:09 user nova-compute[74980]: DEBUG nova.compute.manager [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-badb9f06-7aa6-4909-9b9b-d0362d5a371b req-24189af7-0401-4f79-a86d-2e917a6d2b19 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received event network-vif-unplugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-badb9f06-7aa6-4909-9b9b-d0362d5a371b req-24189af7-0401-4f79-a86d-2e917a6d2b19 service nova] Acquiring lock "47ba09bb-4865-414d-a287-300c813b8576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-badb9f06-7aa6-4909-9b9b-d0362d5a371b req-24189af7-0401-4f79-a86d-2e917a6d2b19 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-badb9f06-7aa6-4909-9b9b-d0362d5a371b req-24189af7-0401-4f79-a86d-2e917a6d2b19 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-badb9f06-7aa6-4909-9b9b-d0362d5a371b req-24189af7-0401-4f79-a86d-2e917a6d2b19 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] No waiting events found dispatching network-vif-unplugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:45:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-badb9f06-7aa6-4909-9b9b-d0362d5a371b req-24189af7-0401-4f79-a86d-2e917a6d2b19 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received event network-vif-unplugged-8211d299-5825-4934-88ca-51ac34dca390 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:10 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Instance destroyed successfully.
Nov 02 17:45:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lazy-loading 'resources' on Instance uuid 47ba09bb-4865-414d-a287-300c813b8576 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2079837321',display_name='tempest-VolumesSnapshotTestJSON-instance-2079837321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2079837321',id=37,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0BifwA2qOaXwY28dNiUl9FKOF8bWpdILzYGCzZAwKqjOU46koug9PzWUuA8Wf751nzcYFrAyb5HYxFCaunTOoDnpBVo98l2f6qxySuoYLKUWoMhwZlIGddZOY7EX3lDg==',key_name='tempest-keypair-440002291',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:41:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8acec542cb1462996e6545c6f350e9f',ramdisk_id='',reservation_id='r-ri30h596',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2140770747',owner_user_name='tempest-VolumesSnapshotTestJSON-2140770747-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d183edfc18ad4a6f91bff1e33db290c8',uuid=47ba09bb-4865-414d-a287-300c813b8576,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8211d299-5825-4934-88ca-51ac34dca390", "address": "fa:16:3e:f1:61:10", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8211d299-58", "ovs_interfaceid": "8211d299-5825-4934-88ca-51ac34dca390", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Converting VIF {"id": "8211d299-5825-4934-88ca-51ac34dca390", "address": "fa:16:3e:f1:61:10", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8211d299-58", "ovs_interfaceid": "8211d299-5825-4934-88ca-51ac34dca390", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:61:10,bridge_name='br-int',has_traffic_filtering=True,id=8211d299-5825-4934-88ca-51ac34dca390,network=Network(61d9ee24-0604-4a72-aebc-ff80ff1f35c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8211d299-58') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG os_vif [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:61:10,bridge_name='br-int',has_traffic_filtering=True,id=8211d299-5825-4934-88ca-51ac34dca390,network=Network(61d9ee24-0604-4a72-aebc-ff80ff1f35c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8211d299-58') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8211d299-58, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac253790-c36b-4959-bb1c-4a818db7ec6a) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:10 user nova-compute[74980]: INFO os_vif [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:61:10,bridge_name='br-int',has_traffic_filtering=True,id=8211d299-5825-4934-88ca-51ac34dca390,network=Network(61d9ee24-0604-4a72-aebc-ff80ff1f35c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8211d299-58')
Nov 02 17:45:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edJFWVHt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:45:10 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:45:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c48608-3f6e-47e3-8866-aa731f252af8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:45:10 user nova-compute[74980]: No targets found.
Nov 02 17:45:10 user nova-compute[74980]: iSNS:
Nov 02 17:45:10 user nova-compute[74980]: No targets found.
Nov 02 17:45:10 user nova-compute[74980]: STATIC:
Nov 02 17:45:10 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187
Nov 02 17:45:10 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:45:10 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:45:10 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07
Nov 02 17:45:10 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:45:10 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:45:10 user nova-compute[74980]: FIRMWARE:
Nov 02 17:45:10 user nova-compute[74980]: No targets found.
Nov 02 17:45:10 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:45:10 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:45:10 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34884392-f416-4929-b042-089c8f7d2e74', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b2eb81-4408-40c6-8ca3-9de8cb7f3847]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60305dd-5cfc-47b3-94d5-f1f178f4b75d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:45:10 user nova-compute[74980]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:45:10 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:45:10 user nova-compute[74980]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:45:10 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b4186680>, {}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Disconnecting from: [] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] <== disconnect_volume: return (79ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:45:10 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Deleting instance files /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576_del
Nov 02 17:45:10 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Deletion of /opt/stack/data/nova/instances/47ba09bb-4865-414d-a287-300c813b8576_del complete
Nov 02 17:45:10 user nova-compute[74980]: INFO nova.compute.manager [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 02 17:45:10 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 47ba09bb-4865-414d-a287-300c813b8576] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:45:11 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Took 1.25 seconds to deallocate network for instance.
Nov 02 17:45:11 user nova-compute[74980]: WARNING nova.volume.cinder [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Attachment 3be4fa75-f5bf-40d7-aedf-cec37911e3cd does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3be4fa75-f5bf-40d7-aedf-cec37911e3cd. (HTTP 404) (Request-ID: req-12679e89-99f6-4c84-9c7f-5eca8496c5bc)
Nov 02 17:45:11 user nova-compute[74980]: INFO nova.compute.manager [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Took 0.03 seconds to detach 1 volumes for instance.
Nov 02 17:45:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received event network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] Acquiring lock "47ba09bb-4865-414d-a287-300c813b8576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] No waiting events found dispatching network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:45:11 user nova-compute[74980]: WARNING nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received unexpected event network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 for instance with vm_state active and task_state deleting.
Nov 02 17:45:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received event network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] Acquiring lock "47ba09bb-4865-414d-a287-300c813b8576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] No waiting events found dispatching network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:45:11 user nova-compute[74980]: WARNING nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received unexpected event network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 for instance with vm_state active and task_state deleting.
Nov 02 17:45:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received event network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] Acquiring lock "47ba09bb-4865-414d-a287-300c813b8576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] No waiting events found dispatching network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:45:11 user nova-compute[74980]: WARNING nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received unexpected event network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 for instance with vm_state active and task_state deleting.
Nov 02 17:45:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received event network-vif-unplugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] Acquiring lock "47ba09bb-4865-414d-a287-300c813b8576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] No waiting events found dispatching network-vif-unplugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received event network-vif-unplugged-8211d299-5825-4934-88ca-51ac34dca390 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received event network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] Acquiring lock "47ba09bb-4865-414d-a287-300c813b8576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] Lock "47ba09bb-4865-414d-a287-300c813b8576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] No waiting events found dispatching network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:45:11 user nova-compute[74980]: WARNING nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received unexpected event network-vif-plugged-8211d299-5825-4934-88ca-51ac34dca390 for instance with vm_state active and task_state deleting.
Nov 02 17:45:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-c4c9bb80-8e25-4555-af19-d9a62b5265fd req-10e7308a-4c6d-461e-bcef-d675e0335fe4 service nova] [instance: 47ba09bb-4865-414d-a287-300c813b8576] Received event network-vif-deleted-8211d299-5825-4934-88ca-51ac34dca390 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:45:11 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:45:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:12 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Deleted allocations for instance 47ba09bb-4865-414d-a287-300c813b8576
Nov 02 17:45:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0fb947bb-ff36-4332-b58c-655405bb6b20 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "47ba09bb-4865-414d-a287-300c813b8576" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.777s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:18 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:45:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:45:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:45:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:45:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:45:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:20 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:45:20 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:45:24 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:45:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:45:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:45:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:45:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:27 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:45:27 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:45:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8368MB free_disk=25.05825424194336GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cfef8d27-a749-4469-912b-b272c0080f03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.345s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:27 user nova-compute[74980]: INFO nova.compute.manager [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Rescuing
Nov 02 17:45:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquired lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:45:27 user nova-compute[74980]: DEBUG nova.network.neutron [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:45:28 user nova-compute[74980]: DEBUG nova.network.neutron [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Updating instance_info_cache with network_info: [{"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:45:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Releasing lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:45:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:28 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:45:28 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:45:28 user nova-compute[74980]: DEBUG nova.compute.manager [req-19f6fbfa-25bc-4cf8-9ac8-ebf59956ae58 req-d869b8b8-a3bf-4c88-8dbd-fec6d630062e service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received event network-vif-unplugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:45:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-19f6fbfa-25bc-4cf8-9ac8-ebf59956ae58 req-d869b8b8-a3bf-4c88-8dbd-fec6d630062e service nova] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-19f6fbfa-25bc-4cf8-9ac8-ebf59956ae58 req-d869b8b8-a3bf-4c88-8dbd-fec6d630062e service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-19f6fbfa-25bc-4cf8-9ac8-ebf59956ae58 req-d869b8b8-a3bf-4c88-8dbd-fec6d630062e service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:28 user nova-compute[74980]: DEBUG nova.compute.manager [req-19f6fbfa-25bc-4cf8-9ac8-ebf59956ae58 req-d869b8b8-a3bf-4c88-8dbd-fec6d630062e service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] No waiting events found dispatching network-vif-unplugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:45:28 user nova-compute[74980]: WARNING nova.compute.manager [req-19f6fbfa-25bc-4cf8-9ac8-ebf59956ae58 req-d869b8b8-a3bf-4c88-8dbd-fec6d630062e service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received unexpected event network-vif-unplugged-c27b6981-9e85-4496-a959-a3ae4e377b34 for instance with vm_state active and task_state rescuing.
Nov 02 17:45:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:29 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Instance destroyed successfully.
Nov 02 17:45:29 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Attempting a stable device rescue
Nov 02 17:45:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74980) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 17:45:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Instance directory exists: not creating {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 17:45:29 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Creating image(s)
Nov 02 17:45:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ea56f31-932f-42f8-987c-13ef46d2d9f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "/opt/stack/data/nova/instances/6ea56f31-932f-42f8-987c-13ef46d2d9f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "/opt/stack/data/nova/instances/6ea56f31-932f-42f8-987c-13ef46d2d9f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:29 user nova-compute[74980]: DEBUG nova.objects.instance [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6ea56f31-932f-42f8-987c-13ef46d2d9f7 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:45:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "e35948682464e165f89788def3707ee923939ce2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "e35948682464e165f89788def3707ee923939ce2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e35948682464e165f89788def3707ee923939ce2.part --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:30 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:45:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e35948682464e165f89788def3707ee923939ce2.part --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:30 user nova-compute[74980]: DEBUG nova.virt.images [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] e57bdb6b-5993-4b59-953c-cbb9fa641b27 was qcow2, converting to raw {{(pid=74980) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 17:45:30 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:45:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e35948682464e165f89788def3707ee923939ce2.part /opt/stack/data/nova/instances/_base/e35948682464e165f89788def3707ee923939ce2.converted {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:30 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:45:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-b9293d47-fdd8-4c81-b415-cbfd4e3a69b5 req-6020f902-8e37-4385-9112-c59d5255b244 service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:45:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b9293d47-fdd8-4c81-b415-cbfd4e3a69b5 req-6020f902-8e37-4385-9112-c59d5255b244 service nova] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b9293d47-fdd8-4c81-b415-cbfd4e3a69b5 req-6020f902-8e37-4385-9112-c59d5255b244 service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b9293d47-fdd8-4c81-b415-cbfd4e3a69b5 req-6020f902-8e37-4385-9112-c59d5255b244 service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-b9293d47-fdd8-4c81-b415-cbfd4e3a69b5 req-6020f902-8e37-4385-9112-c59d5255b244 service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] No waiting events found dispatching network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:45:30 user nova-compute[74980]: WARNING nova.compute.manager [req-b9293d47-fdd8-4c81-b415-cbfd4e3a69b5 req-6020f902-8e37-4385-9112-c59d5255b244 service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received unexpected event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 for instance with vm_state active and task_state rescuing.
Nov 02 17:45:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e35948682464e165f89788def3707ee923939ce2.part /opt/stack/data/nova/instances/_base/e35948682464e165f89788def3707ee923939ce2.converted" returned: 0 in 0.590s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e35948682464e165f89788def3707ee923939ce2.converted --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e35948682464e165f89788def3707ee923939ce2.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "e35948682464e165f89788def3707ee923939ce2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.842s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "e35948682464e165f89788def3707ee923939ce2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "e35948682464e165f89788def3707ee923939ce2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e35948682464e165f89788def3707ee923939ce2 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e35948682464e165f89788def3707ee923939ce2 --force-share --output=json" returned: 0 in 0.169s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e35948682464e165f89788def3707ee923939ce2,backing_fmt=raw /opt/stack/data/nova/instances/6ea56f31-932f-42f8-987c-13ef46d2d9f7/disk.rescue {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e35948682464e165f89788def3707ee923939ce2,backing_fmt=raw /opt/stack/data/nova/instances/6ea56f31-932f-42f8-987c-13ef46d2d9f7/disk.rescue" returned: 0 in 0.047s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "e35948682464e165f89788def3707ee923939ce2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.objects.instance [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'migration_context' on Instance uuid 6ea56f31-932f-42f8-987c-13ef46d2d9f7 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.objects.base [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Object Instance<6ea56f31-932f-42f8-987c-13ef46d2d9f7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Start _get_guest_xml network_info=[{"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "vif_mac": "fa:16:3e:da:ca:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e57bdb6b-5993-4b59-953c-cbb9fa641b27', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgGUnODw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '6ea56f31-932f-42f8-987c-13ef46d2d9f7', 'attached_at': '', 'detached_at': '', 'volume_id': '53f2f947-128b-4fb6-a7ae-b47bb2f37187', 'serial': '53f2f947-128b-4fb6-a7ae-b47bb2f37187'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'cf1714f7-fa59-453d-bad5-6b5804b4584c', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.objects.instance [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'resources' on Instance uuid 6ea56f31-932f-42f8-987c-13ef46d2d9f7 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.objects.base [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Object Instance<6ea56f31-932f-42f8-987c-13ef46d2d9f7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.objects.instance [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'numa_topology' on Instance uuid 6ea56f31-932f-42f8-987c-13ef46d2d9f7 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.objects.base [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Object Instance<6ea56f31-932f-42f8-987c-13ef46d2d9f7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:45:31 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:45:31 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.objects.instance [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6ea56f31-932f-42f8-987c-13ef46d2d9f7 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.objects.base [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Object Instance<6ea56f31-932f-42f8-987c-13ef46d2d9f7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgGUnODw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:45:31 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:45:31 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:45:31 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d92e69-73d9-4518-8437-ae403bbd4c63]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fgGUnODw\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 02 17:45:31 user nova-compute[74980]: node.name = iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187
Nov 02 17:45:31 user nova-compute[74980]: node.tpgt = -1
Nov 02 17:45:31 user nova-compute[74980]: node.startup = automatic
Nov 02 17:45:31 user nova-compute[74980]: node.leading_login = No
Nov 02 17:45:31 user nova-compute[74980]: iface.iscsi_ifacename = default
Nov 02 17:45:31 user nova-compute[74980]: iface.net_ifacename = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.ipaddress = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.prefix_len = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.hwaddress = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.transport_name = tcp
Nov 02 17:45:31 user nova-compute[74980]: iface.initiatorname = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.state = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.vlan_id = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.vlan_priority = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.vlan_state = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.iface_num = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.mtu = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.port = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.bootproto = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.subnet_mask = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.gateway = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.dhcp_alt_client_id_state = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.dhcp_alt_client_id = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.dhcp_dns = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.dhcp_learn_iqn = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.dhcp_req_vendor_id_state = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.dhcp_vendor_id_state = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.dhcp_vendor_id = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.dhcp_slp_da = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.fragmentation = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.gratuitous_arp = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.incoming_forwarding = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.tos_state = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.tos = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.ttl = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.delayed_ack = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.tcp_nagle = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.tcp_wsf_state = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.tcp_wsf = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.tcp_timer_scale = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.tcp_timestamp = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.redirect = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.def_task_mgmt_timeout = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.header_digest = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.data_digest = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.immediate_data = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.initial_r2t = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.data_seq_inorder = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.data_pdu_inorder = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.erl = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.max_receive_data_len = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.first_burst_len = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.max_outstanding_r2t = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.max_burst_len = 0
Nov 02 17:45:31 user nova-compute[74980]: iface.chap_auth = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.bidi_chap = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.strict_login_compliance = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.discovery_auth = <empty>
Nov 02 17:45:31 user nova-compute[74980]: iface.discovery_logout = <empty>
Nov 02 17:45:31 user nova-compute[74980]: node.discovery_address = <empty>
Nov 02 17:45:31 user nova-compute[74980]: node.discovery_port = 0
Nov 02 17:45:31 user nova-compute[74980]: node.discovery_type = static
Nov 02 17:45:31 user nova-compute[74980]: node.session.initial_cmdsn = 0
Nov 02 17:45:31 user nova-compute[74980]: node.session.initial_login_retry_max = 8
Nov 02 17:45:31 user nova-compute[74980]: node.session.xmit_thread_priority = -20
Nov 02 17:45:31 user nova-compute[74980]: node.session.cmds_max = 128
Nov 02 17:45:31 user nova-compute[74980]: node.session.queue_depth = 32
Nov 02 17:45:31 user nova-compute[74980]: node.session.nr_sessions = 1
Nov 02 17:45:31 user nova-compute[74980]: node.session.auth.authmethod = CHAP
Nov 02 17:45:31 user nova-compute[74980]: node.session.auth.username = fgGUnODw
Nov 02 17:45:31 user nova-compute[74980]: node.session.auth.password = ***
Nov 02 17:45:31 user nova-compute[74980]: node.session.auth.username_in = <empty>
Nov 02 17:45:31 user nova-compute[74980]: node.session.auth.password_in = <empty>
Nov 02 17:45:31 user nova-compute[74980]: node.session.auth.chap_algs = MD5
Nov 02 17:45:31 user nova-compute[74980]: node.session.timeo.replacement_timeout = 120
Nov 02 17:45:31 user nova-compute[74980]: node.session.err_timeo.abort_timeout = 15
Nov 02 17:45:31 user nova-compute[74980]: node.session.err_timeo.lu_reset_timeout = 30
Nov 02 17:45:31 user nova-compute[74980]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 02 17:45:31 user nova-compute[74980]: node.session.err_timeo.host_reset_timeout = 60
Nov 02 17:45:31 user nova-compute[74980]: node.session.iscsi.FastAbort = Yes
Nov 02 17:45:31 user nova-compute[74980]: node.session.iscsi.InitialR2T = No
Nov 02 17:45:31 user nova-compute[74980]: node.session.iscsi.ImmediateData = Yes
Nov 02 17:45:31 user nova-compute[74980]: node.session.iscsi.FirstBurstLength = 262144
Nov 02 17:45:31 user nova-compute[74980]: node.session.iscsi.MaxBurstLength = 16776192
Nov 02 17:45:31 user nova-compute[74980]: node.session.iscsi.DefaultTime2Retain = 0
Nov 02 17:45:31 user nova-compute[74980]: node.session.iscsi.DefaultTime2Wait = 2
Nov 02 17:45:31 user nova-compute[74980]: node.session.iscsi.MaxConnections = 1
Nov 02 17:45:31 user nova-compute[74980]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 02 17:45:31 user nova-compute[74980]: node.session.iscsi.ERL = 0
Nov 02 17:45:31 user nova-compute[74980]: node.session.scan = manual
Nov 02 17:45:31 user nova-compute[74980]: node.session.reopen_max = 0
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].address = 172.16.0.220
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].port = 3260
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].startup = manual
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].tcp.window_size = 524288
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].tcp.type_of_service = 0
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].timeo.logout_timeout = 15
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].timeo.login_timeout = 15
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].timeo.auth_timeout = 45
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].timeo.noop_out_interval = 5
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].timeo.noop_out_timeout = 5
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].iscsi.HeaderDigest = None
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].iscsi.DataDigest = None
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].iscsi.IFMarker = No
Nov 02 17:45:31 user nova-compute[74980]: node.conn[0].iscsi.OFMarker = No
Nov 02 17:45:31 user nova-compute[74980]: # END RECORD
Nov 02 17:45:31 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9fcf66-e2ac-457e-8598-5cecf7c2ca3e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37f837e-34fa-490e-afbd-712cf7a73d9c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fgGUnODw {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fgGUnODw" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f948a0-5567-496b-8bc1-005c28b5be8b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fgGUnODw'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4ad15d-3ddd-431d-8846-230e8ba2e8d1]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde0a8bd-ff23-4102-aaec-a0d7efe268e8]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:45:31 user nova-compute[74980]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:45:31 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:45:31 user nova-compute[74980]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:45:31 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.132s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] HCTL ('35', '0', '0', 0) found on session 40 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.012s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f97ccc1-a85c-42a4-869e-eb0f85791559]: (4, ('0 0 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching for a device in session 40 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgGUnODw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.154s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] <== connect_volume: return (155ms) {'type': 'block', 'scsi_wwn': '23138336336656137', 'path': '/dev/sdd'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138336336656137', 'path': '/dev/sdd'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-463257605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-463257605',id=38,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:44:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11e1bb23618243ddb099bc6855aa2f64',ramdisk_id='',reservation_id='r-9drnnags',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-36491096',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:44:09Z,user_data=None,user_id='fef01429fb294195984431fd3699f78b',uuid=6ea56f31-932f-42f8-987c-13ef46d2d9f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "vif_mac": "fa:16:3e:da:ca:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converting VIF {"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "vif_mac": "fa:16:3e:da:ca:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:ca:e6,bridge_name='br-int',has_traffic_filtering=True,id=c27b6981-9e85-4496-a959-a3ae4e377b34,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc27b6981-9e') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.objects.instance [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ea56f31-932f-42f8-987c-13ef46d2d9f7 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.objects.base [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Object Instance<6ea56f31-932f-42f8-987c-13ef46d2d9f7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:45:31 user nova-compute[74980]:   <uuid>6ea56f31-932f-42f8-987c-13ef46d2d9f7</uuid>
Nov 02 17:45:31 user nova-compute[74980]:   <name>instance-00000026</name>
Nov 02 17:45:31 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:45:31 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:45:31 user nova-compute[74980]:   <metadata>
Nov 02 17:45:31 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:45:31 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:45:31 user nova-compute[74980]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-463257605</nova:name>
Nov 02 17:45:31 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:45:31</nova:creationTime>
Nov 02 17:45:31 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:45:31 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:45:31 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:45:31 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:45:31 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:45:31 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:45:31 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:45:31 user nova-compute[74980]:       <nova:owner>
Nov 02 17:45:31 user nova-compute[74980]:         <nova:user uuid="fef01429fb294195984431fd3699f78b">tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member</nova:user>
Nov 02 17:45:31 user nova-compute[74980]:         <nova:project uuid="11e1bb23618243ddb099bc6855aa2f64">tempest-ServerBootFromVolumeStableRescueTest-36491096</nova:project>
Nov 02 17:45:31 user nova-compute[74980]:       </nova:owner>
Nov 02 17:45:31 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:45:31 user nova-compute[74980]:       <nova:ports>
Nov 02 17:45:31 user nova-compute[74980]:         <nova:port uuid="c27b6981-9e85-4496-a959-a3ae4e377b34">
Nov 02 17:45:31 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 17:45:31 user nova-compute[74980]:         </nova:port>
Nov 02 17:45:31 user nova-compute[74980]:       </nova:ports>
Nov 02 17:45:31 user nova-compute[74980]:     </nova:instance>
Nov 02 17:45:31 user nova-compute[74980]:   </metadata>
Nov 02 17:45:31 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:45:31 user nova-compute[74980]:     <system>
Nov 02 17:45:31 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:45:31 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:45:31 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:45:31 user nova-compute[74980]:       <entry name="serial">6ea56f31-932f-42f8-987c-13ef46d2d9f7</entry>
Nov 02 17:45:31 user nova-compute[74980]:       <entry name="uuid">6ea56f31-932f-42f8-987c-13ef46d2d9f7</entry>
Nov 02 17:45:31 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:45:31 user nova-compute[74980]:     </system>
Nov 02 17:45:31 user nova-compute[74980]:   </sysinfo>
Nov 02 17:45:31 user nova-compute[74980]:   <os>
Nov 02 17:45:31 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:45:31 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:45:31 user nova-compute[74980]:   </os>
Nov 02 17:45:31 user nova-compute[74980]:   <features>
Nov 02 17:45:31 user nova-compute[74980]:     <acpi/>
Nov 02 17:45:31 user nova-compute[74980]:     <apic/>
Nov 02 17:45:31 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:45:31 user nova-compute[74980]:   </features>
Nov 02 17:45:31 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:45:31 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:45:31 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:45:31 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:45:31 user nova-compute[74980]:   </clock>
Nov 02 17:45:31 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:45:31 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:45:31 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:45:31 user nova-compute[74980]:   </cpu>
Nov 02 17:45:31 user nova-compute[74980]:   <devices>
Nov 02 17:45:31 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:45:31 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:45:31 user nova-compute[74980]:       <source dev="/dev/sdd"/>
Nov 02 17:45:31 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:45:31 user nova-compute[74980]:       <serial>53f2f947-128b-4fb6-a7ae-b47bb2f37187</serial>
Nov 02 17:45:31 user nova-compute[74980]:     </disk>
Nov 02 17:45:31 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:45:31 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:45:31 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/6ea56f31-932f-42f8-987c-13ef46d2d9f7/disk.rescue"/>
Nov 02 17:45:31 user nova-compute[74980]:       <target dev="vdb" bus="virtio"/>
Nov 02 17:45:31 user nova-compute[74980]:       <boot order="1"/>
Nov 02 17:45:31 user nova-compute[74980]:     </disk>
Nov 02 17:45:31 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:45:31 user nova-compute[74980]:       <mac address="fa:16:3e:da:ca:e6"/>
Nov 02 17:45:31 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:45:31 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:45:31 user nova-compute[74980]:       <target dev="tapc27b6981-9e"/>
Nov 02 17:45:31 user nova-compute[74980]:     </interface>
Nov 02 17:45:31 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:45:31 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/6ea56f31-932f-42f8-987c-13ef46d2d9f7/console.log" append="off"/>
Nov 02 17:45:31 user nova-compute[74980]:     </serial>
Nov 02 17:45:31 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:45:31 user nova-compute[74980]:     <video>
Nov 02 17:45:31 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:45:31 user nova-compute[74980]:     </video>
Nov 02 17:45:31 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:45:31 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:45:31 user nova-compute[74980]:     </rng>
Nov 02 17:45:31 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:45:31 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:45:31 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:45:31 user nova-compute[74980]:     </memballoon>
Nov 02 17:45:31 user nova-compute[74980]:   </devices>
Nov 02 17:45:31 user nova-compute[74980]: </domain>
Nov 02 17:45:31 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:45:31 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Instance destroyed successfully.
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:45:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] No VIF found with MAC fa:16:3e:da:ca:e6, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:45:32 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:45:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-51c3058d-461d-4842-b67a-7002e2454f15 req-2f5d1177-bb21-4925-b8f2-2b6f5e4e5fba service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:45:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-51c3058d-461d-4842-b67a-7002e2454f15 req-2f5d1177-bb21-4925-b8f2-2b6f5e4e5fba service nova] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-51c3058d-461d-4842-b67a-7002e2454f15 req-2f5d1177-bb21-4925-b8f2-2b6f5e4e5fba service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-51c3058d-461d-4842-b67a-7002e2454f15 req-2f5d1177-bb21-4925-b8f2-2b6f5e4e5fba service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-51c3058d-461d-4842-b67a-7002e2454f15 req-2f5d1177-bb21-4925-b8f2-2b6f5e4e5fba service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] No waiting events found dispatching network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:45:33 user nova-compute[74980]: WARNING nova.compute.manager [req-51c3058d-461d-4842-b67a-7002e2454f15 req-2f5d1177-bb21-4925-b8f2-2b6f5e4e5fba service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received unexpected event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 for instance with vm_state active and task_state rescuing.
Nov 02 17:45:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:34 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:45:34 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:45:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:45:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:45:34 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:45:35 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Updating instance_info_cache with network_info: [{"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:45:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-91bccf34-87a9-48f3-bbc7-4a70b9753036" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:45:35 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:45:35 user nova-compute[74980]: DEBUG nova.compute.manager [None req-94dca0a3-f46c-4fbd-a2c1-742ae6078e81 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:45:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-0848858c-305f-45f4-b947-e684280dffe1 req-fa62b5eb-4eb1-434d-b5de-66e9601a84cf service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:45:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0848858c-305f-45f4-b947-e684280dffe1 req-fa62b5eb-4eb1-434d-b5de-66e9601a84cf service nova] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:45:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0848858c-305f-45f4-b947-e684280dffe1 req-fa62b5eb-4eb1-434d-b5de-66e9601a84cf service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:45:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0848858c-305f-45f4-b947-e684280dffe1 req-fa62b5eb-4eb1-434d-b5de-66e9601a84cf service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:45:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-0848858c-305f-45f4-b947-e684280dffe1 req-fa62b5eb-4eb1-434d-b5de-66e9601a84cf service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] No waiting events found dispatching network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:45:35 user nova-compute[74980]: WARNING nova.compute.manager [req-0848858c-305f-45f4-b947-e684280dffe1 req-fa62b5eb-4eb1-434d-b5de-66e9601a84cf service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received unexpected event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 for instance with vm_state rescued and task_state None.
Nov 02 17:45:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:45:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:45:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-bf5c6d08-ed08-41a8-b78e-ed24efe01556 req-2eff129d-264a-476b-b1c8-2ed4053bdb17 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-changed-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:46:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-bf5c6d08-ed08-41a8-b78e-ed24efe01556 req-2eff129d-264a-476b-b1c8-2ed4053bdb17 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Refreshing instance network info cache due to event network-changed-ea0afd21-0732-4572-97d1-63b55c6e5655. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:46:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bf5c6d08-ed08-41a8-b78e-ed24efe01556 req-2eff129d-264a-476b-b1c8-2ed4053bdb17 service nova] Acquiring lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:46:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bf5c6d08-ed08-41a8-b78e-ed24efe01556 req-2eff129d-264a-476b-b1c8-2ed4053bdb17 service nova] Acquired lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:46:11 user nova-compute[74980]: DEBUG nova.network.neutron [req-bf5c6d08-ed08-41a8-b78e-ed24efe01556 req-2eff129d-264a-476b-b1c8-2ed4053bdb17 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Refreshing network info cache for port ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:46:11 user nova-compute[74980]: DEBUG nova.network.neutron [req-bf5c6d08-ed08-41a8-b78e-ed24efe01556 req-2eff129d-264a-476b-b1c8-2ed4053bdb17 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Updated VIF entry in instance network info cache for port ea0afd21-0732-4572-97d1-63b55c6e5655. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:46:11 user nova-compute[74980]: DEBUG nova.network.neutron [req-bf5c6d08-ed08-41a8-b78e-ed24efe01556 req-2eff129d-264a-476b-b1c8-2ed4053bdb17 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Updating instance_info_cache with network_info: [{"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:46:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bf5c6d08-ed08-41a8-b78e-ed24efe01556 req-2eff129d-264a-476b-b1c8-2ed4053bdb17 service nova] Releasing lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:46:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:46:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:46:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:46:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:46:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:46:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG nova.objects.instance [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'flavor' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:46:18 user nova-compute[74980]: INFO nova.compute.manager [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Attaching volume 028d2745-e096-4c65-873a-63cee4135d19 to /dev/vdb
Nov 02 17:46:18 user nova-compute[74980]: DEBUG os_brick.utils [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2e27f3-e81c-40f1-b252-5bd4a212ff61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb038de-2e94-4db4-b22b-19e8daf0fe64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc5d707-26a3-4657-8e31-a1b04678eb41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d4ff1d-8f20-4ccb-8df5-90c7896c57ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:46:18 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:46:18 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea7a82b-0dc5-4115-a03d-69cb37d4a6df]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG os_brick.utils [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:46:18 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Updating existing volume attachment record: f3c56259-0cd4-40df-9b59-aa356180ccac {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:46:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:20 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:46:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:22 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:46:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "f1b27aad-a580-43f3-861a-f150568a374f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:46:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "f1b27aad-a580-43f3-861a-f150568a374f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:46:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:46:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:46:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:46:23 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:46:23 user nova-compute[74980]: INFO nova.compute.claims [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Claim successful on node user
Nov 02 17:46:24 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:46:24 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:46:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG nova.policy [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd183edfc18ad4a6f91bff1e33db290c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8acec542cb1462996e6545c6f350e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:46:24 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Creating image(s)
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "/opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "/opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.194s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.212s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk 1073741824" returned: 0 in 0.068s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Successfully created port: 1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.204s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Cannot resize image /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Ensure instance console log exists: /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Successfully updated port: 1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "refresh_cache-f1b27aad-a580-43f3-861a-f150568a374f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquired lock "refresh_cache-f1b27aad-a580-43f3-861a-f150568a374f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3152b96-5501-4add-8052-a4cd7299eb8c req-06e5962c-0925-43b2-af68-a5f7634c2e88 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received event network-changed-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-f3152b96-5501-4add-8052-a4cd7299eb8c req-06e5962c-0925-43b2-af68-a5f7634c2e88 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Refreshing instance network info cache due to event network-changed-1aaaeff5-679d-4ca7-a20a-05583353b82f. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3152b96-5501-4add-8052-a4cd7299eb8c req-06e5962c-0925-43b2-af68-a5f7634c2e88 service nova] Acquiring lock "refresh_cache-f1b27aad-a580-43f3-861a-f150568a374f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Updating instance_info_cache with network_info: [{"id": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "address": "fa:16:3e:8f:25:bc", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaaeff5-67", "ovs_interfaceid": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Releasing lock "refresh_cache-f1b27aad-a580-43f3-861a-f150568a374f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Instance network_info: |[{"id": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "address": "fa:16:3e:8f:25:bc", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaaeff5-67", "ovs_interfaceid": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3152b96-5501-4add-8052-a4cd7299eb8c req-06e5962c-0925-43b2-af68-a5f7634c2e88 service nova] Acquired lock "refresh_cache-f1b27aad-a580-43f3-861a-f150568a374f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.network.neutron [req-f3152b96-5501-4add-8052-a4cd7299eb8c req-06e5962c-0925-43b2-af68-a5f7634c2e88 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Refreshing network info cache for port 1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Start _get_guest_xml network_info=[{"id": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "address": "fa:16:3e:8f:25:bc", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaaeff5-67", "ovs_interfaceid": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:46:26 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:46:26 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:46:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-723361033',display_name='tempest-VolumesSnapshotTestJSON-instance-723361033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-723361033',id=40,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgH9OLL5kDaxn7g1ZgtIieyLlOxVH1VwkwiiycLzAPg68uhPSsyBHnSgBYTnwxJZ/18i5fEb3H9mu9OlJ1L08Frt5eRAiRi4H5IYryZzyT0s+iq/7WbVi98QsJ59WDXuA==',key_name='tempest-keypair-1999104492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8acec542cb1462996e6545c6f350e9f',ramdisk_id='',reservation_id='r-4tkc20u4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2140770747',owner_user_name='tempest-VolumesSnapshotTestJSON-2140770747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d183edfc18ad4a6f91bff1e33db290c8',uuid=f1b27aad-a580-43f3-861a-f150568a374f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "address": "fa:16:3e:8f:25:bc", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaaeff5-67", "ovs_interfaceid": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Converting VIF {"id": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "address": "fa:16:3e:8f:25:bc", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaaeff5-67", "ovs_interfaceid": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:25:bc,bridge_name='br-int',has_traffic_filtering=True,id=1aaaeff5-679d-4ca7-a20a-05583353b82f,network=Network(61d9ee24-0604-4a72-aebc-ff80ff1f35c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaaeff5-67') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.objects.instance [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lazy-loading 'pci_devices' on Instance uuid f1b27aad-a580-43f3-861a-f150568a374f {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:46:26 user nova-compute[74980]:   <uuid>f1b27aad-a580-43f3-861a-f150568a374f</uuid>
Nov 02 17:46:26 user nova-compute[74980]:   <name>instance-00000028</name>
Nov 02 17:46:26 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:46:26 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:46:26 user nova-compute[74980]:   <metadata>
Nov 02 17:46:26 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:46:26 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:46:26 user nova-compute[74980]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-723361033</nova:name>
Nov 02 17:46:26 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:46:26</nova:creationTime>
Nov 02 17:46:26 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:46:26 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:46:26 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:46:26 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:46:26 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:46:26 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:46:26 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:46:26 user nova-compute[74980]:       <nova:owner>
Nov 02 17:46:26 user nova-compute[74980]:         <nova:user uuid="d183edfc18ad4a6f91bff1e33db290c8">tempest-VolumesSnapshotTestJSON-2140770747-project-member</nova:user>
Nov 02 17:46:26 user nova-compute[74980]:         <nova:project uuid="b8acec542cb1462996e6545c6f350e9f">tempest-VolumesSnapshotTestJSON-2140770747</nova:project>
Nov 02 17:46:26 user nova-compute[74980]:       </nova:owner>
Nov 02 17:46:26 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:46:26 user nova-compute[74980]:       <nova:ports>
Nov 02 17:46:26 user nova-compute[74980]:         <nova:port uuid="1aaaeff5-679d-4ca7-a20a-05583353b82f">
Nov 02 17:46:26 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 17:46:26 user nova-compute[74980]:         </nova:port>
Nov 02 17:46:26 user nova-compute[74980]:       </nova:ports>
Nov 02 17:46:26 user nova-compute[74980]:     </nova:instance>
Nov 02 17:46:26 user nova-compute[74980]:   </metadata>
Nov 02 17:46:26 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:46:26 user nova-compute[74980]:     <system>
Nov 02 17:46:26 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:46:26 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:46:26 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:46:26 user nova-compute[74980]:       <entry name="serial">f1b27aad-a580-43f3-861a-f150568a374f</entry>
Nov 02 17:46:26 user nova-compute[74980]:       <entry name="uuid">f1b27aad-a580-43f3-861a-f150568a374f</entry>
Nov 02 17:46:26 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:46:26 user nova-compute[74980]:     </system>
Nov 02 17:46:26 user nova-compute[74980]:   </sysinfo>
Nov 02 17:46:26 user nova-compute[74980]:   <os>
Nov 02 17:46:26 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:46:26 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:46:26 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:46:26 user nova-compute[74980]:   </os>
Nov 02 17:46:26 user nova-compute[74980]:   <features>
Nov 02 17:46:26 user nova-compute[74980]:     <acpi/>
Nov 02 17:46:26 user nova-compute[74980]:     <apic/>
Nov 02 17:46:26 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:46:26 user nova-compute[74980]:   </features>
Nov 02 17:46:26 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:46:26 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:46:26 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:46:26 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:46:26 user nova-compute[74980]:   </clock>
Nov 02 17:46:26 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:46:26 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:46:26 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:46:26 user nova-compute[74980]:   </cpu>
Nov 02 17:46:26 user nova-compute[74980]:   <devices>
Nov 02 17:46:26 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:46:26 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:46:26 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk"/>
Nov 02 17:46:26 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:46:26 user nova-compute[74980]:     </disk>
Nov 02 17:46:26 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:46:26 user nova-compute[74980]:       <mac address="fa:16:3e:8f:25:bc"/>
Nov 02 17:46:26 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:46:26 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:46:26 user nova-compute[74980]:       <target dev="tap1aaaeff5-67"/>
Nov 02 17:46:26 user nova-compute[74980]:     </interface>
Nov 02 17:46:26 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:46:26 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/console.log" append="off"/>
Nov 02 17:46:26 user nova-compute[74980]:     </serial>
Nov 02 17:46:26 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:46:26 user nova-compute[74980]:     <video>
Nov 02 17:46:26 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:46:26 user nova-compute[74980]:     </video>
Nov 02 17:46:26 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:46:26 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:46:26 user nova-compute[74980]:     </rng>
Nov 02 17:46:26 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:46:26 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:46:26 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:46:26 user nova-compute[74980]:     </memballoon>
Nov 02 17:46:26 user nova-compute[74980]:   </devices>
Nov 02 17:46:26 user nova-compute[74980]: </domain>
Nov 02 17:46:26 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:46:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-723361033',display_name='tempest-VolumesSnapshotTestJSON-instance-723361033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-723361033',id=40,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgH9OLL5kDaxn7g1ZgtIieyLlOxVH1VwkwiiycLzAPg68uhPSsyBHnSgBYTnwxJZ/18i5fEb3H9mu9OlJ1L08Frt5eRAiRi4H5IYryZzyT0s+iq/7WbVi98QsJ59WDXuA==',key_name='tempest-keypair-1999104492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8acec542cb1462996e6545c6f350e9f',ramdisk_id='',reservation_id='r-4tkc20u4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2140770747',owner_user_name='tempest-VolumesSnapshotTestJSON-2140770747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d183edfc18ad4a6f91bff1e33db290c8',uuid=f1b27aad-a580-43f3-861a-f150568a374f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "address": "fa:16:3e:8f:25:bc", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaaeff5-67", "ovs_interfaceid": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Converting VIF {"id": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "address": "fa:16:3e:8f:25:bc", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaaeff5-67", "ovs_interfaceid": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:25:bc,bridge_name='br-int',has_traffic_filtering=True,id=1aaaeff5-679d-4ca7-a20a-05583353b82f,network=Network(61d9ee24-0604-4a72-aebc-ff80ff1f35c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaaeff5-67') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG os_vif [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:25:bc,bridge_name='br-int',has_traffic_filtering=True,id=1aaaeff5-679d-4ca7-a20a-05583353b82f,network=Network(61d9ee24-0604-4a72-aebc-ff80ff1f35c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaaeff5-67') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3238e61e-6b12-5b57-bd29-bbe809c40fbb', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aaaeff5-67, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1aaaeff5-67, col_values=(('qos', UUID('88a61425-97f1-49a7-9b58-64fd7b06131d')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1aaaeff5-67, col_values=(('external_ids', {'iface-id': '1aaaeff5-679d-4ca7-a20a-05583353b82f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:25:bc', 'vm-uuid': 'f1b27aad-a580-43f3-861a-f150568a374f'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:26 user nova-compute[74980]: INFO os_vif [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:25:bc,bridge_name='br-int',has_traffic_filtering=True,id=1aaaeff5-679d-4ca7-a20a-05583353b82f,network=Network(61d9ee24-0604-4a72-aebc-ff80ff1f35c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaaeff5-67')
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] No VIF found with MAC fa:16:3e:8f:25:bc, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea56f31-932f-42f8-987c-13ef46d2d9f7/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.network.neutron [req-f3152b96-5501-4add-8052-a4cd7299eb8c req-06e5962c-0925-43b2-af68-a5f7634c2e88 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Updated VIF entry in instance network info cache for port 1aaaeff5-679d-4ca7-a20a-05583353b82f. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG nova.network.neutron [req-f3152b96-5501-4add-8052-a4cd7299eb8c req-06e5962c-0925-43b2-af68-a5f7634c2e88 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Updating instance_info_cache with network_info: [{"id": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "address": "fa:16:3e:8f:25:bc", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaaeff5-67", "ovs_interfaceid": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:46:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f3152b96-5501-4add-8052-a4cd7299eb8c req-06e5962c-0925-43b2-af68-a5f7634c2e88 service nova] Releasing lock "refresh_cache-f1b27aad-a580-43f3-861a-f150568a374f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:46:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea56f31-932f-42f8-987c-13ef46d2d9f7/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea56f31-932f-42f8-987c-13ef46d2d9f7/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ea56f31-932f-42f8-987c-13ef46d2d9f7/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-f36bb985-0641-422d-b7cb-27ef19cc4a0d req-44ecf60e-4599-4a66-adc9-b326bd77f112 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received event network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f36bb985-0641-422d-b7cb-27ef19cc4a0d req-44ecf60e-4599-4a66-adc9-b326bd77f112 service nova] Acquiring lock "f1b27aad-a580-43f3-861a-f150568a374f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f36bb985-0641-422d-b7cb-27ef19cc4a0d req-44ecf60e-4599-4a66-adc9-b326bd77f112 service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f36bb985-0641-422d-b7cb-27ef19cc4a0d req-44ecf60e-4599-4a66-adc9-b326bd77f112 service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-f36bb985-0641-422d-b7cb-27ef19cc4a0d req-44ecf60e-4599-4a66-adc9-b326bd77f112 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] No waiting events found dispatching network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:46:30 user nova-compute[74980]: WARNING nova.compute.manager [req-f36bb985-0641-422d-b7cb-27ef19cc4a0d req-44ecf60e-4599-4a66-adc9-b326bd77f112 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received unexpected event network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f for instance with vm_state building and task_state spawning.
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-c57f6c1d-344f-4059-875e-10cdc97b6421 req-bd7b1c65-b5f8-483b-8551-e66cdaede122 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received event network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c57f6c1d-344f-4059-875e-10cdc97b6421 req-bd7b1c65-b5f8-483b-8551-e66cdaede122 service nova] Acquiring lock "f1b27aad-a580-43f3-861a-f150568a374f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c57f6c1d-344f-4059-875e-10cdc97b6421 req-bd7b1c65-b5f8-483b-8551-e66cdaede122 service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c57f6c1d-344f-4059-875e-10cdc97b6421 req-bd7b1c65-b5f8-483b-8551-e66cdaede122 service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-c57f6c1d-344f-4059-875e-10cdc97b6421 req-bd7b1c65-b5f8-483b-8551-e66cdaede122 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] No waiting events found dispatching network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:46:30 user nova-compute[74980]: WARNING nova.compute.manager [req-c57f6c1d-344f-4059-875e-10cdc97b6421 req-bd7b1c65-b5f8-483b-8551-e66cdaede122 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received unexpected event network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f for instance with vm_state building and task_state spawning.
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:46:30 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Instance spawned successfully.
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:46:30 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:46:30 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8285MB free_disk=24.959251403808594GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:46:30 user nova-compute[74980]: INFO nova.compute.manager [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cfef8d27-a749-4469-912b-b272c0080f03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance f1b27aad-a580-43f3-861a-f150568a374f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:46:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:46:30 user nova-compute[74980]: INFO nova.compute.manager [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Took 7.03 seconds to build instance.
Nov 02 17:46:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e34f694-2538-4b22-9171-6548aa473729 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "f1b27aad-a580-43f3-861a-f150568a374f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.137s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:46:31 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:46:31 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:46:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:46:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:46:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:46:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:46:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:46:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:46:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:46:34 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:46:34 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:46:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:46:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:46:34 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:46:35 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Updating instance_info_cache with network_info: [{"id": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "address": "fa:16:3e:7c:b8:1b", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6fd444-02", "ovs_interfaceid": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:46:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:46:35 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:46:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IHYjywcV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:46:39 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:46:39 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:46:39 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86018c0-5b6e-4314-b69d-f102b472af2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:46:39 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a4edf3-8630-4c3d-a251-c4b4b041cd62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19] added
Nov 02 17:46:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa047aa-68e3-456b-89a1-cef907a9de96]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6a5a2c-bbd5-4998-95c2-431e966feddd]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IHYjywcV {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IHYjywcV" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f77c9af-115b-4c4a-9808-147a200de05f]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IHYjywcV'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2f1f59-a804-423c-a128-2636e30d9712]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d0dd6d-01e9-4499-a89a-2be6ceaf5eb3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:46:39 user nova-compute[74980]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:46:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:46:39 user nova-compute[74980]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:46:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc07060-ef54-422c-b747-46c29009b9d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260]
Nov 02 17:46:39 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260] successful.
Nov 02 17:46:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e64689-8338-4e74-81cc-919a71cb0e88]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f52339-f213-43bf-bbc8-72c93528ef38]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:46:39 user nova-compute[74980]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:46:39 user nova-compute[74980]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:46:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:46:39 user nova-compute[74980]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:46:39 user nova-compute[74980]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:46:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b7edf9-58c0-4392-9bea-7cb146724c5a]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:46:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IHYjywcV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:46:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:46:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23762613063383333', 'path': '/dev/sdc'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:46:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762613063383333', 'path': '/dev/sdc'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:46:40 user nova-compute[74980]: DEBUG nova.objects.instance [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'flavor' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:46:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:46:40 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:46:40 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:46:40 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:46:40 user nova-compute[74980]:   <serial>028d2745-e096-4c65-873a-63cee4135d19</serial>
Nov 02 17:46:40 user nova-compute[74980]: </disk>
Nov 02 17:46:40 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:46:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:46:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:46:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] No VIF found with MAC fa:16:3e:d9:e5:54, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:46:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0e4f52df-e568-4953-bed7-02c1d4171e37 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.403s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:46:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-86e43aad-6815-4f06-9239-90f3677fa46b tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:46:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-86e43aad-6815-4f06-9239-90f3677fa46b tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:46:41 user nova-compute[74980]: DEBUG nova.compute.manager [None req-86e43aad-6815-4f06-9239-90f3677fa46b tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:46:41 user nova-compute[74980]: DEBUG nova.compute.manager [None req-86e43aad-6815-4f06-9239-90f3677fa46b tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74980) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 02 17:46:41 user nova-compute[74980]: DEBUG nova.objects.instance [None req-86e43aad-6815-4f06-9239-90f3677fa46b tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'flavor' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:46:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:41 user nova-compute[74980]: DEBUG nova.compute.manager [req-10840c04-a1bd-4746-8c71-c094d5555f0b req-a6ad4222-a0d1-4610-8d0f-6ee7878465e1 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-unplugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:46:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-10840c04-a1bd-4746-8c71-c094d5555f0b req-a6ad4222-a0d1-4610-8d0f-6ee7878465e1 service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:46:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-10840c04-a1bd-4746-8c71-c094d5555f0b req-a6ad4222-a0d1-4610-8d0f-6ee7878465e1 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:46:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-10840c04-a1bd-4746-8c71-c094d5555f0b req-a6ad4222-a0d1-4610-8d0f-6ee7878465e1 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:46:41 user nova-compute[74980]: DEBUG nova.compute.manager [req-10840c04-a1bd-4746-8c71-c094d5555f0b req-a6ad4222-a0d1-4610-8d0f-6ee7878465e1 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-unplugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:46:41 user nova-compute[74980]: WARNING nova.compute.manager [req-10840c04-a1bd-4746-8c71-c094d5555f0b req-a6ad4222-a0d1-4610-8d0f-6ee7878465e1 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received unexpected event network-vif-unplugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with vm_state active and task_state powering-off.
Nov 02 17:46:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:42 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Instance destroyed successfully.
Nov 02 17:46:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-86e43aad-6815-4f06-9239-90f3677fa46b tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:46:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-86e43aad-6815-4f06-9239-90f3677fa46b tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.833s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:46:43 user nova-compute[74980]: DEBUG nova.compute.manager [req-c8027bcc-1730-4b8e-a4a0-54c0959abee5 req-6adf7ebd-89b9-47b8-97e2-443842a1d5a3 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:46:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c8027bcc-1730-4b8e-a4a0-54c0959abee5 req-6adf7ebd-89b9-47b8-97e2-443842a1d5a3 service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:46:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c8027bcc-1730-4b8e-a4a0-54c0959abee5 req-6adf7ebd-89b9-47b8-97e2-443842a1d5a3 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:46:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c8027bcc-1730-4b8e-a4a0-54c0959abee5 req-6adf7ebd-89b9-47b8-97e2-443842a1d5a3 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:46:43 user nova-compute[74980]: DEBUG nova.compute.manager [req-c8027bcc-1730-4b8e-a4a0-54c0959abee5 req-6adf7ebd-89b9-47b8-97e2-443842a1d5a3 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:46:43 user nova-compute[74980]: WARNING nova.compute.manager [req-c8027bcc-1730-4b8e-a4a0-54c0959abee5 req-6adf7ebd-89b9-47b8-97e2-443842a1d5a3 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received unexpected event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with vm_state stopped and task_state None.
Nov 02 17:46:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-e7275971-fced-4d6c-bd31-3996d79332c7 req-84b102b6-34fa-4bae-9bf0-a2fae9e6b9d4 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-changed-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:46:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-e7275971-fced-4d6c-bd31-3996d79332c7 req-84b102b6-34fa-4bae-9bf0-a2fae9e6b9d4 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Refreshing instance network info cache due to event network-changed-5c2fcde8-42ac-4ce6-a511-2221327973b0. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:46:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e7275971-fced-4d6c-bd31-3996d79332c7 req-84b102b6-34fa-4bae-9bf0-a2fae9e6b9d4 service nova] Acquiring lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:46:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e7275971-fced-4d6c-bd31-3996d79332c7 req-84b102b6-34fa-4bae-9bf0-a2fae9e6b9d4 service nova] Acquired lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:46:51 user nova-compute[74980]: DEBUG nova.network.neutron [req-e7275971-fced-4d6c-bd31-3996d79332c7 req-84b102b6-34fa-4bae-9bf0-a2fae9e6b9d4 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Refreshing network info cache for port 5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:46:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:46:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:46:51 user nova-compute[74980]: INFO nova.compute.manager [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Detaching volume 868973ef-76d3-4a26-ab36-414477731e07
Nov 02 17:46:51 user nova-compute[74980]: DEBUG nova.network.neutron [req-e7275971-fced-4d6c-bd31-3996d79332c7 req-84b102b6-34fa-4bae-9bf0-a2fae9e6b9d4 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Updated VIF entry in instance network info cache for port 5c2fcde8-42ac-4ce6-a511-2221327973b0. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:46:51 user nova-compute[74980]: DEBUG nova.network.neutron [req-e7275971-fced-4d6c-bd31-3996d79332c7 req-84b102b6-34fa-4bae-9bf0-a2fae9e6b9d4 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Updating instance_info_cache with network_info: [{"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:46:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e7275971-fced-4d6c-bd31-3996d79332c7 req-84b102b6-34fa-4bae-9bf0-a2fae9e6b9d4 service nova] Releasing lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:46:51 user nova-compute[74980]: INFO nova.virt.block_device [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Attempting to driver detach volume 868973ef-76d3-4a26-ab36-414477731e07 from mountpoint /dev/vdb
Nov 02 17:46:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Attempting to detach device vdb from instance e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:46:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:46:51 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:46:51 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:46:51 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:46:51 user nova-compute[74980]:   <serial>868973ef-76d3-4a26-ab36-414477731e07</serial>
Nov 02 17:46:51 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:46:51 user nova-compute[74980]: </disk>
Nov 02 17:46:51 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:46:51 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Successfully detached device vdb from instance e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e from the persistent domain config.
Nov 02 17:46:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:46:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:46:51 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:46:51 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:46:51 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:46:51 user nova-compute[74980]:   <serial>868973ef-76d3-4a26-ab36-414477731e07</serial>
Nov 02 17:46:51 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:46:51 user nova-compute[74980]: </disk>
Nov 02 17:46:51 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:46:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:46:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-6b746b89-3b76-4898-8e80-8b0740842f7a req-bd96b8a7-44bb-452f-8201-6bd31b758b83 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-changed-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:46:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-6b746b89-3b76-4898-8e80-8b0740842f7a req-bd96b8a7-44bb-452f-8201-6bd31b758b83 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Refreshing instance network info cache due to event network-changed-5c2fcde8-42ac-4ce6-a511-2221327973b0. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:46:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6b746b89-3b76-4898-8e80-8b0740842f7a req-bd96b8a7-44bb-452f-8201-6bd31b758b83 service nova] Acquiring lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:46:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6b746b89-3b76-4898-8e80-8b0740842f7a req-bd96b8a7-44bb-452f-8201-6bd31b758b83 service nova] Acquired lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:46:53 user nova-compute[74980]: DEBUG nova.network.neutron [req-6b746b89-3b76-4898-8e80-8b0740842f7a req-bd96b8a7-44bb-452f-8201-6bd31b758b83 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Refreshing network info cache for port 5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:46:53 user nova-compute[74980]: DEBUG nova.network.neutron [req-6b746b89-3b76-4898-8e80-8b0740842f7a req-bd96b8a7-44bb-452f-8201-6bd31b758b83 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Updated VIF entry in instance network info cache for port 5c2fcde8-42ac-4ce6-a511-2221327973b0. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:46:53 user nova-compute[74980]: DEBUG nova.network.neutron [req-6b746b89-3b76-4898-8e80-8b0740842f7a req-bd96b8a7-44bb-452f-8201-6bd31b758b83 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Updating instance_info_cache with network_info: [{"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:46:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6b746b89-3b76-4898-8e80-8b0740842f7a req-bd96b8a7-44bb-452f-8201-6bd31b758b83 service nova] Releasing lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:46:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:46:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:12 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e is timed out.
Nov 02 17:47:12 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Successfully detached device vdb from instance e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e from the live domain config.
Nov 02 17:47:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvFkMhnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:47:12 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[81580692-8065-4635-9ff6-53cbd39cde24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:47:12 user nova-compute[74980]: No targets found.
Nov 02 17:47:12 user nova-compute[74980]: iSNS:
Nov 02 17:47:12 user nova-compute[74980]: No targets found.
Nov 02 17:47:12 user nova-compute[74980]: STATIC:
Nov 02 17:47:12 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187
Nov 02 17:47:12 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:47:12 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:47:12 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19
Nov 02 17:47:12 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:47:12 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:47:12 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07
Nov 02 17:47:12 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:47:12 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:47:12 user nova-compute[74980]: FIRMWARE:
Nov 02 17:47:12 user nova-compute[74980]: No targets found.
Nov 02 17:47:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:47:12 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:47:12 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8572cf-c839-427c-9912-8ca09ac9ebbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b4a03c-0074-4d82-b54c-e26201d6ca2d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:47:12 user nova-compute[74980]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:47:12 user nova-compute[74980]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:47:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 (non-flash)
Nov 02 17:47:12 user nova-compute[74980]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:47:12 user nova-compute[74980]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:47:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f599456a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dc2e02-bc25-4360-8952-df46ce4e115d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e309d4d1-4800-4f40-9ecc-912bd653dd9f]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7190d3-2237-4bc6-a5cf-2a2041d675fb]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa18cb3-f28a-4188-b9d7-50fe6046d6e0]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6ece77-d8b2-478c-98b8-8ab63388c30d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df1819b-a35f-4968-bb90-b5477b281791]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07, portal: 172.16.0.220,3260]
Nov 02 17:47:12 user nova-compute[74980]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07, portal: 172.16.0.220,3260] successful.
Nov 02 17:47:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868973ef-76d3-4a26-ab36-414477731e07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[38772fc0-d03b-4c6d-bfbf-ca97262cdc64]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] <== disconnect_volume: return (304ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:47:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:47:13 user nova-compute[74980]: DEBUG nova.objects.instance [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'flavor' on Instance uuid e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:47:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dce0f00e-b349-4da0-99e1-3b30a9012ea8 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.764s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:47:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:18 user nova-compute[74980]: INFO nova.compute.manager [None req-2587e662-644e-4b39-bd2d-c2b91dbbd729 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Unrescuing
Nov 02 17:47:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2587e662-644e-4b39-bd2d-c2b91dbbd729 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:47:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2587e662-644e-4b39-bd2d-c2b91dbbd729 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquired lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:47:18 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2587e662-644e-4b39-bd2d-c2b91dbbd729 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:47:19 user nova-compute[74980]: DEBUG nova.network.neutron [None req-2587e662-644e-4b39-bd2d-c2b91dbbd729 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Updating instance_info_cache with network_info: [{"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:47:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2587e662-644e-4b39-bd2d-c2b91dbbd729 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Releasing lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:47:19 user nova-compute[74980]: DEBUG nova.objects.instance [None req-2587e662-644e-4b39-bd2d-c2b91dbbd729 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'flavor' on Instance uuid 6ea56f31-932f-42f8-987c-13ef46d2d9f7 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:47:19 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:47:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-d00767cc-a2da-4a0f-8dd2-6e45bfdd216d req-25277037-1d87-442e-a96a-4c0d9c3fe064 service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received event network-vif-unplugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:47:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d00767cc-a2da-4a0f-8dd2-6e45bfdd216d req-25277037-1d87-442e-a96a-4c0d9c3fe064 service nova] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:47:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d00767cc-a2da-4a0f-8dd2-6e45bfdd216d req-25277037-1d87-442e-a96a-4c0d9c3fe064 service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:47:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d00767cc-a2da-4a0f-8dd2-6e45bfdd216d req-25277037-1d87-442e-a96a-4c0d9c3fe064 service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:47:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-d00767cc-a2da-4a0f-8dd2-6e45bfdd216d req-25277037-1d87-442e-a96a-4c0d9c3fe064 service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] No waiting events found dispatching network-vif-unplugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:47:19 user nova-compute[74980]: WARNING nova.compute.manager [req-d00767cc-a2da-4a0f-8dd2-6e45bfdd216d req-25277037-1d87-442e-a96a-4c0d9c3fe064 service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received unexpected event network-vif-unplugged-c27b6981-9e85-4496-a959-a3ae4e377b34 for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:47:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:19 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Instance destroyed successfully.
Nov 02 17:47:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:21 user nova-compute[74980]: DEBUG nova.compute.manager [req-b312a2dd-8185-4887-a23b-7c5361645cfe req-f39f03a4-5d04-421e-9700-bdff4ba125ba service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:47:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b312a2dd-8185-4887-a23b-7c5361645cfe req-f39f03a4-5d04-421e-9700-bdff4ba125ba service nova] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:47:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b312a2dd-8185-4887-a23b-7c5361645cfe req-f39f03a4-5d04-421e-9700-bdff4ba125ba service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:47:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b312a2dd-8185-4887-a23b-7c5361645cfe req-f39f03a4-5d04-421e-9700-bdff4ba125ba service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:47:21 user nova-compute[74980]: DEBUG nova.compute.manager [req-b312a2dd-8185-4887-a23b-7c5361645cfe req-f39f03a4-5d04-421e-9700-bdff4ba125ba service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] No waiting events found dispatching network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:47:21 user nova-compute[74980]: WARNING nova.compute.manager [req-b312a2dd-8185-4887-a23b-7c5361645cfe req-f39f03a4-5d04-421e-9700-bdff4ba125ba service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received unexpected event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:47:21 user nova-compute[74980]: DEBUG nova.compute.manager [req-b312a2dd-8185-4887-a23b-7c5361645cfe req-f39f03a4-5d04-421e-9700-bdff4ba125ba service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:47:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b312a2dd-8185-4887-a23b-7c5361645cfe req-f39f03a4-5d04-421e-9700-bdff4ba125ba service nova] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:47:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b312a2dd-8185-4887-a23b-7c5361645cfe req-f39f03a4-5d04-421e-9700-bdff4ba125ba service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:47:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b312a2dd-8185-4887-a23b-7c5361645cfe req-f39f03a4-5d04-421e-9700-bdff4ba125ba service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:47:21 user nova-compute[74980]: DEBUG nova.compute.manager [req-b312a2dd-8185-4887-a23b-7c5361645cfe req-f39f03a4-5d04-421e-9700-bdff4ba125ba service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] No waiting events found dispatching network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:47:21 user nova-compute[74980]: WARNING nova.compute.manager [req-b312a2dd-8185-4887-a23b-7c5361645cfe req-f39f03a4-5d04-421e-9700-bdff4ba125ba service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received unexpected event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:47:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:22 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:47:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-2587e662-644e-4b39-bd2d-c2b91dbbd729 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:47:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-a04733ef-e4e5-4391-a3e6-a1a39ce7ad3e req-27cf72c5-e08e-4843-ae1e-a8d447adf556 service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:47:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a04733ef-e4e5-4391-a3e6-a1a39ce7ad3e req-27cf72c5-e08e-4843-ae1e-a8d447adf556 service nova] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:47:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a04733ef-e4e5-4391-a3e6-a1a39ce7ad3e req-27cf72c5-e08e-4843-ae1e-a8d447adf556 service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:47:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a04733ef-e4e5-4391-a3e6-a1a39ce7ad3e req-27cf72c5-e08e-4843-ae1e-a8d447adf556 service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:47:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-a04733ef-e4e5-4391-a3e6-a1a39ce7ad3e req-27cf72c5-e08e-4843-ae1e-a8d447adf556 service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] No waiting events found dispatching network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:47:23 user nova-compute[74980]: WARNING nova.compute.manager [req-a04733ef-e4e5-4391-a3e6-a1a39ce7ad3e req-27cf72c5-e08e-4843-ae1e-a8d447adf556 service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received unexpected event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 for instance with vm_state active and task_state None.
Nov 02 17:47:24 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:47:24 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:47:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:47:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:47:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:47:24 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:47:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:47:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:47:27 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:47:27 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:47:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8402MB free_disk=24.93011474609375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cfef8d27-a749-4469-912b-b272c0080f03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance f1b27aad-a580-43f3-861a-f150568a374f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:47:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:47:28 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:47:28 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:47:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:47:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:47:30 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:47:30 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:47:30 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:47:31 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:47:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:47:35 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:47:35 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:47:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:47:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:47:35 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:47:36 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Updating instance_info_cache with network_info: [{"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:47:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:47:36 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:47:36 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:47:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:47:37 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:47:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:47:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:47:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:47:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:47:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:47:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:47:41 user nova-compute[74980]: INFO nova.compute.manager [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Terminating instance
Nov 02 17:47:41 user nova-compute[74980]: DEBUG nova.compute.manager [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:47:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-75525f29-107c-4f53-8df4-3335b2f6e980 req-f4c123f3-1375-4b5c-b764-6eff58a53c9c service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-vif-unplugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-75525f29-107c-4f53-8df4-3335b2f6e980 req-f4c123f3-1375-4b5c-b764-6eff58a53c9c service nova] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-75525f29-107c-4f53-8df4-3335b2f6e980 req-f4c123f3-1375-4b5c-b764-6eff58a53c9c service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-75525f29-107c-4f53-8df4-3335b2f6e980 req-f4c123f3-1375-4b5c-b764-6eff58a53c9c service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-75525f29-107c-4f53-8df4-3335b2f6e980 req-f4c123f3-1375-4b5c-b764-6eff58a53c9c service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] No waiting events found dispatching network-vif-unplugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-75525f29-107c-4f53-8df4-3335b2f6e980 req-f4c123f3-1375-4b5c-b764-6eff58a53c9c service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-vif-unplugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:42 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Instance destroyed successfully.
Nov 02 17:47:42 user nova-compute[74980]: DEBUG nova.objects.instance [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'resources' on Instance uuid e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:40:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-138862382',display_name='tempest-ServerRescueNegativeTestJSON-server-138862382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-138862382',id=36,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuKStpw7DFbvE328Zxz9Ykoa6CbmGKIXVv7rsiKwiyCOeuaJ+jFMFcOErWQ4L9ovcgKgiR4rEnBp5BAytU14OHeYTIQY2iDkgxpilQGkmZHmFvAu7SJaLIUa1aKbiX3/Q==',key_name='tempest-keypair-1369605087',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:43:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc26ef1932f1408c860b3b9edb4925a4',ramdisk_id='',reservation_id='r-spzm07ce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-86632079',owner_user_name='tempest-ServerRescueNegativeTestJSON-86632079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:45:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='985386b6880e4b07bdad162c7860d7a3',uuid=e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converting VIF {"id": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "address": "fa:16:3e:fb:47:7d", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2fcde8-42", "ovs_interfaceid": "5c2fcde8-42ac-4ce6-a511-2221327973b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:47:7d,bridge_name='br-int',has_traffic_filtering=True,id=5c2fcde8-42ac-4ce6-a511-2221327973b0,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2fcde8-42') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG os_vif [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:47:7d,bridge_name='br-int',has_traffic_filtering=True,id=5c2fcde8-42ac-4ce6-a511-2221327973b0,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2fcde8-42') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c2fcde8-42, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75fc9150-427a-4417-8873-3923327a8778) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:42 user nova-compute[74980]: INFO os_vif [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:47:7d,bridge_name='br-int',has_traffic_filtering=True,id=5c2fcde8-42ac-4ce6-a511-2221327973b0,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2fcde8-42')
Nov 02 17:47:42 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Deleting instance files /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e_del
Nov 02 17:47:42 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Deletion of /opt/stack/data/nova/instances/e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e_del complete
Nov 02 17:47:42 user nova-compute[74980]: INFO nova.compute.manager [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 02 17:47:42 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:47:42 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:47:43 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:47:43 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Took 0.70 seconds to deallocate network for instance.
Nov 02 17:47:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:47:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:47:43 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:47:43 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:47:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:47:43 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Deleted allocations for instance e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e
Nov 02 17:47:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-062820b9-db06-4ce0-aff3-4b5cd1e6bc86 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.981s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:47:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-4a105be2-3c6a-41d0-bf78-95602562aaca req-e1d7a91f-5785-47ee-9f8d-7e1ebbf49673 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:47:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4a105be2-3c6a-41d0-bf78-95602562aaca req-e1d7a91f-5785-47ee-9f8d-7e1ebbf49673 service nova] Acquiring lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:47:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4a105be2-3c6a-41d0-bf78-95602562aaca req-e1d7a91f-5785-47ee-9f8d-7e1ebbf49673 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:47:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4a105be2-3c6a-41d0-bf78-95602562aaca req-e1d7a91f-5785-47ee-9f8d-7e1ebbf49673 service nova] Lock "e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:47:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-4a105be2-3c6a-41d0-bf78-95602562aaca req-e1d7a91f-5785-47ee-9f8d-7e1ebbf49673 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] No waiting events found dispatching network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:47:44 user nova-compute[74980]: WARNING nova.compute.manager [req-4a105be2-3c6a-41d0-bf78-95602562aaca req-e1d7a91f-5785-47ee-9f8d-7e1ebbf49673 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received unexpected event network-vif-plugged-5c2fcde8-42ac-4ce6-a511-2221327973b0 for instance with vm_state deleted and task_state None.
Nov 02 17:47:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-4a105be2-3c6a-41d0-bf78-95602562aaca req-e1d7a91f-5785-47ee-9f8d-7e1ebbf49673 service nova] [instance: e5ce2ffe-9fc3-42c6-ad35-ba6cc714bb7e] Received event network-vif-deleted-5c2fcde8-42ac-4ce6-a511-2221327973b0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:47:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:47:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:47:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:47:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:47:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:47:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:48:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:48:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:48:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:48:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:48:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:48:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-4009734c-963d-4fd4-9cb9-4409f5890e9e req-b40e34af-64fc-4686-9a90-8a09e4a9e7f8 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received event network-changed-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:48:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-4009734c-963d-4fd4-9cb9-4409f5890e9e req-b40e34af-64fc-4686-9a90-8a09e4a9e7f8 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Refreshing instance network info cache due to event network-changed-1aaaeff5-679d-4ca7-a20a-05583353b82f. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:48:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4009734c-963d-4fd4-9cb9-4409f5890e9e req-b40e34af-64fc-4686-9a90-8a09e4a9e7f8 service nova] Acquiring lock "refresh_cache-f1b27aad-a580-43f3-861a-f150568a374f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:48:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4009734c-963d-4fd4-9cb9-4409f5890e9e req-b40e34af-64fc-4686-9a90-8a09e4a9e7f8 service nova] Acquired lock "refresh_cache-f1b27aad-a580-43f3-861a-f150568a374f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:48:14 user nova-compute[74980]: DEBUG nova.network.neutron [req-4009734c-963d-4fd4-9cb9-4409f5890e9e req-b40e34af-64fc-4686-9a90-8a09e4a9e7f8 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Refreshing network info cache for port 1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:48:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "f1b27aad-a580-43f3-861a-f150568a374f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:48:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "f1b27aad-a580-43f3-861a-f150568a374f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:48:14 user nova-compute[74980]: DEBUG nova.objects.instance [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lazy-loading 'flavor' on Instance uuid f1b27aad-a580-43f3-861a-f150568a374f {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:48:15 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Ignoring supplied device name: /dev/vdb
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "f1b27aad-a580-43f3-861a-f150568a374f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "f1b27aad-a580-43f3-861a-f150568a374f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "f1b27aad-a580-43f3-861a-f150568a374f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:48:15 user nova-compute[74980]: INFO nova.compute.manager [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Attaching volume 6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 to /dev/vdb
Nov 02 17:48:15 user nova-compute[74980]: DEBUG os_brick.utils [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5c2959-2d7f-4d35-9ff1-bb996ca13705]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG nova.network.neutron [req-4009734c-963d-4fd4-9cb9-4409f5890e9e req-b40e34af-64fc-4686-9a90-8a09e4a9e7f8 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Updated VIF entry in instance network info cache for port 1aaaeff5-679d-4ca7-a20a-05583353b82f. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG nova.network.neutron [req-4009734c-963d-4fd4-9cb9-4409f5890e9e req-b40e34af-64fc-4686-9a90-8a09e4a9e7f8 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Updating instance_info_cache with network_info: [{"id": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "address": "fa:16:3e:8f:25:bc", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaaeff5-67", "ovs_interfaceid": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f895df43-9a68-482c-86e7-48c1940efcc2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4009734c-963d-4fd4-9cb9-4409f5890e9e req-b40e34af-64fc-4686-9a90-8a09e4a9e7f8 service nova] Releasing lock "refresh_cache-f1b27aad-a580-43f3-861a-f150568a374f" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7c8946-67bf-48fa-a546-4b98ddf305bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[167945a7-b135-4784-b50e-4ddbe88420a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:48:15 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:48:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8116c531-4d2e-49bd-a0b6-9f4367ab6b31]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG os_brick.utils [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:48:15 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Updating existing volume attachment record: ac953fcf-f05e-4317-bfb4-d959b258e9ab {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:48:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:20 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:48:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:24 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:48:24 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:48:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:25 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:48:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:48:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:48:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:48:25 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:48:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:25 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:48:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:48:28 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:48:28 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8554MB free_disk=24.95720672607422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cfef8d27-a749-4469-912b-b272c0080f03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance f1b27aad-a580-43f3-861a-f150568a374f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing inventories for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating ProviderTree inventory for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating inventory in ProviderTree for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing aggregate associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, aggregates: None {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing trait associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:48:28 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:48:29 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:48:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:48:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:31 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:48:31 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:48:31 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:48:31 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:48:31 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 17:48:31 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] There are 0 instances to clean {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG nova.objects.instance [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'flavor' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquired lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG nova.network.neutron [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG nova.objects.instance [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'info_cache' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG nova.objects.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Object Instance<cfef8d27-a749-4469-912b-b272c0080f03> lazy-loaded attributes: flavor,info_cache {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG nova.network.neutron [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Updating instance_info_cache with network_info: [{"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Releasing lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:32 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Instance destroyed successfully.
Nov 02 17:48:32 user nova-compute[74980]: DEBUG nova.objects.instance [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'resources' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG nova.objects.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Object Instance<cfef8d27-a749-4469-912b-b272c0080f03> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-250854749',display_name='tempest-AttachVolumeTestJSON-server-250854749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-250854749',id=39,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6JAtpXxXAMk37Fjkmu/ZPyEKNAoZCsurgqR46mBWz93eP3XOv624lEH1cEe8AD13EovSi2qgytX7qPhQWZ2yoWROF90MH23x4k9KH5UB+HXi+XcSNSHRnM1ZBy5kZltQ==',key_name='tempest-keypair-503867642',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d8271dee2adb499dae5bbd63662036e0',ramdisk_id='',reservation_id='r-l2gruwx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847432967',owner_user_name='tempest-AttachVolumeTestJSON-847432967-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:46:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dea42f332a54314a6ffc0790bd66240',uuid=cfef8d27-a749-4469-912b-b272c0080f03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converting VIF {"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_vif [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea0afd21-07, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4a5eb55-771a-47fb-84ec-42c99f5cfcc6) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:32 user nova-compute[74980]: INFO os_vif [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07')
Nov 02 17:48:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IHYjywcV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:48:32 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e453c00f-4095-4dea-b432-9cd84087faae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:48:32 user nova-compute[74980]: No targets found.
Nov 02 17:48:32 user nova-compute[74980]: iSNS:
Nov 02 17:48:32 user nova-compute[74980]: No targets found.
Nov 02 17:48:32 user nova-compute[74980]: STATIC:
Nov 02 17:48:32 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187
Nov 02 17:48:32 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:48:32 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:48:32 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19
Nov 02 17:48:32 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:48:32 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:48:32 user nova-compute[74980]: FIRMWARE:
Nov 02 17:48:32 user nova-compute[74980]: No targets found.
Nov 02 17:48:32 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:48:32 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:48:32 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddbbc58-25f9-4686-8911-803df6299f7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbfe240-529e-42b1-9e0a-e799cc9f27ce]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:48:32 user nova-compute[74980]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:48:32 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:48:32 user nova-compute[74980]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:48:32 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b41270a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19'): ({'sdc'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Removing single pathed devices sdc {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8855abde-3448-4696-b913-9b2d684f2ef6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[687b3bc8-645c-49d5-a8ca-5c4e1d54332a]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Flushing IO for device /dev/sdc {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4f40da-c535-445b-9077-dc8cc2e033a8]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[151b1c82-8004-4521-9d2f-b7fdc4ae29eb]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c71628-d638-4c8e-817b-dc3cbfd63db8]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[055dab53-0211-464c-852d-4ffb0a6b97e3]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260]
Nov 02 17:48:32 user nova-compute[74980]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260] successful.
Nov 02 17:48:32 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[da771d6e-ad56-4a5e-82c3-c3fabe9b4331]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] <== disconnect_volume: return (282ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Start _get_guest_xml network_info=[{"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IHYjywcV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'cfef8d27-a749-4469-912b-b272c0080f03', 'attached_at': '', 'detached_at': '', 'volume_id': '028d2745-e096-4c65-873a-63cee4135d19', 'serial': '028d2745-e096-4c65-873a-63cee4135d19'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'f3c56259-0cd4-40df-9b59-aa356180ccac', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.objects.instance [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'numa_topology' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.objects.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Object Instance<cfef8d27-a749-4469-912b-b272c0080f03> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:48:33 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:48:33 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.objects.instance [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'vcpu_model' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.objects.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Object Instance<cfef8d27-a749-4469-912b-b272c0080f03> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IHYjywcV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:48:33 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:48:33 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:48:33 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b975671-4a4a-43b8-acaf-869312176002]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:48:33 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01991d9-bb29-4cb9-9190-c9d13f01d195]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19] added
Nov 02 17:48:33 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6a6398-2080-433e-aca3-344686975b7c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f835d1dc-bc8f-4be1-8495-051532942d8c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IHYjywcV {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IHYjywcV" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a07d5e-275f-4e69-b057-eb96cc2c1ba7]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IHYjywcV'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f4515b-41bc-478b-ba1e-8ccf8e61514e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd22eb14-1461-427e-a869-62d4e0047ab8]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:48:33 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:48:33 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0c9066-c34f-4121-90d8-409e3bf4b9a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260]
Nov 02 17:48:33 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260] successful.
Nov 02 17:48:33 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[419adcca-bca4-43e1-b750-baf20510f150]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b2cef6-6127-4cae-a288-03e532c6d577]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:48:33 user nova-compute[74980]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:48:33 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:48:33 user nova-compute[74980]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:48:33 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5aea60-976a-41ef-9994-5512b4920a16]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IHYjywcV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:48:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23762613063383333', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762613063383333', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-250854749',display_name='tempest-AttachVolumeTestJSON-server-250854749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-250854749',id=39,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6JAtpXxXAMk37Fjkmu/ZPyEKNAoZCsurgqR46mBWz93eP3XOv624lEH1cEe8AD13EovSi2qgytX7qPhQWZ2yoWROF90MH23x4k9KH5UB+HXi+XcSNSHRnM1ZBy5kZltQ==',key_name='tempest-keypair-503867642',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d8271dee2adb499dae5bbd63662036e0',ramdisk_id='',reservation_id='r-l2gruwx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847432967',owner_user_name='tempest-AttachVolumeTestJSON-847432967-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:46:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dea42f332a54314a6ffc0790bd66240',uuid=cfef8d27-a749-4469-912b-b272c0080f03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converting VIF {"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG nova.objects.instance [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'pci_devices' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG nova.objects.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Object Instance<cfef8d27-a749-4469-912b-b272c0080f03> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:48:34 user nova-compute[74980]:   <uuid>cfef8d27-a749-4469-912b-b272c0080f03</uuid>
Nov 02 17:48:34 user nova-compute[74980]:   <name>instance-00000027</name>
Nov 02 17:48:34 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:48:34 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:48:34 user nova-compute[74980]:   <metadata>
Nov 02 17:48:34 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:48:34 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:48:34 user nova-compute[74980]:       <nova:name>tempest-AttachVolumeTestJSON-server-250854749</nova:name>
Nov 02 17:48:34 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:48:33</nova:creationTime>
Nov 02 17:48:34 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:48:34 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:48:34 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:48:34 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:48:34 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:48:34 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:48:34 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:48:34 user nova-compute[74980]:       <nova:owner>
Nov 02 17:48:34 user nova-compute[74980]:         <nova:user uuid="3dea42f332a54314a6ffc0790bd66240">tempest-AttachVolumeTestJSON-847432967-project-member</nova:user>
Nov 02 17:48:34 user nova-compute[74980]:         <nova:project uuid="d8271dee2adb499dae5bbd63662036e0">tempest-AttachVolumeTestJSON-847432967</nova:project>
Nov 02 17:48:34 user nova-compute[74980]:       </nova:owner>
Nov 02 17:48:34 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:48:34 user nova-compute[74980]:       <nova:ports>
Nov 02 17:48:34 user nova-compute[74980]:         <nova:port uuid="ea0afd21-0732-4572-97d1-63b55c6e5655">
Nov 02 17:48:34 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 17:48:34 user nova-compute[74980]:         </nova:port>
Nov 02 17:48:34 user nova-compute[74980]:       </nova:ports>
Nov 02 17:48:34 user nova-compute[74980]:     </nova:instance>
Nov 02 17:48:34 user nova-compute[74980]:   </metadata>
Nov 02 17:48:34 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:48:34 user nova-compute[74980]:     <system>
Nov 02 17:48:34 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:48:34 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:48:34 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:48:34 user nova-compute[74980]:       <entry name="serial">cfef8d27-a749-4469-912b-b272c0080f03</entry>
Nov 02 17:48:34 user nova-compute[74980]:       <entry name="uuid">cfef8d27-a749-4469-912b-b272c0080f03</entry>
Nov 02 17:48:34 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:48:34 user nova-compute[74980]:     </system>
Nov 02 17:48:34 user nova-compute[74980]:   </sysinfo>
Nov 02 17:48:34 user nova-compute[74980]:   <os>
Nov 02 17:48:34 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:48:34 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:48:34 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:48:34 user nova-compute[74980]:   </os>
Nov 02 17:48:34 user nova-compute[74980]:   <features>
Nov 02 17:48:34 user nova-compute[74980]:     <acpi/>
Nov 02 17:48:34 user nova-compute[74980]:     <apic/>
Nov 02 17:48:34 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:48:34 user nova-compute[74980]:   </features>
Nov 02 17:48:34 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:48:34 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:48:34 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:48:34 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:48:34 user nova-compute[74980]:   </clock>
Nov 02 17:48:34 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:48:34 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:48:34 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:48:34 user nova-compute[74980]:   </cpu>
Nov 02 17:48:34 user nova-compute[74980]:   <devices>
Nov 02 17:48:34 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:48:34 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:48:34 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk"/>
Nov 02 17:48:34 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:48:34 user nova-compute[74980]:     </disk>
Nov 02 17:48:34 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:48:34 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:48:34 user nova-compute[74980]:       <source dev="/dev/sdb"/>
Nov 02 17:48:34 user nova-compute[74980]:       <target dev="vdb" bus="virtio"/>
Nov 02 17:48:34 user nova-compute[74980]:       <serial>028d2745-e096-4c65-873a-63cee4135d19</serial>
Nov 02 17:48:34 user nova-compute[74980]:     </disk>
Nov 02 17:48:34 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:48:34 user nova-compute[74980]:       <mac address="fa:16:3e:d9:e5:54"/>
Nov 02 17:48:34 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:48:34 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:48:34 user nova-compute[74980]:       <target dev="tapea0afd21-07"/>
Nov 02 17:48:34 user nova-compute[74980]:     </interface>
Nov 02 17:48:34 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:48:34 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/console.log" append="off"/>
Nov 02 17:48:34 user nova-compute[74980]:     </serial>
Nov 02 17:48:34 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:48:34 user nova-compute[74980]:     <video>
Nov 02 17:48:34 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:48:34 user nova-compute[74980]:     </video>
Nov 02 17:48:34 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:48:34 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:48:34 user nova-compute[74980]:     </rng>
Nov 02 17:48:34 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:48:34 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:48:34 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:48:34 user nova-compute[74980]:     </memballoon>
Nov 02 17:48:34 user nova-compute[74980]:   </devices>
Nov 02 17:48:34 user nova-compute[74980]: </domain>
Nov 02 17:48:34 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG nova.objects.instance [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'trusted_certs' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG nova.objects.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Object Instance<cfef8d27-a749-4469-912b-b272c0080f03> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:48:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.203s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Cannot resize image /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG nova.objects.instance [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'migration_context' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG nova.objects.base [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Object Instance<cfef8d27-a749-4469-912b-b272c0080f03> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-250854749',display_name='tempest-AttachVolumeTestJSON-server-250854749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-250854749',id=39,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6JAtpXxXAMk37Fjkmu/ZPyEKNAoZCsurgqR46mBWz93eP3XOv624lEH1cEe8AD13EovSi2qgytX7qPhQWZ2yoWROF90MH23x4k9KH5UB+HXi+XcSNSHRnM1ZBy5kZltQ==',key_name='tempest-keypair-503867642',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d8271dee2adb499dae5bbd63662036e0',ramdisk_id='',reservation_id='r-l2gruwx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847432967',owner_user_name='tempest-AttachVolumeTestJSON-847432967-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:46:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dea42f332a54314a6ffc0790bd66240',uuid=cfef8d27-a749-4469-912b-b272c0080f03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converting VIF {"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG os_vif [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85dfbe5a-5fb1-52fe-8d55-631a0e2a843e', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea0afd21-07, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea0afd21-07, col_values=(('qos', UUID('8e7cfc34-4277-45b4-b0f1-6660ff5372cc')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea0afd21-07, col_values=(('external_ids', {'iface-id': 'ea0afd21-0732-4572-97d1-63b55c6e5655', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:e5:54', 'vm-uuid': 'cfef8d27-a749-4469-912b-b272c0080f03'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:48:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:35 user nova-compute[74980]: INFO os_vif [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07')
Nov 02 17:48:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-e987d3ad-f90b-4da0-a4f1-b8683aaf0ef9 req-94e1ea51-5369-4a21-8d54-58f45e140dab service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:48:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e987d3ad-f90b-4da0-a4f1-b8683aaf0ef9 req-94e1ea51-5369-4a21-8d54-58f45e140dab service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:48:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e987d3ad-f90b-4da0-a4f1-b8683aaf0ef9 req-94e1ea51-5369-4a21-8d54-58f45e140dab service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:48:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e987d3ad-f90b-4da0-a4f1-b8683aaf0ef9 req-94e1ea51-5369-4a21-8d54-58f45e140dab service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:48:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-e987d3ad-f90b-4da0-a4f1-b8683aaf0ef9 req-94e1ea51-5369-4a21-8d54-58f45e140dab service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:48:36 user nova-compute[74980]: WARNING nova.compute.manager [req-e987d3ad-f90b-4da0-a4f1-b8683aaf0ef9 req-94e1ea51-5369-4a21-8d54-58f45e140dab service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received unexpected event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with vm_state stopped and task_state powering-on.
Nov 02 17:48:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:37 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:48:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:48:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:48:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:48:37 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:48:38 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Updating instance_info_cache with network_info: [{"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:48:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:48:38 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:48:38 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:48:38 user nova-compute[74980]: DEBUG nova.compute.manager [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:48:38 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Instance rebooted successfully.
Nov 02 17:48:38 user nova-compute[74980]: DEBUG nova.compute.manager [None req-f4e15c88-9a90-4309-9602-3b8af84ecb12 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:48:38 user nova-compute[74980]: DEBUG nova.compute.manager [req-596649f8-a935-4a3e-9792-909c7e166267 req-9fb525f0-e540-4bf6-827d-f7b13b411f54 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:48:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-596649f8-a935-4a3e-9792-909c7e166267 req-9fb525f0-e540-4bf6-827d-f7b13b411f54 service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:48:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-596649f8-a935-4a3e-9792-909c7e166267 req-9fb525f0-e540-4bf6-827d-f7b13b411f54 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:48:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-596649f8-a935-4a3e-9792-909c7e166267 req-9fb525f0-e540-4bf6-827d-f7b13b411f54 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:48:38 user nova-compute[74980]: DEBUG nova.compute.manager [req-596649f8-a935-4a3e-9792-909c7e166267 req-9fb525f0-e540-4bf6-827d-f7b13b411f54 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:48:38 user nova-compute[74980]: WARNING nova.compute.manager [req-596649f8-a935-4a3e-9792-909c7e166267 req-9fb525f0-e540-4bf6-827d-f7b13b411f54 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received unexpected event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with vm_state active and task_state None.
Nov 02 17:48:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWjHTnLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:48:45 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:48:45 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:48:45 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7363049-c852-40b8-a575-49ffe27dc13e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:48:45 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aef9f4-a004-44e0-815f-ae1424f8e907]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2] added
Nov 02 17:48:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fee93c-3e83-426f-85d3-23e740a45e85]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d26e4a-f755-463f-a0de-c754a9a2aed1]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qWjHTnLE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qWjHTnLE" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aef8f2-4e2d-4fdb-8244-b4e2cb4b2549]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qWjHTnLE'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae82aff-c53c-47b4-8ecc-35870a56c461]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec800e9-e750-48a4-9f58-c01304424388]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:48:45 user nova-compute[74980]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:48:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:48:45 user nova-compute[74980]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:48:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64e05f7-6254-4c81-b7fa-c24f14673f94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2, portal: 172.16.0.220,3260]
Nov 02 17:48:45 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2, portal: 172.16.0.220,3260] successful.
Nov 02 17:48:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70aa3cf-39c6-478b-ab46-fe1d53669b29]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a85814-fa8b-4d1d-a8eb-efae2ae98d59]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:48:45 user nova-compute[74980]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:48:45 user nova-compute[74980]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 (non-flash)
Nov 02 17:48:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:48:45 user nova-compute[74980]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:48:45 user nova-compute[74980]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 (non-flash)
Nov 02 17:48:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aba6be-bbe5-41df-8122-57650829b496]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:48:45 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:48:46 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:48:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWjHTnLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:48:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:48:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23533376336653636', 'path': '/dev/sdc'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:48:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533376336653636', 'path': '/dev/sdc'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:48:46 user nova-compute[74980]: DEBUG nova.objects.instance [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lazy-loading 'flavor' on Instance uuid f1b27aad-a580-43f3-861a-f150568a374f {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:48:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:48:46 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:48:46 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:48:46 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:48:46 user nova-compute[74980]:   <serial>6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2</serial>
Nov 02 17:48:46 user nova-compute[74980]: </disk>
Nov 02 17:48:46 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:48:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:48:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:48:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] No VIF found with MAC fa:16:3e:8f:25:bc, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:48:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c2874962-ec60-4457-b7ff-9bfaec6a272e tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "f1b27aad-a580-43f3-861a-f150568a374f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.080s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:48:47 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:48:47 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74980) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 17:48:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:48:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:48:56 user nova-compute[74980]: INFO nova.compute.manager [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Terminating instance
Nov 02 17:48:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-c6cd310e-24c8-4614-8757-5b492594d983 req-5771b8a7-e238-4c63-8768-0b5d49179f5b service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received event network-vif-unplugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c6cd310e-24c8-4614-8757-5b492594d983 req-5771b8a7-e238-4c63-8768-0b5d49179f5b service nova] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c6cd310e-24c8-4614-8757-5b492594d983 req-5771b8a7-e238-4c63-8768-0b5d49179f5b service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c6cd310e-24c8-4614-8757-5b492594d983 req-5771b8a7-e238-4c63-8768-0b5d49179f5b service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-c6cd310e-24c8-4614-8757-5b492594d983 req-5771b8a7-e238-4c63-8768-0b5d49179f5b service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] No waiting events found dispatching network-vif-unplugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-c6cd310e-24c8-4614-8757-5b492594d983 req-5771b8a7-e238-4c63-8768-0b5d49179f5b service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received event network-vif-unplugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:56 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Instance destroyed successfully.
Nov 02 17:48:56 user nova-compute[74980]: DEBUG nova.objects.instance [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'resources' on Instance uuid 91bccf34-87a9-48f3-bbc7-4a70b9753036 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2077511521',display_name='tempest-ServerRescueNegativeTestJSON-server-2077511521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2077511521',id=28,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc26ef1932f1408c860b3b9edb4925a4',ramdisk_id='',reservation_id='r-jgytv777',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-86632079',owner_user_name='tempest-ServerRescueNegativeTestJSON-86632079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:34:16Z,user_data=None,user_id='985386b6880e4b07bdad162c7860d7a3',uuid=91bccf34-87a9-48f3-bbc7-4a70b9753036,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converting VIF {"id": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "address": "fa:16:3e:3d:11:5f", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae57bdb2-df", "ovs_interfaceid": "ae57bdb2-dfca-46be-bc84-9ea10a5634ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:11:5f,bridge_name='br-int',has_traffic_filtering=True,id=ae57bdb2-dfca-46be-bc84-9ea10a5634ad,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae57bdb2-df') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG os_vif [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:11:5f,bridge_name='br-int',has_traffic_filtering=True,id=ae57bdb2-dfca-46be-bc84-9ea10a5634ad,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae57bdb2-df') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae57bdb2-df, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac3b38fa-7f61-40c7-9935-a10f25a17260) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:48:56 user nova-compute[74980]: INFO os_vif [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:11:5f,bridge_name='br-int',has_traffic_filtering=True,id=ae57bdb2-dfca-46be-bc84-9ea10a5634ad,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae57bdb2-df')
Nov 02 17:48:56 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Deleting instance files /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036_del
Nov 02 17:48:56 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Deletion of /opt/stack/data/nova/instances/91bccf34-87a9-48f3-bbc7-4a70b9753036_del complete
Nov 02 17:48:56 user nova-compute[74980]: INFO nova.compute.manager [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 02 17:48:56 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:48:56 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:48:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:48:57 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:48:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-c75cd782-8d02-4de9-9b1f-90358fde3e14 req-512ad94e-c076-457f-aa18-21ba15ccb030 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received event network-vif-deleted-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:48:57 user nova-compute[74980]: INFO nova.compute.manager [req-c75cd782-8d02-4de9-9b1f-90358fde3e14 req-512ad94e-c076-457f-aa18-21ba15ccb030 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Neutron deleted interface ae57bdb2-dfca-46be-bc84-9ea10a5634ad; detaching it from the instance and deleting it from the info cache
Nov 02 17:48:57 user nova-compute[74980]: DEBUG nova.network.neutron [req-c75cd782-8d02-4de9-9b1f-90358fde3e14 req-512ad94e-c076-457f-aa18-21ba15ccb030 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:48:57 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Took 0.50 seconds to deallocate network for instance.
Nov 02 17:48:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-c75cd782-8d02-4de9-9b1f-90358fde3e14 req-512ad94e-c076-457f-aa18-21ba15ccb030 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Detach interface failed, port_id=ae57bdb2-dfca-46be-bc84-9ea10a5634ad, reason: Instance 91bccf34-87a9-48f3-bbc7-4a70b9753036 could not be found. {{(pid=74980) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 17:48:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:48:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:48:57 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:48:57 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:48:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:48:57 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Deleted allocations for instance 91bccf34-87a9-48f3-bbc7-4a70b9753036
Nov 02 17:48:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5731dc37-f309-44e3-a2bc-89908f715d76 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.808s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] No waiting events found dispatching network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:48:58 user nova-compute[74980]: WARNING nova.compute.manager [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received unexpected event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad for instance with vm_state deleted and task_state None.
Nov 02 17:48:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] No waiting events found dispatching network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:48:58 user nova-compute[74980]: WARNING nova.compute.manager [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received unexpected event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad for instance with vm_state deleted and task_state None.
Nov 02 17:48:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] No waiting events found dispatching network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:48:58 user nova-compute[74980]: WARNING nova.compute.manager [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received unexpected event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad for instance with vm_state deleted and task_state None.
Nov 02 17:48:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received event network-vif-unplugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] No waiting events found dispatching network-vif-unplugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:48:58 user nova-compute[74980]: WARNING nova.compute.manager [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received unexpected event network-vif-unplugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad for instance with vm_state deleted and task_state None.
Nov 02 17:48:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] Acquiring lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] Lock "91bccf34-87a9-48f3-bbc7-4a70b9753036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:48:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] No waiting events found dispatching network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:48:58 user nova-compute[74980]: WARNING nova.compute.manager [req-7e372fa1-5ee5-4897-ab6b-5ac954334572 req-2a395601-58ee-4591-8247-5008d1e27c06 service nova] [instance: 91bccf34-87a9-48f3-bbc7-4a70b9753036] Received unexpected event network-vif-plugged-ae57bdb2-dfca-46be-bc84-9ea10a5634ad for instance with vm_state deleted and task_state None.
Nov 02 17:49:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "b219f919-44a8-49d1-9b20-36bbb1056120" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "b219f919-44a8-49d1-9b20-36bbb1056120" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:49:10 user nova-compute[74980]: INFO nova.compute.claims [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Claim successful on node user
Nov 02 17:49:10 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG nova.network.neutron [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:49:10 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:49:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG nova.policy [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fef01429fb294195984431fd3699f78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11e1bb23618243ddb099bc6855aa2f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:49:10 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Creating image(s)
Nov 02 17:49:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "/opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "/opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "/opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:49:10 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.167s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk 1073741824" returned: 0 in 0.046s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.221s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Successfully created port: 00f75489-496c-4666-a645-0dacdcadcc02 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Cannot resize image /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Ensure instance console log exists: /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:49:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.network.neutron [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Successfully updated port: 00f75489-496c-4666-a645-0dacdcadcc02 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "refresh_cache-b219f919-44a8-49d1-9b20-36bbb1056120" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquired lock "refresh_cache-b219f919-44a8-49d1-9b20-36bbb1056120" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.network.neutron [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.network.neutron [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.compute.manager [req-697ecfe4-475d-4c63-a0fb-75b23c6b4da2 req-572110f5-33cd-4aaa-97a0-b927af7b2f25 service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Received event network-changed-00f75489-496c-4666-a645-0dacdcadcc02 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.compute.manager [req-697ecfe4-475d-4c63-a0fb-75b23c6b4da2 req-572110f5-33cd-4aaa-97a0-b927af7b2f25 service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Refreshing instance network info cache due to event network-changed-00f75489-496c-4666-a645-0dacdcadcc02. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-697ecfe4-475d-4c63-a0fb-75b23c6b4da2 req-572110f5-33cd-4aaa-97a0-b927af7b2f25 service nova] Acquiring lock "refresh_cache-b219f919-44a8-49d1-9b20-36bbb1056120" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.network.neutron [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Updating instance_info_cache with network_info: [{"id": "00f75489-496c-4666-a645-0dacdcadcc02", "address": "fa:16:3e:cc:e6:cc", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f75489-49", "ovs_interfaceid": "00f75489-496c-4666-a645-0dacdcadcc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Releasing lock "refresh_cache-b219f919-44a8-49d1-9b20-36bbb1056120" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.compute.manager [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Instance network_info: |[{"id": "00f75489-496c-4666-a645-0dacdcadcc02", "address": "fa:16:3e:cc:e6:cc", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f75489-49", "ovs_interfaceid": "00f75489-496c-4666-a645-0dacdcadcc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-697ecfe4-475d-4c63-a0fb-75b23c6b4da2 req-572110f5-33cd-4aaa-97a0-b927af7b2f25 service nova] Acquired lock "refresh_cache-b219f919-44a8-49d1-9b20-36bbb1056120" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.network.neutron [req-697ecfe4-475d-4c63-a0fb-75b23c6b4da2 req-572110f5-33cd-4aaa-97a0-b927af7b2f25 service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Refreshing network info cache for port 00f75489-496c-4666-a645-0dacdcadcc02 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Start _get_guest_xml network_info=[{"id": "00f75489-496c-4666-a645-0dacdcadcc02", "address": "fa:16:3e:cc:e6:cc", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f75489-49", "ovs_interfaceid": "00f75489-496c-4666-a645-0dacdcadcc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:49:12 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:49:12 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1441054969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1441054969',id=41,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11e1bb23618243ddb099bc6855aa2f64',ramdisk_id='',reservation_id='r-yoioigui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-36491096',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:49:11Z,user_data=None,user_id='fef01429fb294195984431fd3699f78b',uuid=b219f919-44a8-49d1-9b20-36bbb1056120,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00f75489-496c-4666-a645-0dacdcadcc02", "address": "fa:16:3e:cc:e6:cc", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f75489-49", "ovs_interfaceid": "00f75489-496c-4666-a645-0dacdcadcc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converting VIF {"id": "00f75489-496c-4666-a645-0dacdcadcc02", "address": "fa:16:3e:cc:e6:cc", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f75489-49", "ovs_interfaceid": "00f75489-496c-4666-a645-0dacdcadcc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e6:cc,bridge_name='br-int',has_traffic_filtering=True,id=00f75489-496c-4666-a645-0dacdcadcc02,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00f75489-49') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.objects.instance [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'pci_devices' on Instance uuid b219f919-44a8-49d1-9b20-36bbb1056120 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:49:12 user nova-compute[74980]:   <uuid>b219f919-44a8-49d1-9b20-36bbb1056120</uuid>
Nov 02 17:49:12 user nova-compute[74980]:   <name>instance-00000029</name>
Nov 02 17:49:12 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:49:12 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:49:12 user nova-compute[74980]:   <metadata>
Nov 02 17:49:12 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:49:12 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:49:12 user nova-compute[74980]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1441054969</nova:name>
Nov 02 17:49:12 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:49:12</nova:creationTime>
Nov 02 17:49:12 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:49:12 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:49:12 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:49:12 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:49:12 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:49:12 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:49:12 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:49:12 user nova-compute[74980]:       <nova:owner>
Nov 02 17:49:12 user nova-compute[74980]:         <nova:user uuid="fef01429fb294195984431fd3699f78b">tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member</nova:user>
Nov 02 17:49:12 user nova-compute[74980]:         <nova:project uuid="11e1bb23618243ddb099bc6855aa2f64">tempest-ServerBootFromVolumeStableRescueTest-36491096</nova:project>
Nov 02 17:49:12 user nova-compute[74980]:       </nova:owner>
Nov 02 17:49:12 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:49:12 user nova-compute[74980]:       <nova:ports>
Nov 02 17:49:12 user nova-compute[74980]:         <nova:port uuid="00f75489-496c-4666-a645-0dacdcadcc02">
Nov 02 17:49:12 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 17:49:12 user nova-compute[74980]:         </nova:port>
Nov 02 17:49:12 user nova-compute[74980]:       </nova:ports>
Nov 02 17:49:12 user nova-compute[74980]:     </nova:instance>
Nov 02 17:49:12 user nova-compute[74980]:   </metadata>
Nov 02 17:49:12 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:49:12 user nova-compute[74980]:     <system>
Nov 02 17:49:12 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:49:12 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:49:12 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:49:12 user nova-compute[74980]:       <entry name="serial">b219f919-44a8-49d1-9b20-36bbb1056120</entry>
Nov 02 17:49:12 user nova-compute[74980]:       <entry name="uuid">b219f919-44a8-49d1-9b20-36bbb1056120</entry>
Nov 02 17:49:12 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:49:12 user nova-compute[74980]:     </system>
Nov 02 17:49:12 user nova-compute[74980]:   </sysinfo>
Nov 02 17:49:12 user nova-compute[74980]:   <os>
Nov 02 17:49:12 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:49:12 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:49:12 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:49:12 user nova-compute[74980]:   </os>
Nov 02 17:49:12 user nova-compute[74980]:   <features>
Nov 02 17:49:12 user nova-compute[74980]:     <acpi/>
Nov 02 17:49:12 user nova-compute[74980]:     <apic/>
Nov 02 17:49:12 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:49:12 user nova-compute[74980]:   </features>
Nov 02 17:49:12 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:49:12 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:49:12 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:49:12 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:49:12 user nova-compute[74980]:   </clock>
Nov 02 17:49:12 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:49:12 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:49:12 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:49:12 user nova-compute[74980]:   </cpu>
Nov 02 17:49:12 user nova-compute[74980]:   <devices>
Nov 02 17:49:12 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:49:12 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:49:12 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk"/>
Nov 02 17:49:12 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:49:12 user nova-compute[74980]:     </disk>
Nov 02 17:49:12 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:49:12 user nova-compute[74980]:       <mac address="fa:16:3e:cc:e6:cc"/>
Nov 02 17:49:12 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:49:12 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:49:12 user nova-compute[74980]:       <target dev="tap00f75489-49"/>
Nov 02 17:49:12 user nova-compute[74980]:     </interface>
Nov 02 17:49:12 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:49:12 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/console.log" append="off"/>
Nov 02 17:49:12 user nova-compute[74980]:     </serial>
Nov 02 17:49:12 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:49:12 user nova-compute[74980]:     <video>
Nov 02 17:49:12 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:49:12 user nova-compute[74980]:     </video>
Nov 02 17:49:12 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:49:12 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:49:12 user nova-compute[74980]:     </rng>
Nov 02 17:49:12 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:49:12 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:49:12 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:49:12 user nova-compute[74980]:     </memballoon>
Nov 02 17:49:12 user nova-compute[74980]:   </devices>
Nov 02 17:49:12 user nova-compute[74980]: </domain>
Nov 02 17:49:12 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1441054969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1441054969',id=41,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11e1bb23618243ddb099bc6855aa2f64',ramdisk_id='',reservation_id='r-yoioigui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-36491096',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:49:11Z,user_data=None,user_id='fef01429fb294195984431fd3699f78b',uuid=b219f919-44a8-49d1-9b20-36bbb1056120,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00f75489-496c-4666-a645-0dacdcadcc02", "address": "fa:16:3e:cc:e6:cc", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f75489-49", "ovs_interfaceid": "00f75489-496c-4666-a645-0dacdcadcc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converting VIF {"id": "00f75489-496c-4666-a645-0dacdcadcc02", "address": "fa:16:3e:cc:e6:cc", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f75489-49", "ovs_interfaceid": "00f75489-496c-4666-a645-0dacdcadcc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e6:cc,bridge_name='br-int',has_traffic_filtering=True,id=00f75489-496c-4666-a645-0dacdcadcc02,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00f75489-49') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG os_vif [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e6:cc,bridge_name='br-int',has_traffic_filtering=True,id=00f75489-496c-4666-a645-0dacdcadcc02,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00f75489-49') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb70f8c5-d73d-577f-969b-7c3f12550535', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00f75489-49, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00f75489-49, col_values=(('qos', UUID('5478bfa5-3fd8-4e82-a646-0feaca60f0df')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00f75489-49, col_values=(('external_ids', {'iface-id': '00f75489-496c-4666-a645-0dacdcadcc02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:e6:cc', 'vm-uuid': 'b219f919-44a8-49d1-9b20-36bbb1056120'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:12 user nova-compute[74980]: INFO os_vif [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e6:cc,bridge_name='br-int',has_traffic_filtering=True,id=00f75489-496c-4666-a645-0dacdcadcc02,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00f75489-49')
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:49:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] No VIF found with MAC fa:16:3e:cc:e6:cc, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:49:13 user nova-compute[74980]: DEBUG nova.network.neutron [req-697ecfe4-475d-4c63-a0fb-75b23c6b4da2 req-572110f5-33cd-4aaa-97a0-b927af7b2f25 service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Updated VIF entry in instance network info cache for port 00f75489-496c-4666-a645-0dacdcadcc02. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:49:13 user nova-compute[74980]: DEBUG nova.network.neutron [req-697ecfe4-475d-4c63-a0fb-75b23c6b4da2 req-572110f5-33cd-4aaa-97a0-b927af7b2f25 service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Updating instance_info_cache with network_info: [{"id": "00f75489-496c-4666-a645-0dacdcadcc02", "address": "fa:16:3e:cc:e6:cc", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f75489-49", "ovs_interfaceid": "00f75489-496c-4666-a645-0dacdcadcc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:49:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-697ecfe4-475d-4c63-a0fb-75b23c6b4da2 req-572110f5-33cd-4aaa-97a0-b927af7b2f25 service nova] Releasing lock "refresh_cache-b219f919-44a8-49d1-9b20-36bbb1056120" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:49:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-fd77e290-1258-4c73-865c-a694435cf23b req-9534fb7c-617a-47ad-b10d-24e2ff7f526a service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Received event network-vif-plugged-00f75489-496c-4666-a645-0dacdcadcc02 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:49:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fd77e290-1258-4c73-865c-a694435cf23b req-9534fb7c-617a-47ad-b10d-24e2ff7f526a service nova] Acquiring lock "b219f919-44a8-49d1-9b20-36bbb1056120-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fd77e290-1258-4c73-865c-a694435cf23b req-9534fb7c-617a-47ad-b10d-24e2ff7f526a service nova] Lock "b219f919-44a8-49d1-9b20-36bbb1056120-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:49:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fd77e290-1258-4c73-865c-a694435cf23b req-9534fb7c-617a-47ad-b10d-24e2ff7f526a service nova] Lock "b219f919-44a8-49d1-9b20-36bbb1056120-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:49:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-fd77e290-1258-4c73-865c-a694435cf23b req-9534fb7c-617a-47ad-b10d-24e2ff7f526a service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] No waiting events found dispatching network-vif-plugged-00f75489-496c-4666-a645-0dacdcadcc02 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:49:14 user nova-compute[74980]: WARNING nova.compute.manager [req-fd77e290-1258-4c73-865c-a694435cf23b req-9534fb7c-617a-47ad-b10d-24e2ff7f526a service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Received unexpected event network-vif-plugged-00f75489-496c-4666-a645-0dacdcadcc02 for instance with vm_state building and task_state spawning.
Nov 02 17:49:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:16 user nova-compute[74980]: DEBUG nova.compute.manager [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:49:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:49:16 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Instance spawned successfully.
Nov 02 17:49:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:49:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:49:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:49:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:49:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:49:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:49:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:49:16 user nova-compute[74980]: INFO nova.compute.manager [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 02 17:49:16 user nova-compute[74980]: DEBUG nova.compute.manager [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:49:16 user nova-compute[74980]: INFO nova.compute.manager [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Took 6.07 seconds to build instance.
Nov 02 17:49:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-662821d3-9ef4-4243-a35a-f2405ec5150b tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "b219f919-44a8-49d1-9b20-36bbb1056120" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.184s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:49:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-b33e3fef-611a-4008-af62-893490c2adc8 req-e6365887-a96d-4c7e-ba75-dff895a9e0e1 service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Received event network-vif-plugged-00f75489-496c-4666-a645-0dacdcadcc02 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:49:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b33e3fef-611a-4008-af62-893490c2adc8 req-e6365887-a96d-4c7e-ba75-dff895a9e0e1 service nova] Acquiring lock "b219f919-44a8-49d1-9b20-36bbb1056120-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b33e3fef-611a-4008-af62-893490c2adc8 req-e6365887-a96d-4c7e-ba75-dff895a9e0e1 service nova] Lock "b219f919-44a8-49d1-9b20-36bbb1056120-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:49:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b33e3fef-611a-4008-af62-893490c2adc8 req-e6365887-a96d-4c7e-ba75-dff895a9e0e1 service nova] Lock "b219f919-44a8-49d1-9b20-36bbb1056120-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:49:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-b33e3fef-611a-4008-af62-893490c2adc8 req-e6365887-a96d-4c7e-ba75-dff895a9e0e1 service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] No waiting events found dispatching network-vif-plugged-00f75489-496c-4666-a645-0dacdcadcc02 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:49:16 user nova-compute[74980]: WARNING nova.compute.manager [req-b33e3fef-611a-4008-af62-893490c2adc8 req-e6365887-a96d-4c7e-ba75-dff895a9e0e1 service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Received unexpected event network-vif-plugged-00f75489-496c-4666-a645-0dacdcadcc02 for instance with vm_state active and task_state None.
Nov 02 17:49:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:22 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:49:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:49:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:49:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:49:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:49:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:24 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:49:24 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:49:27 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:49:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:49:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:49:27 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:49:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:49:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:49:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:49:27 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:49:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:49:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:49:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:49:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:49:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:49:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:49:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:49:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:49:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:49:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:49:28 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:49:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:49:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:49:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:49:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:49:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:49:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:49:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:49:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:49:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:49:30 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:49:30 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:49:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8351MB free_disk=24.966205596923828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:49:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:49:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c6bfac8f-3834-4514-9a56-59c293ced966 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:49:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:49:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:49:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cfef8d27-a749-4469-912b-b272c0080f03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:49:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance f1b27aad-a580-43f3-861a-f150568a374f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:49:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance b219f919-44a8-49d1-9b20-36bbb1056120 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:49:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:49:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:49:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:30 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:49:30 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:49:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:49:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:49:31 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:49:31 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:49:31 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:49:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:34 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:49:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:37 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:49:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:38 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:49:38 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:49:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:49:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:49:38 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:49:39 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Updating instance_info_cache with network_info: [{"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:49:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:49:39 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:49:40 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:49:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "f1b27aad-a580-43f3-861a-f150568a374f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "f1b27aad-a580-43f3-861a-f150568a374f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:49:42 user nova-compute[74980]: INFO nova.compute.manager [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Detaching volume 6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2
Nov 02 17:49:42 user nova-compute[74980]: INFO nova.virt.block_device [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Attempting to driver detach volume 6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 from mountpoint /dev/vdb
Nov 02 17:49:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Attempting to detach device vdb from instance f1b27aad-a580-43f3-861a-f150568a374f from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:49:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:49:42 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:49:42 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:49:42 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:49:42 user nova-compute[74980]:   <serial>6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2</serial>
Nov 02 17:49:42 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:49:42 user nova-compute[74980]: </disk>
Nov 02 17:49:42 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:49:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "f1b27aad-a580-43f3-861a-f150568a374f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:43 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Successfully detached device vdb from instance f1b27aad-a580-43f3-861a-f150568a374f from the persistent domain config.
Nov 02 17:49:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1b27aad-a580-43f3-861a-f150568a374f from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:49:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:49:43 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:49:43 user nova-compute[74980]:   <source dev="/dev/sdc"/>
Nov 02 17:49:43 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:49:43 user nova-compute[74980]:   <serial>6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2</serial>
Nov 02 17:49:43 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:49:43 user nova-compute[74980]: </disk>
Nov 02 17:49:43 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:49:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1b27aad-a580-43f3-861a-f150568a374f {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:49:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "c6bfac8f-3834-4514-9a56-59c293ced966" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:49:46 user nova-compute[74980]: INFO nova.compute.manager [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Terminating instance
Nov 02 17:49:46 user nova-compute[74980]: DEBUG nova.compute.manager [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-e7e83600-e35c-40ab-a87f-015e9268e97c req-bbe3818f-1245-499b-9c9b-552f3881b066 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received event network-vif-unplugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e7e83600-e35c-40ab-a87f-015e9268e97c req-bbe3818f-1245-499b-9c9b-552f3881b066 service nova] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e7e83600-e35c-40ab-a87f-015e9268e97c req-bbe3818f-1245-499b-9c9b-552f3881b066 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e7e83600-e35c-40ab-a87f-015e9268e97c req-bbe3818f-1245-499b-9c9b-552f3881b066 service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-e7e83600-e35c-40ab-a87f-015e9268e97c req-bbe3818f-1245-499b-9c9b-552f3881b066 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] No waiting events found dispatching network-vif-unplugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-e7e83600-e35c-40ab-a87f-015e9268e97c req-bbe3818f-1245-499b-9c9b-552f3881b066 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received event network-vif-unplugged-d882437d-9ae3-4508-8a6d-6429e692c104 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:49:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:47 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Instance destroyed successfully.
Nov 02 17:49:47 user nova-compute[74980]: DEBUG nova.objects.instance [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lazy-loading 'resources' on Instance uuid c6bfac8f-3834-4514-9a56-59c293ced966 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-376242262',display_name='tempest-ServerRescueNegativeTestJSON-server-376242262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-376242262',id=27,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:37:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc26ef1932f1408c860b3b9edb4925a4',ramdisk_id='',reservation_id='r-904k0hob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-86632079',owner_user_name='tempest-ServerRescueNegativeTestJSON-86632079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:39:01Z,user_data=None,user_id='985386b6880e4b07bdad162c7860d7a3',uuid=c6bfac8f-3834-4514-9a56-59c293ced966,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converting VIF {"id": "d882437d-9ae3-4508-8a6d-6429e692c104", "address": "fa:16:3e:11:18:6e", "network": {"id": "5fe269d9-1150-4713-b8c0-74fa222accd3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1794582454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc26ef1932f1408c860b3b9edb4925a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd882437d-9a", "ovs_interfaceid": "d882437d-9ae3-4508-8a6d-6429e692c104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:18:6e,bridge_name='br-int',has_traffic_filtering=True,id=d882437d-9ae3-4508-8a6d-6429e692c104,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd882437d-9a') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG os_vif [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:18:6e,bridge_name='br-int',has_traffic_filtering=True,id=d882437d-9ae3-4508-8a6d-6429e692c104,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd882437d-9a') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd882437d-9a, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51cfd1eb-72e2-453f-85f7-453800c63ecb) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:49:47 user nova-compute[74980]: INFO os_vif [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:18:6e,bridge_name='br-int',has_traffic_filtering=True,id=d882437d-9ae3-4508-8a6d-6429e692c104,network=Network(5fe269d9-1150-4713-b8c0-74fa222accd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd882437d-9a')
Nov 02 17:49:47 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Deleting instance files /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966_del
Nov 02 17:49:47 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Deletion of /opt/stack/data/nova/instances/c6bfac8f-3834-4514-9a56-59c293ced966_del complete
Nov 02 17:49:47 user nova-compute[74980]: INFO nova.compute.manager [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 02 17:49:47 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:49:47 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Took 0.42 seconds to deallocate network for instance.
Nov 02 17:49:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-f7500ee6-dced-47eb-83c8-5ba8ccfa20ac req-926076f1-6af8-4eca-bbdd-aa28350b37a2 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received event network-vif-deleted-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:49:47 user nova-compute[74980]: INFO nova.compute.manager [req-f7500ee6-dced-47eb-83c8-5ba8ccfa20ac req-926076f1-6af8-4eca-bbdd-aa28350b37a2 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Neutron deleted interface d882437d-9ae3-4508-8a6d-6429e692c104; detaching it from the instance and deleting it from the info cache
Nov 02 17:49:47 user nova-compute[74980]: DEBUG nova.network.neutron [req-f7500ee6-dced-47eb-83c8-5ba8ccfa20ac req-926076f1-6af8-4eca-bbdd-aa28350b37a2 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-f7500ee6-dced-47eb-83c8-5ba8ccfa20ac req-926076f1-6af8-4eca-bbdd-aa28350b37a2 service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Detach interface failed, port_id=d882437d-9ae3-4508-8a6d-6429e692c104, reason: Instance c6bfac8f-3834-4514-9a56-59c293ced966 could not be found. {{(pid=74980) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:49:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:49:47 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Deleted allocations for instance c6bfac8f-3834-4514-9a56-59c293ced966
Nov 02 17:49:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-8a6768f1-bcab-471c-8180-f7f406fd2465 tempest-ServerRescueNegativeTestJSON-86632079 tempest-ServerRescueNegativeTestJSON-86632079-project-member] Lock "c6bfac8f-3834-4514-9a56-59c293ced966" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.447s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:49:48 user nova-compute[74980]: DEBUG nova.compute.manager [req-bbe1fe29-856b-4102-8aa5-2cbc2dc4d7f2 req-07048f1e-2617-464c-ab19-fa1647fc2c9c service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:49:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bbe1fe29-856b-4102-8aa5-2cbc2dc4d7f2 req-07048f1e-2617-464c-ab19-fa1647fc2c9c service nova] Acquiring lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:49:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bbe1fe29-856b-4102-8aa5-2cbc2dc4d7f2 req-07048f1e-2617-464c-ab19-fa1647fc2c9c service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:49:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bbe1fe29-856b-4102-8aa5-2cbc2dc4d7f2 req-07048f1e-2617-464c-ab19-fa1647fc2c9c service nova] Lock "c6bfac8f-3834-4514-9a56-59c293ced966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:49:48 user nova-compute[74980]: DEBUG nova.compute.manager [req-bbe1fe29-856b-4102-8aa5-2cbc2dc4d7f2 req-07048f1e-2617-464c-ab19-fa1647fc2c9c service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] No waiting events found dispatching network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:49:48 user nova-compute[74980]: WARNING nova.compute.manager [req-bbe1fe29-856b-4102-8aa5-2cbc2dc4d7f2 req-07048f1e-2617-464c-ab19-fa1647fc2c9c service nova] [instance: c6bfac8f-3834-4514-9a56-59c293ced966] Received unexpected event network-vif-plugged-d882437d-9ae3-4508-8a6d-6429e692c104 for instance with vm_state deleted and task_state None.
Nov 02 17:49:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:49:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:49:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:49:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:49:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:49:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:50:03 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f1b27aad-a580-43f3-861a-f150568a374f is timed out.
Nov 02 17:50:03 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Successfully detached device vdb from instance f1b27aad-a580-43f3-861a-f150568a374f from the live domain config.
Nov 02 17:50:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWjHTnLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:50:03 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b23e124-e336-4ebd-96c9-12d935ff2d02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:50:03 user nova-compute[74980]: No targets found.
Nov 02 17:50:03 user nova-compute[74980]: iSNS:
Nov 02 17:50:03 user nova-compute[74980]: No targets found.
Nov 02 17:50:03 user nova-compute[74980]: STATIC:
Nov 02 17:50:03 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187
Nov 02 17:50:03 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:50:03 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:50:03 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19
Nov 02 17:50:03 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:50:03 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:50:03 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2
Nov 02 17:50:03 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:50:03 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:50:03 user nova-compute[74980]: FIRMWARE:
Nov 02 17:50:03 user nova-compute[74980]: No targets found.
Nov 02 17:50:03 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:50:03 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:50:03 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5a1ba4-d873-4ae0-b52b-98dfe2362a5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[303fa733-7ed8-4fa0-ab13-2effd88b41b2]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:50:03 user nova-compute[74980]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:50:03 user nova-compute[74980]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 (non-flash)
Nov 02 17:50:03 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:50:03 user nova-compute[74980]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:50:03 user nova-compute[74980]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 (non-flash)
Nov 02 17:50:03 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b46ae440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2'): ({'sdc'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Removing single pathed devices sdc {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[798324eb-caf6-404e-85da-783637662f0a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a31331b-03be-48d0-925e-624a6e1b5ca3]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Flushing IO for device /dev/sdc {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ff8e74-25cd-4000-8830-49593c2959cc]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[70308bc5-0205-40eb-a8e2-e738d36db4b2]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6a783f-a449-41fc-b2e6-2500abef01f7]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1384a426-2bff-41ed-a850-c7e0c91da0b6]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2, portal: 172.16.0.220,3260]
Nov 02 17:50:03 user nova-compute[74980]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2, portal: 172.16.0.220,3260] successful.
Nov 02 17:50:03 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff6f200-2211-448a-a806-78384198a647]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] <== disconnect_volume: return (302ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:50:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lazy-loading 'flavor' on Instance uuid f1b27aad-a580-43f3-861a-f150568a374f {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b756cee8-990c-4289-b53e-57672178ae3b tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "f1b27aad-a580-43f3-861a-f150568a374f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.773s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "f1b27aad-a580-43f3-861a-f150568a374f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.654s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "f1b27aad-a580-43f3-861a-f150568a374f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:04 user nova-compute[74980]: INFO nova.compute.manager [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Terminating instance
Nov 02 17:50:04 user nova-compute[74980]: DEBUG nova.compute.manager [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-6e5ef23e-58e8-4d02-9973-ffb57acf6338 req-590ac9dd-6aea-4eb5-a74f-914a13c50775 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received event network-vif-unplugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6e5ef23e-58e8-4d02-9973-ffb57acf6338 req-590ac9dd-6aea-4eb5-a74f-914a13c50775 service nova] Acquiring lock "f1b27aad-a580-43f3-861a-f150568a374f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6e5ef23e-58e8-4d02-9973-ffb57acf6338 req-590ac9dd-6aea-4eb5-a74f-914a13c50775 service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6e5ef23e-58e8-4d02-9973-ffb57acf6338 req-590ac9dd-6aea-4eb5-a74f-914a13c50775 service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-6e5ef23e-58e8-4d02-9973-ffb57acf6338 req-590ac9dd-6aea-4eb5-a74f-914a13c50775 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] No waiting events found dispatching network-vif-unplugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:50:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-6e5ef23e-58e8-4d02-9973-ffb57acf6338 req-590ac9dd-6aea-4eb5-a74f-914a13c50775 service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received event network-vif-unplugged-1aaaeff5-679d-4ca7-a20a-05583353b82f for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:05 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Instance destroyed successfully.
Nov 02 17:50:05 user nova-compute[74980]: DEBUG nova.objects.instance [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lazy-loading 'resources' on Instance uuid f1b27aad-a580-43f3-861a-f150568a374f {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:46:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-723361033',display_name='tempest-VolumesSnapshotTestJSON-instance-723361033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-723361033',id=40,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgH9OLL5kDaxn7g1ZgtIieyLlOxVH1VwkwiiycLzAPg68uhPSsyBHnSgBYTnwxJZ/18i5fEb3H9mu9OlJ1L08Frt5eRAiRi4H5IYryZzyT0s+iq/7WbVi98QsJ59WDXuA==',key_name='tempest-keypair-1999104492',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:46:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8acec542cb1462996e6545c6f350e9f',ramdisk_id='',reservation_id='r-4tkc20u4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2140770747',owner_user_name='tempest-VolumesSnapshotTestJSON-2140770747-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:46:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d183edfc18ad4a6f91bff1e33db290c8',uuid=f1b27aad-a580-43f3-861a-f150568a374f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "address": "fa:16:3e:8f:25:bc", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaaeff5-67", "ovs_interfaceid": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Converting VIF {"id": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "address": "fa:16:3e:8f:25:bc", "network": {"id": "61d9ee24-0604-4a72-aebc-ff80ff1f35c1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1795946475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8acec542cb1462996e6545c6f350e9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aaaeff5-67", "ovs_interfaceid": "1aaaeff5-679d-4ca7-a20a-05583353b82f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:25:bc,bridge_name='br-int',has_traffic_filtering=True,id=1aaaeff5-679d-4ca7-a20a-05583353b82f,network=Network(61d9ee24-0604-4a72-aebc-ff80ff1f35c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaaeff5-67') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG os_vif [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:25:bc,bridge_name='br-int',has_traffic_filtering=True,id=1aaaeff5-679d-4ca7-a20a-05583353b82f,network=Network(61d9ee24-0604-4a72-aebc-ff80ff1f35c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaaeff5-67') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aaaeff5-67, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88a61425-97f1-49a7-9b58-64fd7b06131d) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:05 user nova-compute[74980]: INFO os_vif [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:25:bc,bridge_name='br-int',has_traffic_filtering=True,id=1aaaeff5-679d-4ca7-a20a-05583353b82f,network=Network(61d9ee24-0604-4a72-aebc-ff80ff1f35c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aaaeff5-67')
Nov 02 17:50:05 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWjHTnLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:50:05 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:50:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dd26cb-818d-4d3b-ac8f-abe4fce5ddbe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:50:05 user nova-compute[74980]: No targets found.
Nov 02 17:50:05 user nova-compute[74980]: iSNS:
Nov 02 17:50:05 user nova-compute[74980]: No targets found.
Nov 02 17:50:05 user nova-compute[74980]: STATIC:
Nov 02 17:50:05 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187
Nov 02 17:50:05 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:50:05 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:50:05 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19
Nov 02 17:50:05 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:50:05 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:50:05 user nova-compute[74980]: FIRMWARE:
Nov 02 17:50:05 user nova-compute[74980]: No targets found.
Nov 02 17:50:05 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:50:05 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:50:05 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cfcfc4c-fa3b-4f0a-86dd-55429592bbc2', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[111eb697-09d5-47e3-8917-78cfba44ff62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d13938-f89b-434f-9344-c0642b042b4d]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:50:05 user nova-compute[74980]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:50:05 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:50:05 user nova-compute[74980]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:50:05 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b4444550>, {}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Disconnecting from: [] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] <== disconnect_volume: return (83ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:50:05 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Deleting instance files /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f_del
Nov 02 17:50:05 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Deletion of /opt/stack/data/nova/instances/f1b27aad-a580-43f3-861a-f150568a374f_del complete
Nov 02 17:50:05 user nova-compute[74980]: INFO nova.compute.manager [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 02 17:50:05 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:50:05 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: f1b27aad-a580-43f3-861a-f150568a374f] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received event network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] Acquiring lock "f1b27aad-a580-43f3-861a-f150568a374f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] No waiting events found dispatching network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:50:06 user nova-compute[74980]: WARNING nova.compute.manager [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received unexpected event network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f for instance with vm_state active and task_state deleting.
Nov 02 17:50:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received event network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] Acquiring lock "f1b27aad-a580-43f3-861a-f150568a374f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] No waiting events found dispatching network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:50:06 user nova-compute[74980]: WARNING nova.compute.manager [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received unexpected event network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f for instance with vm_state active and task_state deleting.
Nov 02 17:50:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received event network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] Acquiring lock "f1b27aad-a580-43f3-861a-f150568a374f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] No waiting events found dispatching network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:50:06 user nova-compute[74980]: WARNING nova.compute.manager [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received unexpected event network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f for instance with vm_state active and task_state deleting.
Nov 02 17:50:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received event network-vif-unplugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] Acquiring lock "f1b27aad-a580-43f3-861a-f150568a374f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] No waiting events found dispatching network-vif-unplugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received event network-vif-unplugged-1aaaeff5-679d-4ca7-a20a-05583353b82f for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received event network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] Acquiring lock "f1b27aad-a580-43f3-861a-f150568a374f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] Lock "f1b27aad-a580-43f3-861a-f150568a374f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] No waiting events found dispatching network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:50:06 user nova-compute[74980]: WARNING nova.compute.manager [req-d96867ab-7c0f-4f4b-b3fb-b9eaf9f83d16 req-9561331d-d36b-4c5c-ba25-70ec4a8a5b4c service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received unexpected event network-vif-plugged-1aaaeff5-679d-4ca7-a20a-05583353b82f for instance with vm_state active and task_state deleting.
Nov 02 17:50:07 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:50:07 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Took 1.28 seconds to deallocate network for instance.
Nov 02 17:50:07 user nova-compute[74980]: WARNING nova.volume.cinder [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Attachment ac953fcf-f05e-4317-bfb4-d959b258e9ab does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ac953fcf-f05e-4317-bfb4-d959b258e9ab. (HTTP 404) (Request-ID: req-a6971a6d-81d9-41fc-a575-b7c345d056b2)
Nov 02 17:50:07 user nova-compute[74980]: INFO nova.compute.manager [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Took 0.03 seconds to detach 1 volumes for instance.
Nov 02 17:50:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:50:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:50:07 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:50:07 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:50:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:07 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Deleted allocations for instance f1b27aad-a580-43f3-861a-f150568a374f
Nov 02 17:50:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d55c7ee-fe02-4595-92b1-4dfa7992dc97 tempest-VolumesSnapshotTestJSON-2140770747 tempest-VolumesSnapshotTestJSON-2140770747-project-member] Lock "f1b27aad-a580-43f3-861a-f150568a374f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.837s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-a456f1db-45e6-46e0-96e2-2da7da0e1037 req-10b60d32-2a7a-44dd-bec8-41b18d852b4b service nova] [instance: f1b27aad-a580-43f3-861a-f150568a374f] Received event network-vif-deleted-1aaaeff5-679d-4ca7-a20a-05583353b82f {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:50:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:50:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:50:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:50:23 user nova-compute[74980]: INFO nova.compute.manager [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Detaching volume 028d2745-e096-4c65-873a-63cee4135d19
Nov 02 17:50:23 user nova-compute[74980]: INFO nova.virt.block_device [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Attempting to driver detach volume 028d2745-e096-4c65-873a-63cee4135d19 from mountpoint /dev/vdb
Nov 02 17:50:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Attempting to detach device vdb from instance cfef8d27-a749-4469-912b-b272c0080f03 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:50:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:50:23 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:50:23 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:50:23 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:50:23 user nova-compute[74980]:   <serial>028d2745-e096-4c65-873a-63cee4135d19</serial>
Nov 02 17:50:23 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 17:50:23 user nova-compute[74980]: </disk>
Nov 02 17:50:23 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:50:23 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Successfully detached device vdb from instance cfef8d27-a749-4469-912b-b272c0080f03 from the persistent domain config.
Nov 02 17:50:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cfef8d27-a749-4469-912b-b272c0080f03 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:50:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:50:23 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:50:23 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:50:23 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:50:23 user nova-compute[74980]:   <serial>028d2745-e096-4c65-873a-63cee4135d19</serial>
Nov 02 17:50:23 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 17:50:23 user nova-compute[74980]: </disk>
Nov 02 17:50:23 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:50:23 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:50:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:50:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:25 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:50:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:26 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:50:29 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:50:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:50:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:50:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:29 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:50:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:50:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:50:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:31 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:50:31 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:50:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8571MB free_disk=24.993270874023438GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:50:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:50:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:50:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:50:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:50:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cfef8d27-a749-4469-912b-b272c0080f03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:50:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance b219f919-44a8-49d1-9b20-36bbb1056120 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:50:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:50:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:50:31 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:50:31 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:50:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:50:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:32 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:50:32 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:50:32 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:50:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:36 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:50:37 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:50:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:40 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:50:40 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:50:40 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 17:50:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:50:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:50:40 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:50:40 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid a1f33052-902f-44ef-b758-67cfc144416c {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:50:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:41 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Updating instance_info_cache with network_info: [{"id": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "address": "fa:16:3e:7c:b8:1b", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6fd444-02", "ovs_interfaceid": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:50:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:50:41 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:50:43 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cfef8d27-a749-4469-912b-b272c0080f03 is timed out.
Nov 02 17:50:43 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Successfully detached device vdb from instance cfef8d27-a749-4469-912b-b272c0080f03 from the live domain config.
Nov 02 17:50:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IHYjywcV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:50:43 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7622b79b-d4da-4763-b79f-e48c1ab76009]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:50:43 user nova-compute[74980]: No targets found.
Nov 02 17:50:43 user nova-compute[74980]: iSNS:
Nov 02 17:50:43 user nova-compute[74980]: No targets found.
Nov 02 17:50:43 user nova-compute[74980]: STATIC:
Nov 02 17:50:43 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187
Nov 02 17:50:43 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:50:43 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:50:43 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19
Nov 02 17:50:43 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:50:43 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:50:43 user nova-compute[74980]: FIRMWARE:
Nov 02 17:50:43 user nova-compute[74980]: No targets found.
Nov 02 17:50:43 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:50:43 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:50:43 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0baf8a4-16a8-426c-b3b8-23e5886b7129]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2f6221-cb80-4583-b17c-29b5815ad868]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:50:43 user nova-compute[74980]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:50:43 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:50:43 user nova-compute[74980]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 (non-flash)
Nov 02 17:50:43 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5994770280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1720f82e-a2a4-42cd-8b36-91683adc766f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee5746e-cf98-43a1-970d-34d9dd8c3304]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75d9ad5-966d-419f-af32-162bd003b69e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[143d5eca-bcca-48e3-9141-f6198d170a5f]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dbb338-c7b8-458f-8c44-fa2649889adf]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:50:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8591ea3-81dd-4d82-b9fa-aa8c64b0b7fd]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260]
Nov 02 17:50:44 user nova-compute[74980]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19, portal: 172.16.0.220,3260] successful.
Nov 02 17:50:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:50:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:50:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028d2745-e096-4c65-873a-63cee4135d19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:50:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ac8aa9-dabd-4763-84ec-b308939d7149]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:50:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:50:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:50:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] <== disconnect_volume: return (286ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:50:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:50:44 user nova-compute[74980]: DEBUG nova.objects.instance [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'flavor' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:50:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-49834cc4-ffac-4a10-9fe9-42e39ee9e4ce tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.773s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:50:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:50:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:50:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:50:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-47de652f-473f-4df3-9621-e723c3b29514 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:50:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-47de652f-473f-4df3-9621-e723c3b29514 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:50:45 user nova-compute[74980]: DEBUG nova.compute.manager [None req-47de652f-473f-4df3-9621-e723c3b29514 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:50:45 user nova-compute[74980]: DEBUG nova.compute.manager [None req-47de652f-473f-4df3-9621-e723c3b29514 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74980) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 02 17:50:45 user nova-compute[74980]: DEBUG nova.objects.instance [None req-47de652f-473f-4df3-9621-e723c3b29514 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'flavor' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:50:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-84c22762-0be8-4b3e-aaf2-c1fc45e17344 req-6e74703c-d794-4cf9-a46b-fad539763610 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-unplugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:50:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-84c22762-0be8-4b3e-aaf2-c1fc45e17344 req-6e74703c-d794-4cf9-a46b-fad539763610 service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:50:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-84c22762-0be8-4b3e-aaf2-c1fc45e17344 req-6e74703c-d794-4cf9-a46b-fad539763610 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:50:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-84c22762-0be8-4b3e-aaf2-c1fc45e17344 req-6e74703c-d794-4cf9-a46b-fad539763610 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-84c22762-0be8-4b3e-aaf2-c1fc45e17344 req-6e74703c-d794-4cf9-a46b-fad539763610 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-unplugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:50:46 user nova-compute[74980]: WARNING nova.compute.manager [req-84c22762-0be8-4b3e-aaf2-c1fc45e17344 req-6e74703c-d794-4cf9-a46b-fad539763610 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received unexpected event network-vif-unplugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with vm_state active and task_state powering-off.
Nov 02 17:50:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:46 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Instance destroyed successfully.
Nov 02 17:50:46 user nova-compute[74980]: DEBUG nova.compute.manager [None req-47de652f-473f-4df3-9621-e723c3b29514 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:50:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-47de652f-473f-4df3-9621-e723c3b29514 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.833s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:48 user nova-compute[74980]: DEBUG nova.compute.manager [req-9e7eab66-76b8-40ab-a831-da710be10b16 req-c416cc06-4f20-4697-9178-d19d25fedcc0 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:50:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9e7eab66-76b8-40ab-a831-da710be10b16 req-c416cc06-4f20-4697-9178-d19d25fedcc0 service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:50:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9e7eab66-76b8-40ab-a831-da710be10b16 req-c416cc06-4f20-4697-9178-d19d25fedcc0 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:50:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-9e7eab66-76b8-40ab-a831-da710be10b16 req-c416cc06-4f20-4697-9178-d19d25fedcc0 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:50:48 user nova-compute[74980]: DEBUG nova.compute.manager [req-9e7eab66-76b8-40ab-a831-da710be10b16 req-c416cc06-4f20-4697-9178-d19d25fedcc0 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:50:48 user nova-compute[74980]: WARNING nova.compute.manager [req-9e7eab66-76b8-40ab-a831-da710be10b16 req-c416cc06-4f20-4697-9178-d19d25fedcc0 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received unexpected event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with vm_state stopped and task_state None.
Nov 02 17:50:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:50:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:51:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:51:01 user nova-compute[74980]: DEBUG nova.compute.manager [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:51:01 user nova-compute[74980]: INFO nova.compute.manager [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] instance snapshotting
Nov 02 17:51:01 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Beginning live snapshot process
Nov 02 17:51:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json -f qcow2 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:51:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:51:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json -f qcow2 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:51:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:51:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:51:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.183s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:51:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl9wspj5a/af0a89330037428a81569925f6c70b9f.delta 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:51:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl9wspj5a/af0a89330037428a81569925f6c70b9f.delta 1073741824" returned: 0 in 0.054s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:51:02 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 17:51:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:51:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74980) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 17:51:03 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 17:51:04 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:51:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl9wspj5a/af0a89330037428a81569925f6c70b9f.delta /opt/stack/data/nova/instances/snapshots/tmpl9wspj5a/af0a89330037428a81569925f6c70b9f {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:51:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl9wspj5a/af0a89330037428a81569925f6c70b9f.delta /opt/stack/data/nova/instances/snapshots/tmpl9wspj5a/af0a89330037428a81569925f6c70b9f" returned: 0 in 0.546s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:51:04 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Snapshot extracted, beginning image upload
Nov 02 17:51:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:51:07 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Snapshot image upload complete
Nov 02 17:51:07 user nova-compute[74980]: INFO nova.compute.manager [None req-70b399c7-9547-486c-bc1c-8002a6459ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Took 5.42 seconds to snapshot the instance on the hypervisor.
Nov 02 17:51:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:51:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:51:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:51:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:51:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:51:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:51:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:51:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:51:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:51:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:51:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:51:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:51:25 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:51:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:51:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:51:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:51:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:51:26 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:51:27 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:51:29 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:51:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:51:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:51:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:51:29 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:51:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:51:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:51:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:51:29 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:51:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:51:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:51:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:51:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:51:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:51:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:51:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:51:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:51:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:51:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:51:31 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:51:31 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:51:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8715MB free_disk=24.93349838256836GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:51:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:51:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:51:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:51:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:51:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cfef8d27-a749-4469-912b-b272c0080f03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:51:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance b219f919-44a8-49d1-9b20-36bbb1056120 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:51:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:51:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:51:31 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:51:31 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:51:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:51:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:51:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:51:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:51:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:51:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:51:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:51:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:51:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:51:38 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:51:39 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:51:39 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:51:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:51:42 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:51:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:51:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:51:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:51:42 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:51:42 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Updating instance_info_cache with network_info: [{"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:51:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:51:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:51:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:51:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:51:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:51:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:51:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:51:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:51:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:51:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:51:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:51:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:51:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:51:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:51:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:52:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:52:09 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:52:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:52:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:52:09 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:52:09 user nova-compute[74980]: INFO nova.compute.claims [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Claim successful on node user
Nov 02 17:52:09 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:52:09 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:52:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:52:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:52:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:52:10 user nova-compute[74980]: DEBUG nova.network.neutron [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:52:10 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:52:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:52:10 user nova-compute[74980]: DEBUG nova.policy [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fef01429fb294195984431fd3699f78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11e1bb23618243ddb099bc6855aa2f64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:52:10 user nova-compute[74980]: INFO nova.virt.block_device [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Booting with volume-backed-image 36a97702-8b81-46fe-8b9c-8c3e2e69141f at /dev/vda
Nov 02 17:52:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:10 user nova-compute[74980]: DEBUG nova.network.neutron [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Successfully created port: 93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:52:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Successfully updated port: 93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:52:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "refresh_cache-e4819d7e-1ce3-4202-be42-e20671aa0b42" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:52:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquired lock "refresh_cache-e4819d7e-1ce3-4202-be42-e20671aa0b42" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:52:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:52:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-f32d30ce-fe37-4a4d-a413-603f82f25b04 req-63b85f93-c32d-42ab-86b0-02881add133d service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-changed-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:52:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-f32d30ce-fe37-4a4d-a413-603f82f25b04 req-63b85f93-c32d-42ab-86b0-02881add133d service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Refreshing instance network info cache due to event network-changed-93016e95-3426-4947-a5da-a37369870ffe. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:52:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f32d30ce-fe37-4a4d-a413-603f82f25b04 req-63b85f93-c32d-42ab-86b0-02881add133d service nova] Acquiring lock "refresh_cache-e4819d7e-1ce3-4202-be42-e20671aa0b42" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:52:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:52:12 user nova-compute[74980]: DEBUG nova.network.neutron [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Updating instance_info_cache with network_info: [{"id": "93016e95-3426-4947-a5da-a37369870ffe", "address": "fa:16:3e:d2:ad:f5", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93016e95-34", "ovs_interfaceid": "93016e95-3426-4947-a5da-a37369870ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:52:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Releasing lock "refresh_cache-e4819d7e-1ce3-4202-be42-e20671aa0b42" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:52:12 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Instance network_info: |[{"id": "93016e95-3426-4947-a5da-a37369870ffe", "address": "fa:16:3e:d2:ad:f5", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93016e95-34", "ovs_interfaceid": "93016e95-3426-4947-a5da-a37369870ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:52:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f32d30ce-fe37-4a4d-a413-603f82f25b04 req-63b85f93-c32d-42ab-86b0-02881add133d service nova] Acquired lock "refresh_cache-e4819d7e-1ce3-4202-be42-e20671aa0b42" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:52:12 user nova-compute[74980]: DEBUG nova.network.neutron [req-f32d30ce-fe37-4a4d-a413-603f82f25b04 req-63b85f93-c32d-42ab-86b0-02881add133d service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Refreshing network info cache for port 93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:52:12 user nova-compute[74980]: DEBUG nova.network.neutron [req-f32d30ce-fe37-4a4d-a413-603f82f25b04 req-63b85f93-c32d-42ab-86b0-02881add133d service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Updated VIF entry in instance network info cache for port 93016e95-3426-4947-a5da-a37369870ffe. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:52:12 user nova-compute[74980]: DEBUG nova.network.neutron [req-f32d30ce-fe37-4a4d-a413-603f82f25b04 req-63b85f93-c32d-42ab-86b0-02881add133d service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Updating instance_info_cache with network_info: [{"id": "93016e95-3426-4947-a5da-a37369870ffe", "address": "fa:16:3e:d2:ad:f5", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93016e95-34", "ovs_interfaceid": "93016e95-3426-4947-a5da-a37369870ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:52:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f32d30ce-fe37-4a4d-a413-603f82f25b04 req-63b85f93-c32d-42ab-86b0-02881add133d service nova] Releasing lock "refresh_cache-e4819d7e-1ce3-4202-be42-e20671aa0b42" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:52:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:52:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:52:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:52:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:52:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:52:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:52:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:52:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:52:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:52:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:26 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:52:27 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:52:28 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:52:30 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:52:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:52:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:52:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:52:30 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:52:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG os_brick.utils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bdf523-3fcd-4d57-b779-12aecba6899e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c7fbe3-bc76-4b12-b4dd-2defe88146d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[494d8d0d-b1f6-4f50-ab58-c4c486ee4e77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88c7f57-53ec-474c-8eff-4d183c23da50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:52:31 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2a80ce-90bd-48d2-88bd-7648ef8df8ad]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG os_brick.utils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Updating existing volume attachment record: 35e07e2d-3c83-4381-92a4-6681df746b60 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:32 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:52:32 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:52:32 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=24.93102264404297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:52:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:52:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:52:32 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:52:32 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:52:32 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cfef8d27-a749-4469-912b-b272c0080f03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:52:32 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance b219f919-44a8-49d1-9b20-36bbb1056120 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:52:32 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e4819d7e-1ce3-4202-be42-e20671aa0b42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:52:32 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:52:32 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:52:32 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:52:32 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:52:32 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:52:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:52:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:52:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:52:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:52:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:52:36 user nova-compute[74980]: DEBUG nova.objects.instance [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'flavor' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:52:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:52:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquired lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:52:36 user nova-compute[74980]: DEBUG nova.network.neutron [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:52:36 user nova-compute[74980]: DEBUG nova.objects.instance [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'info_cache' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:52:36 user nova-compute[74980]: DEBUG nova.objects.base [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Object Instance<cfef8d27-a749-4469-912b-b272c0080f03> lazy-loaded attributes: flavor,info_cache {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.network.neutron [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Updating instance_info_cache with network_info: [{"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Releasing lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:52:37 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Instance destroyed successfully.
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.objects.instance [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'resources' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.objects.base [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Object Instance<cfef8d27-a749-4469-912b-b272c0080f03> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-250854749',display_name='tempest-AttachVolumeTestJSON-server-250854749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-250854749',id=39,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6JAtpXxXAMk37Fjkmu/ZPyEKNAoZCsurgqR46mBWz93eP3XOv624lEH1cEe8AD13EovSi2qgytX7qPhQWZ2yoWROF90MH23x4k9KH5UB+HXi+XcSNSHRnM1ZBy5kZltQ==',key_name='tempest-keypair-503867642',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d8271dee2adb499dae5bbd63662036e0',ramdisk_id='',reservation_id='r-l2gruwx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847432967',owner_user_name='tempest-AttachVolumeTestJSON-847432967-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dea42f332a54314a6ffc0790bd66240',uuid=cfef8d27-a749-4469-912b-b272c0080f03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converting VIF {"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG os_vif [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea0afd21-07, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e7cfc34-4277-45b4-b0f1-6660ff5372cc) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:52:37 user nova-compute[74980]: INFO os_vif [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07')
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Start _get_guest_xml network_info=[{"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.objects.instance [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'numa_topology' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.objects.base [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Object Instance<cfef8d27-a749-4469-912b-b272c0080f03> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:52:37 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:52:37 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.objects.instance [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'vcpu_model' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.objects.base [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Object Instance<cfef8d27-a749-4469-912b-b272c0080f03> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-250854749',display_name='tempest-AttachVolumeTestJSON-server-250854749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-250854749',id=39,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6JAtpXxXAMk37Fjkmu/ZPyEKNAoZCsurgqR46mBWz93eP3XOv624lEH1cEe8AD13EovSi2qgytX7qPhQWZ2yoWROF90MH23x4k9KH5UB+HXi+XcSNSHRnM1ZBy5kZltQ==',key_name='tempest-keypair-503867642',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d8271dee2adb499dae5bbd63662036e0',ramdisk_id='',reservation_id='r-l2gruwx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847432967',owner_user_name='tempest-AttachVolumeTestJSON-847432967-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dea42f332a54314a6ffc0790bd66240',uuid=cfef8d27-a749-4469-912b-b272c0080f03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converting VIF {"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.objects.instance [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'pci_devices' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.objects.base [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Object Instance<cfef8d27-a749-4469-912b-b272c0080f03> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:52:37 user nova-compute[74980]:   <uuid>cfef8d27-a749-4469-912b-b272c0080f03</uuid>
Nov 02 17:52:37 user nova-compute[74980]:   <name>instance-00000027</name>
Nov 02 17:52:37 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:52:37 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:52:37 user nova-compute[74980]:   <metadata>
Nov 02 17:52:37 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:52:37 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:52:37 user nova-compute[74980]:       <nova:name>tempest-AttachVolumeTestJSON-server-250854749</nova:name>
Nov 02 17:52:37 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:52:37</nova:creationTime>
Nov 02 17:52:37 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:52:37 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:52:37 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:52:37 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:52:37 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:52:37 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:52:37 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:52:37 user nova-compute[74980]:       <nova:owner>
Nov 02 17:52:37 user nova-compute[74980]:         <nova:user uuid="3dea42f332a54314a6ffc0790bd66240">tempest-AttachVolumeTestJSON-847432967-project-member</nova:user>
Nov 02 17:52:37 user nova-compute[74980]:         <nova:project uuid="d8271dee2adb499dae5bbd63662036e0">tempest-AttachVolumeTestJSON-847432967</nova:project>
Nov 02 17:52:37 user nova-compute[74980]:       </nova:owner>
Nov 02 17:52:37 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:52:37 user nova-compute[74980]:       <nova:ports>
Nov 02 17:52:37 user nova-compute[74980]:         <nova:port uuid="ea0afd21-0732-4572-97d1-63b55c6e5655">
Nov 02 17:52:37 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 17:52:37 user nova-compute[74980]:         </nova:port>
Nov 02 17:52:37 user nova-compute[74980]:       </nova:ports>
Nov 02 17:52:37 user nova-compute[74980]:     </nova:instance>
Nov 02 17:52:37 user nova-compute[74980]:   </metadata>
Nov 02 17:52:37 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:52:37 user nova-compute[74980]:     <system>
Nov 02 17:52:37 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:52:37 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:52:37 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:52:37 user nova-compute[74980]:       <entry name="serial">cfef8d27-a749-4469-912b-b272c0080f03</entry>
Nov 02 17:52:37 user nova-compute[74980]:       <entry name="uuid">cfef8d27-a749-4469-912b-b272c0080f03</entry>
Nov 02 17:52:37 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:52:37 user nova-compute[74980]:     </system>
Nov 02 17:52:37 user nova-compute[74980]:   </sysinfo>
Nov 02 17:52:37 user nova-compute[74980]:   <os>
Nov 02 17:52:37 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:52:37 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:52:37 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:52:37 user nova-compute[74980]:   </os>
Nov 02 17:52:37 user nova-compute[74980]:   <features>
Nov 02 17:52:37 user nova-compute[74980]:     <acpi/>
Nov 02 17:52:37 user nova-compute[74980]:     <apic/>
Nov 02 17:52:37 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:52:37 user nova-compute[74980]:   </features>
Nov 02 17:52:37 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:52:37 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:52:37 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:52:37 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:52:37 user nova-compute[74980]:   </clock>
Nov 02 17:52:37 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:52:37 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:52:37 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:52:37 user nova-compute[74980]:   </cpu>
Nov 02 17:52:37 user nova-compute[74980]:   <devices>
Nov 02 17:52:37 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:52:37 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:52:37 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk"/>
Nov 02 17:52:37 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:52:37 user nova-compute[74980]:     </disk>
Nov 02 17:52:37 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:52:37 user nova-compute[74980]:       <mac address="fa:16:3e:d9:e5:54"/>
Nov 02 17:52:37 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:52:37 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:52:37 user nova-compute[74980]:       <target dev="tapea0afd21-07"/>
Nov 02 17:52:37 user nova-compute[74980]:     </interface>
Nov 02 17:52:37 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:52:37 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/console.log" append="off"/>
Nov 02 17:52:37 user nova-compute[74980]:     </serial>
Nov 02 17:52:37 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:52:37 user nova-compute[74980]:     <video>
Nov 02 17:52:37 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:52:37 user nova-compute[74980]:     </video>
Nov 02 17:52:37 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:52:37 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:52:37 user nova-compute[74980]:     </rng>
Nov 02 17:52:37 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:52:37 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:52:37 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:52:37 user nova-compute[74980]:     </memballoon>
Nov 02 17:52:37 user nova-compute[74980]:   </devices>
Nov 02 17:52:37 user nova-compute[74980]: </domain>
Nov 02 17:52:37 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG nova.objects.instance [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'trusted_certs' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG nova.objects.base [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Object Instance<cfef8d27-a749-4469-912b-b272c0080f03> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.248s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Cannot resize image /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG nova.objects.instance [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'migration_context' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG nova.objects.base [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Object Instance<cfef8d27-a749-4469-912b-b272c0080f03> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-250854749',display_name='tempest-AttachVolumeTestJSON-server-250854749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-250854749',id=39,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6JAtpXxXAMk37Fjkmu/ZPyEKNAoZCsurgqR46mBWz93eP3XOv624lEH1cEe8AD13EovSi2qgytX7qPhQWZ2yoWROF90MH23x4k9KH5UB+HXi+XcSNSHRnM1ZBy5kZltQ==',key_name='tempest-keypair-503867642',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d8271dee2adb499dae5bbd63662036e0',ramdisk_id='',reservation_id='r-l2gruwx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847432967',owner_user_name='tempest-AttachVolumeTestJSON-847432967-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dea42f332a54314a6ffc0790bd66240',uuid=cfef8d27-a749-4469-912b-b272c0080f03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converting VIF {"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG os_vif [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85dfbe5a-5fb1-52fe-8d55-631a0e2a843e', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea0afd21-07, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea0afd21-07, col_values=(('qos', UUID('d619696f-2f9f-4ee8-889a-e52463599fd5')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea0afd21-07, col_values=(('external_ids', {'iface-id': 'ea0afd21-0732-4572-97d1-63b55c6e5655', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:e5:54', 'vm-uuid': 'cfef8d27-a749-4469-912b-b272c0080f03'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:52:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:38 user nova-compute[74980]: INFO os_vif [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07')
Nov 02 17:52:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:39 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:52:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:40 user nova-compute[74980]: DEBUG nova.compute.manager [req-af49b5bb-1ada-4362-aca7-421e524c38a2 req-190afa33-02a6-4725-b408-b1455ea4e69f service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:52:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-af49b5bb-1ada-4362-aca7-421e524c38a2 req-190afa33-02a6-4725-b408-b1455ea4e69f service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:52:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-af49b5bb-1ada-4362-aca7-421e524c38a2 req-190afa33-02a6-4725-b408-b1455ea4e69f service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:52:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-af49b5bb-1ada-4362-aca7-421e524c38a2 req-190afa33-02a6-4725-b408-b1455ea4e69f service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:52:40 user nova-compute[74980]: DEBUG nova.compute.manager [req-af49b5bb-1ada-4362-aca7-421e524c38a2 req-190afa33-02a6-4725-b408-b1455ea4e69f service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:52:40 user nova-compute[74980]: WARNING nova.compute.manager [req-af49b5bb-1ada-4362-aca7-421e524c38a2 req-190afa33-02a6-4725-b408-b1455ea4e69f service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received unexpected event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with vm_state stopped and task_state powering-on.
Nov 02 17:52:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:41 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:52:42 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:52:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:52:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-ea4a1040-80ed-4265-83f2-ff917d108e56 req-79045893-514f-4b88-86bf-73c176868740 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:52:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ea4a1040-80ed-4265-83f2-ff917d108e56 req-79045893-514f-4b88-86bf-73c176868740 service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:52:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ea4a1040-80ed-4265-83f2-ff917d108e56 req-79045893-514f-4b88-86bf-73c176868740 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:52:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ea4a1040-80ed-4265-83f2-ff917d108e56 req-79045893-514f-4b88-86bf-73c176868740 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:52:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-ea4a1040-80ed-4265-83f2-ff917d108e56 req-79045893-514f-4b88-86bf-73c176868740 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:52:42 user nova-compute[74980]: WARNING nova.compute.manager [req-ea4a1040-80ed-4265-83f2-ff917d108e56 req-79045893-514f-4b88-86bf-73c176868740 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received unexpected event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with vm_state stopped and task_state powering-on.
Nov 02 17:52:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:52:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:52:42 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:52:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:52:42 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Instance rebooted successfully.
Nov 02 17:52:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-30a1d03a-8b69-4ba8-ba01-1d400e7d2c2f tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:52:43 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Updating instance_info_cache with network_info: [{"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:52:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-cfef8d27-a749-4469-912b-b272c0080f03" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:52:43 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:52:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:52:52 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Creating image(s)
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Ensure instance console log exists: /opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Start _get_guest_xml network_info=[{"id": "93016e95-3426-4947-a5da-a37369870ffe", "address": "fa:16:3e:d2:ad:f5", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93016e95-34", "ovs_interfaceid": "93016e95-3426-4947-a5da-a37369870ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whxTIJLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4819d7e-1ce3-4202-be42-e20671aa0b42', 'attached_at': '', 'detached_at': '', 'volume_id': '5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f', 'serial': '5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '35e07e2d-3c83-4381-92a4-6681df746b60', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:52:52 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:52:52 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whxTIJLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:52:52 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:52:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:52:52 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:52:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:52:52 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:52:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f74e4ee-e937-481f-b16d-1b9ec5dd9743]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:52:52 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6010d82f-3f86-4827-80c4-6f374dcd2de0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f] added
Nov 02 17:52:52 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:52:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.069s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c78d9a-d78b-48b0-a936-f1f5c79057c5]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[580015b5-6635-446f-a75f-db58c87da8ae]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v whxTIJLD {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v whxTIJLD" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7249e6-2a1b-42d8-af66-8fbcfa7b04dc]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'whxTIJLD'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[31398ea0-67c5-4bfb-a41f-e98e7e170818]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[98688c29-27ae-4121-9831-315c33e60e1b]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:52:53 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:52:53 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e012b7-c6fd-460a-8005-d7781f0d4c86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f, portal: 172.16.0.220,3260]
Nov 02 17:52:53 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f, portal: 172.16.0.220,3260] successful.
Nov 02 17:52:53 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d4d8d2-762b-4803-836d-017be1378296]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff09f1b7-ab52-44c6-9a59-2c21508eae43]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:52:53 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:52:53 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:52:53 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:52:53 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f795e6c-a89e-4061-947f-c50552a59e5e]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whxTIJLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23862623039313539', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862623039313539', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-274175433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-274175433',id=42,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11e1bb23618243ddb099bc6855aa2f64',ramdisk_id='',reservation_id='r-4azmqki5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-36491096',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:52:10Z,user_data=None,user_id='fef01429fb294195984431fd3699f78b',uuid=e4819d7e-1ce3-4202-be42-e20671aa0b42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93016e95-3426-4947-a5da-a37369870ffe", "address": "fa:16:3e:d2:ad:f5", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93016e95-34", "ovs_interfaceid": "93016e95-3426-4947-a5da-a37369870ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converting VIF {"id": "93016e95-3426-4947-a5da-a37369870ffe", "address": "fa:16:3e:d2:ad:f5", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93016e95-34", "ovs_interfaceid": "93016e95-3426-4947-a5da-a37369870ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ad:f5,bridge_name='br-int',has_traffic_filtering=True,id=93016e95-3426-4947-a5da-a37369870ffe,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93016e95-34') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.objects.instance [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'pci_devices' on Instance uuid e4819d7e-1ce3-4202-be42-e20671aa0b42 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:52:54 user nova-compute[74980]:   <uuid>e4819d7e-1ce3-4202-be42-e20671aa0b42</uuid>
Nov 02 17:52:54 user nova-compute[74980]:   <name>instance-0000002a</name>
Nov 02 17:52:54 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:52:54 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:52:54 user nova-compute[74980]:   <metadata>
Nov 02 17:52:54 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:52:54 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:52:54 user nova-compute[74980]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-274175433</nova:name>
Nov 02 17:52:54 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:52:52</nova:creationTime>
Nov 02 17:52:54 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:52:54 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:52:54 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:52:54 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:52:54 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:52:54 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:52:54 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:52:54 user nova-compute[74980]:       <nova:owner>
Nov 02 17:52:54 user nova-compute[74980]:         <nova:user uuid="fef01429fb294195984431fd3699f78b">tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member</nova:user>
Nov 02 17:52:54 user nova-compute[74980]:         <nova:project uuid="11e1bb23618243ddb099bc6855aa2f64">tempest-ServerBootFromVolumeStableRescueTest-36491096</nova:project>
Nov 02 17:52:54 user nova-compute[74980]:       </nova:owner>
Nov 02 17:52:54 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:52:54 user nova-compute[74980]:       <nova:ports>
Nov 02 17:52:54 user nova-compute[74980]:         <nova:port uuid="93016e95-3426-4947-a5da-a37369870ffe">
Nov 02 17:52:54 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 17:52:54 user nova-compute[74980]:         </nova:port>
Nov 02 17:52:54 user nova-compute[74980]:       </nova:ports>
Nov 02 17:52:54 user nova-compute[74980]:     </nova:instance>
Nov 02 17:52:54 user nova-compute[74980]:   </metadata>
Nov 02 17:52:54 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:52:54 user nova-compute[74980]:     <system>
Nov 02 17:52:54 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:52:54 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:52:54 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:52:54 user nova-compute[74980]:       <entry name="serial">e4819d7e-1ce3-4202-be42-e20671aa0b42</entry>
Nov 02 17:52:54 user nova-compute[74980]:       <entry name="uuid">e4819d7e-1ce3-4202-be42-e20671aa0b42</entry>
Nov 02 17:52:54 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:52:54 user nova-compute[74980]:     </system>
Nov 02 17:52:54 user nova-compute[74980]:   </sysinfo>
Nov 02 17:52:54 user nova-compute[74980]:   <os>
Nov 02 17:52:54 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:52:54 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:52:54 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:52:54 user nova-compute[74980]:   </os>
Nov 02 17:52:54 user nova-compute[74980]:   <features>
Nov 02 17:52:54 user nova-compute[74980]:     <acpi/>
Nov 02 17:52:54 user nova-compute[74980]:     <apic/>
Nov 02 17:52:54 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:52:54 user nova-compute[74980]:   </features>
Nov 02 17:52:54 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:52:54 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:52:54 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:52:54 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:52:54 user nova-compute[74980]:   </clock>
Nov 02 17:52:54 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:52:54 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:52:54 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:52:54 user nova-compute[74980]:   </cpu>
Nov 02 17:52:54 user nova-compute[74980]:   <devices>
Nov 02 17:52:54 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:52:54 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:52:54 user nova-compute[74980]:       <source dev="/dev/sdb"/>
Nov 02 17:52:54 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:52:54 user nova-compute[74980]:       <serial>5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f</serial>
Nov 02 17:52:54 user nova-compute[74980]:     </disk>
Nov 02 17:52:54 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:52:54 user nova-compute[74980]:       <mac address="fa:16:3e:d2:ad:f5"/>
Nov 02 17:52:54 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:52:54 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:52:54 user nova-compute[74980]:       <target dev="tap93016e95-34"/>
Nov 02 17:52:54 user nova-compute[74980]:     </interface>
Nov 02 17:52:54 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:52:54 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/console.log" append="off"/>
Nov 02 17:52:54 user nova-compute[74980]:     </serial>
Nov 02 17:52:54 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:52:54 user nova-compute[74980]:     <video>
Nov 02 17:52:54 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:52:54 user nova-compute[74980]:     </video>
Nov 02 17:52:54 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:52:54 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:52:54 user nova-compute[74980]:     </rng>
Nov 02 17:52:54 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:52:54 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:52:54 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:52:54 user nova-compute[74980]:     </memballoon>
Nov 02 17:52:54 user nova-compute[74980]:   </devices>
Nov 02 17:52:54 user nova-compute[74980]: </domain>
Nov 02 17:52:54 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-274175433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-274175433',id=42,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11e1bb23618243ddb099bc6855aa2f64',ramdisk_id='',reservation_id='r-4azmqki5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-36491096',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:52:10Z,user_data=None,user_id='fef01429fb294195984431fd3699f78b',uuid=e4819d7e-1ce3-4202-be42-e20671aa0b42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93016e95-3426-4947-a5da-a37369870ffe", "address": "fa:16:3e:d2:ad:f5", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93016e95-34", "ovs_interfaceid": "93016e95-3426-4947-a5da-a37369870ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converting VIF {"id": "93016e95-3426-4947-a5da-a37369870ffe", "address": "fa:16:3e:d2:ad:f5", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93016e95-34", "ovs_interfaceid": "93016e95-3426-4947-a5da-a37369870ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ad:f5,bridge_name='br-int',has_traffic_filtering=True,id=93016e95-3426-4947-a5da-a37369870ffe,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93016e95-34') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG os_vif [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ad:f5,bridge_name='br-int',has_traffic_filtering=True,id=93016e95-3426-4947-a5da-a37369870ffe,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93016e95-34') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0336763-7e83-5e7e-94e8-0bf9886cdd91', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93016e95-34, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93016e95-34, col_values=(('qos', UUID('6c108f41-6d4a-4666-86a9-67c879128e19')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93016e95-34, col_values=(('external_ids', {'iface-id': '93016e95-3426-4947-a5da-a37369870ffe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:ad:f5', 'vm-uuid': 'e4819d7e-1ce3-4202-be42-e20671aa0b42'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:54 user nova-compute[74980]: INFO os_vif [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:ad:f5,bridge_name='br-int',has_traffic_filtering=True,id=93016e95-3426-4947-a5da-a37369870ffe,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93016e95-34')
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] No VIF found with MAC fa:16:3e:d2:ad:f5, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Verify base images {{(pid=74980) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Image id 36a97702-8b81-46fe-8b9c-8c3e2e69141f yields fingerprint 80316776c27fc820c31d305dae09f2877f7a7666 {{(pid=74980) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 02 17:52:54 user nova-compute[74980]: INFO nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] image 36a97702-8b81-46fe-8b9c-8c3e2e69141f at (/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666): checking
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] image 36a97702-8b81-46fe-8b9c-8c3e2e69141f at (/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666): image is in use {{(pid=74980) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74980) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] cfef8d27-a749-4469-912b-b272c0080f03 is a valid instance name {{(pid=74980) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] cfef8d27-a749-4469-912b-b272c0080f03 has a disk file {{(pid=74980) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cfef8d27-a749-4469-912b-b272c0080f03 is backed by 80316776c27fc820c31d305dae09f2877f7a7666 {{(pid=74980) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] 6ea56f31-932f-42f8-987c-13ef46d2d9f7 is a valid instance name {{(pid=74980) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] b219f919-44a8-49d1-9b20-36bbb1056120 is a valid instance name {{(pid=74980) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] b219f919-44a8-49d1-9b20-36bbb1056120 has a disk file {{(pid=74980) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 02 17:52:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance b219f919-44a8-49d1-9b20-36bbb1056120 is backed by 80316776c27fc820c31d305dae09f2877f7a7666 {{(pid=74980) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 02 17:52:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] a1f33052-902f-44ef-b758-67cfc144416c is a valid instance name {{(pid=74980) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 17:52:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] a1f33052-902f-44ef-b758-67cfc144416c has a disk file {{(pid=74980) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 02 17:52:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:52:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:52:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c is backed by 80316776c27fc820c31d305dae09f2877f7a7666 {{(pid=74980) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 02 17:52:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] e4819d7e-1ce3-4202-be42-e20671aa0b42 is a valid instance name {{(pid=74980) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 17:52:55 user nova-compute[74980]: WARNING nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316
Nov 02 17:52:55 user nova-compute[74980]: WARNING nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3
Nov 02 17:52:55 user nova-compute[74980]: WARNING nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0
Nov 02 17:52:55 user nova-compute[74980]: WARNING nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e35948682464e165f89788def3707ee923939ce2
Nov 02 17:52:55 user nova-compute[74980]: WARNING nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4
Nov 02 17:52:55 user nova-compute[74980]: WARNING nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1
Nov 02 17:52:55 user nova-compute[74980]: WARNING nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3
Nov 02 17:52:55 user nova-compute[74980]: INFO nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Active base files: /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666
Nov 02 17:52:55 user nova-compute[74980]: INFO nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Removable base files: /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316 /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3 /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0 /opt/stack/data/nova/instances/_base/e35948682464e165f89788def3707ee923939ce2 /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4 /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1 /opt/stack/data/nova/instances/_base/7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3
Nov 02 17:52:55 user nova-compute[74980]: INFO nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f8272c538c50fd42c6b02e4edcc76c003b5a6316
Nov 02 17:52:55 user nova-compute[74980]: INFO nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2213305e0b4bb734d1ba23e3746e5dab20a0fbd3
Nov 02 17:52:55 user nova-compute[74980]: INFO nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a1fb95080e4142a4f989cb5f269e62c5ba5514d0
Nov 02 17:52:55 user nova-compute[74980]: INFO nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e35948682464e165f89788def3707ee923939ce2
Nov 02 17:52:55 user nova-compute[74980]: INFO nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1e8e2992ba3fbe980e7c7c2dab9344ffb75590f4
Nov 02 17:52:55 user nova-compute[74980]: INFO nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9bbdc5a6b0d17a90dcbc06822cf559050c06e6d1
Nov 02 17:52:55 user nova-compute[74980]: INFO nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7fb9ec3c95a59b1b4b559a2037c74fd6ffe790e3
Nov 02 17:52:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Verification complete {{(pid=74980) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 02 17:52:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Verify swap images {{(pid=74980) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 02 17:52:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.imagecache [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Verify ephemeral images {{(pid=74980) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 02 17:52:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:52:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:52:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:52:58 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Instance spawned successfully.
Nov 02 17:52:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:52:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:52:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:52:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:52:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:52:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:52:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:52:58 user nova-compute[74980]: INFO nova.compute.manager [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 02 17:52:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:52:58 user nova-compute[74980]: INFO nova.compute.manager [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Took 48.78 seconds to build instance.
Nov 02 17:52:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d45d9ee4-c594-44d8-b6ab-468ded0a586c tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.899s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:52:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-5e204a6f-a02a-4a7b-be7f-54a650d803cf req-db7f86f4-f608-45eb-ae53-dfd90966f859 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:52:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5e204a6f-a02a-4a7b-be7f-54a650d803cf req-db7f86f4-f608-45eb-ae53-dfd90966f859 service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:52:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5e204a6f-a02a-4a7b-be7f-54a650d803cf req-db7f86f4-f608-45eb-ae53-dfd90966f859 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:52:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5e204a6f-a02a-4a7b-be7f-54a650d803cf req-db7f86f4-f608-45eb-ae53-dfd90966f859 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:52:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-5e204a6f-a02a-4a7b-be7f-54a650d803cf req-db7f86f4-f608-45eb-ae53-dfd90966f859 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:52:58 user nova-compute[74980]: WARNING nova.compute.manager [req-5e204a6f-a02a-4a7b-be7f-54a650d803cf req-db7f86f4-f608-45eb-ae53-dfd90966f859 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received unexpected event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe for instance with vm_state active and task_state None.
Nov 02 17:52:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:00 user nova-compute[74980]: DEBUG nova.compute.manager [req-ac3e5b41-0960-4221-9542-f2a95984a0ef req-e7e146d9-05fe-438e-8bbc-8e1b20eaae71 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:53:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ac3e5b41-0960-4221-9542-f2a95984a0ef req-e7e146d9-05fe-438e-8bbc-8e1b20eaae71 service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:53:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ac3e5b41-0960-4221-9542-f2a95984a0ef req-e7e146d9-05fe-438e-8bbc-8e1b20eaae71 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:53:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ac3e5b41-0960-4221-9542-f2a95984a0ef req-e7e146d9-05fe-438e-8bbc-8e1b20eaae71 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:53:00 user nova-compute[74980]: DEBUG nova.compute.manager [req-ac3e5b41-0960-4221-9542-f2a95984a0ef req-e7e146d9-05fe-438e-8bbc-8e1b20eaae71 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:53:00 user nova-compute[74980]: WARNING nova.compute.manager [req-ac3e5b41-0960-4221-9542-f2a95984a0ef req-e7e146d9-05fe-438e-8bbc-8e1b20eaae71 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received unexpected event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe for instance with vm_state active and task_state None.
Nov 02 17:53:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:53:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:53:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:53:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:53:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:53:24 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:53:24 user nova-compute[74980]: INFO nova.compute.claims [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Claim successful on node user
Nov 02 17:53:24 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:53:24 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:53:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:53:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:53:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:53:24 user nova-compute[74980]: DEBUG nova.network.neutron [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:53:24 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:53:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:53:24 user nova-compute[74980]: INFO nova.virt.block_device [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Booting with volume snapshot b49a36a2-ad79-4f68-af51-87d83831f43e at /dev/vda
Nov 02 17:53:24 user nova-compute[74980]: DEBUG nova.policy [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b309bc195c84c68a52e095927f874f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84de25c95ef24520aa7c06012991dd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:53:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:25 user nova-compute[74980]: DEBUG nova.network.neutron [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Successfully created port: 0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:53:26 user nova-compute[74980]: DEBUG nova.network.neutron [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Successfully updated port: 0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:53:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "refresh_cache-3d4f3b83-46ac-4723-b7f0-31c0769ab31e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:53:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquired lock "refresh_cache-3d4f3b83-46ac-4723-b7f0-31c0769ab31e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:53:26 user nova-compute[74980]: DEBUG nova.network.neutron [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:53:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-bd431c4d-9354-445c-9783-a6353b82c35e req-1c556ce7-5938-4ebf-b3ee-49c2dbe8a2ca service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received event network-changed-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:53:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-bd431c4d-9354-445c-9783-a6353b82c35e req-1c556ce7-5938-4ebf-b3ee-49c2dbe8a2ca service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Refreshing instance network info cache due to event network-changed-0cc1bbfd-b848-4519-b244-1ac391ea362d. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:53:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bd431c4d-9354-445c-9783-a6353b82c35e req-1c556ce7-5938-4ebf-b3ee-49c2dbe8a2ca service nova] Acquiring lock "refresh_cache-3d4f3b83-46ac-4723-b7f0-31c0769ab31e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:53:26 user nova-compute[74980]: DEBUG nova.network.neutron [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:53:27 user nova-compute[74980]: DEBUG nova.network.neutron [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Updating instance_info_cache with network_info: [{"id": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "address": "fa:16:3e:cd:5e:c6", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1bbfd-b8", "ovs_interfaceid": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:53:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Releasing lock "refresh_cache-3d4f3b83-46ac-4723-b7f0-31c0769ab31e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:53:27 user nova-compute[74980]: DEBUG nova.compute.manager [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Instance network_info: |[{"id": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "address": "fa:16:3e:cd:5e:c6", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1bbfd-b8", "ovs_interfaceid": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:53:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bd431c4d-9354-445c-9783-a6353b82c35e req-1c556ce7-5938-4ebf-b3ee-49c2dbe8a2ca service nova] Acquired lock "refresh_cache-3d4f3b83-46ac-4723-b7f0-31c0769ab31e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:53:27 user nova-compute[74980]: DEBUG nova.network.neutron [req-bd431c4d-9354-445c-9783-a6353b82c35e req-1c556ce7-5938-4ebf-b3ee-49c2dbe8a2ca service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Refreshing network info cache for port 0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:53:27 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:53:27 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:53:27 user nova-compute[74980]: DEBUG nova.network.neutron [req-bd431c4d-9354-445c-9783-a6353b82c35e req-1c556ce7-5938-4ebf-b3ee-49c2dbe8a2ca service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Updated VIF entry in instance network info cache for port 0cc1bbfd-b848-4519-b244-1ac391ea362d. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:53:27 user nova-compute[74980]: DEBUG nova.network.neutron [req-bd431c4d-9354-445c-9783-a6353b82c35e req-1c556ce7-5938-4ebf-b3ee-49c2dbe8a2ca service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Updating instance_info_cache with network_info: [{"id": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "address": "fa:16:3e:cd:5e:c6", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1bbfd-b8", "ovs_interfaceid": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:53:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bd431c4d-9354-445c-9783-a6353b82c35e req-1c556ce7-5938-4ebf-b3ee-49c2dbe8a2ca service nova] Releasing lock "refresh_cache-3d4f3b83-46ac-4723-b7f0-31c0769ab31e" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:53:28 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:53:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG os_brick.utils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2112841-7750-4ab8-a894-78bd4d54814d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7f7fb0-0edb-46f3-a9aa-ccad9b784774]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bb01c5-174e-48f7-9e82-78d2407bf456]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[621959c8-fd6c-4d1c-9345-01f3748016cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:53:31 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c8483c-91a8-408e-b38a-91c4811c5d7d]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG os_brick.utils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Updating existing volume attachment record: 77b952f8-98ed-42e1-badf-c2e50144f5cb {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:53:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:53:33 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:53:33 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8498MB free_disk=24.91830825805664GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cfef8d27-a749-4469-912b-b272c0080f03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance b219f919-44a8-49d1-9b20-36bbb1056120 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e4819d7e-1ce3-4202-be42-e20671aa0b42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 3d4f3b83-46ac-4723-b7f0-31c0769ab31e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing inventories for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating ProviderTree inventory for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating inventory in ProviderTree for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing aggregate associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, aggregates: None {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing trait associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 17:53:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] There are 0 instances to clean {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 17:53:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:34 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:53:34 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:53:34 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:53:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:39 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:53:40 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:53:41 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:53:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:53:44 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:53:44 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:53:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-b219f919-44a8-49d1-9b20-36bbb1056120" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:53:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-b219f919-44a8-49d1-9b20-36bbb1056120" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:53:44 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:53:45 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Updating instance_info_cache with network_info: [{"id": "00f75489-496c-4666-a645-0dacdcadcc02", "address": "fa:16:3e:cc:e6:cc", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f75489-49", "ovs_interfaceid": "00f75489-496c-4666-a645-0dacdcadcc02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:53:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-b219f919-44a8-49d1-9b20-36bbb1056120" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:53:45 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:53:46 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:53:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.compute.manager [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:53:50 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Creating image(s)
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Ensure instance console log exists: /opt/stack/data/nova/instances/3d4f3b83-46ac-4723-b7f0-31c0769ab31e/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Start _get_guest_xml network_info=[{"id": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "address": "fa:16:3e:cd:5e:c6", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1bbfd-b8", "ovs_interfaceid": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtAHjRnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d4f3b83-46ac-4723-b7f0-31c0769ab31e', 'attached_at': '', 'detached_at': '', 'volume_id': '3dec4d33-33ff-4b6e-9e03-c6a5af95ef30', 'serial': '3dec4d33-33ff-4b6e-9e03-c6a5af95ef30'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '77b952f8-98ed-42e1-badf-c2e50144f5cb', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:53:50 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:53:50 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtAHjRnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:53:50 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:53:50 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:53:50 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc720b0-94af-46de-a61c-7cb036ea16f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:53:50 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[de66efbb-deb5-4840-8c77-3ed5c0553a65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30] added
Nov 02 17:53:50 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7553cb0-ae32-462c-8f5f-59850ac7a303]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d4030f-67e3-4b9e-aac1-2c687a1a35cd]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JtAHjRnQ {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JtAHjRnQ" returned: 0 in 0.130s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d87303c-8394-4b46-b0cd-3d07f818c30b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JtAHjRnQ'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[149c95cc-3dcd-490c-b998-f973f8a8ac87]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e017df6-3c70-4df0-abdf-101603718c30]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:53:50 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:53:50 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:53:50 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:53:50 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[84058641-d7b8-4bf3-856a-9c3a8efb6bec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30, portal: 172.16.0.220,3260]
Nov 02 17:53:50 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30, portal: 172.16.0.220,3260] successful.
Nov 02 17:53:50 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c1b710-cbc5-4f61-b1be-c8702f3e65bd]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac82892-6b61-4da8-bf5c-c9ef02ddac38]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:53:50 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:53:50 user nova-compute[74980]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 (non-flash)
Nov 02 17:53:50 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:53:50 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:53:50 user nova-compute[74980]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 (non-flash)
Nov 02 17:53:50 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:53:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:53:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:53:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06b8d77-a085-4ce7-8d28-628bba584c6a]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:53:51 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:53:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtAHjRnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '26536366164383233', 'path': '/dev/sdc'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536366164383233', 'path': '/dev/sdc'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:53:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1998029217',display_name='tempest-TestVolumeBootPattern-server-1998029217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1998029217',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-58nubt4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:53:25Z,user_data=None,user_id='9b309bc195c84c68a52e095927f874f0',uuid=3d4f3b83-46ac-4723-b7f0-31c0769ab31e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "address": "fa:16:3e:cd:5e:c6", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1bbfd-b8", "ovs_interfaceid": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "address": "fa:16:3e:cd:5e:c6", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1bbfd-b8", "ovs_interfaceid": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:5e:c6,bridge_name='br-int',has_traffic_filtering=True,id=0cc1bbfd-b848-4519-b244-1ac391ea362d,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1bbfd-b8') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG nova.objects.instance [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d4f3b83-46ac-4723-b7f0-31c0769ab31e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:53:52 user nova-compute[74980]:   <uuid>3d4f3b83-46ac-4723-b7f0-31c0769ab31e</uuid>
Nov 02 17:53:52 user nova-compute[74980]:   <name>instance-0000002b</name>
Nov 02 17:53:52 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:53:52 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:53:52 user nova-compute[74980]:   <metadata>
Nov 02 17:53:52 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:53:52 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:53:52 user nova-compute[74980]:       <nova:name>tempest-TestVolumeBootPattern-server-1998029217</nova:name>
Nov 02 17:53:52 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:53:50</nova:creationTime>
Nov 02 17:53:52 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:53:52 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:53:52 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:53:52 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:53:52 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:53:52 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:53:52 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:53:52 user nova-compute[74980]:       <nova:owner>
Nov 02 17:53:52 user nova-compute[74980]:         <nova:user uuid="9b309bc195c84c68a52e095927f874f0">tempest-TestVolumeBootPattern-352919040-project-member</nova:user>
Nov 02 17:53:52 user nova-compute[74980]:         <nova:project uuid="84de25c95ef24520aa7c06012991dd97">tempest-TestVolumeBootPattern-352919040</nova:project>
Nov 02 17:53:52 user nova-compute[74980]:       </nova:owner>
Nov 02 17:53:52 user nova-compute[74980]:       <nova:ports>
Nov 02 17:53:52 user nova-compute[74980]:         <nova:port uuid="0cc1bbfd-b848-4519-b244-1ac391ea362d">
Nov 02 17:53:52 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 17:53:52 user nova-compute[74980]:         </nova:port>
Nov 02 17:53:52 user nova-compute[74980]:       </nova:ports>
Nov 02 17:53:52 user nova-compute[74980]:     </nova:instance>
Nov 02 17:53:52 user nova-compute[74980]:   </metadata>
Nov 02 17:53:52 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:53:52 user nova-compute[74980]:     <system>
Nov 02 17:53:52 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:53:52 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:53:52 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:53:52 user nova-compute[74980]:       <entry name="serial">3d4f3b83-46ac-4723-b7f0-31c0769ab31e</entry>
Nov 02 17:53:52 user nova-compute[74980]:       <entry name="uuid">3d4f3b83-46ac-4723-b7f0-31c0769ab31e</entry>
Nov 02 17:53:52 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:53:52 user nova-compute[74980]:     </system>
Nov 02 17:53:52 user nova-compute[74980]:   </sysinfo>
Nov 02 17:53:52 user nova-compute[74980]:   <os>
Nov 02 17:53:52 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:53:52 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:53:52 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:53:52 user nova-compute[74980]:   </os>
Nov 02 17:53:52 user nova-compute[74980]:   <features>
Nov 02 17:53:52 user nova-compute[74980]:     <acpi/>
Nov 02 17:53:52 user nova-compute[74980]:     <apic/>
Nov 02 17:53:52 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:53:52 user nova-compute[74980]:   </features>
Nov 02 17:53:52 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:53:52 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:53:52 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:53:52 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:53:52 user nova-compute[74980]:   </clock>
Nov 02 17:53:52 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:53:52 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:53:52 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:53:52 user nova-compute[74980]:   </cpu>
Nov 02 17:53:52 user nova-compute[74980]:   <devices>
Nov 02 17:53:52 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:53:52 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:53:52 user nova-compute[74980]:       <source dev="/dev/sdc"/>
Nov 02 17:53:52 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:53:52 user nova-compute[74980]:       <serial>3dec4d33-33ff-4b6e-9e03-c6a5af95ef30</serial>
Nov 02 17:53:52 user nova-compute[74980]:     </disk>
Nov 02 17:53:52 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:53:52 user nova-compute[74980]:       <mac address="fa:16:3e:cd:5e:c6"/>
Nov 02 17:53:52 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:53:52 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:53:52 user nova-compute[74980]:       <target dev="tap0cc1bbfd-b8"/>
Nov 02 17:53:52 user nova-compute[74980]:     </interface>
Nov 02 17:53:52 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:53:52 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/3d4f3b83-46ac-4723-b7f0-31c0769ab31e/console.log" append="off"/>
Nov 02 17:53:52 user nova-compute[74980]:     </serial>
Nov 02 17:53:52 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:53:52 user nova-compute[74980]:     <video>
Nov 02 17:53:52 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:53:52 user nova-compute[74980]:     </video>
Nov 02 17:53:52 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:53:52 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:53:52 user nova-compute[74980]:     </rng>
Nov 02 17:53:52 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:53:52 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:53:52 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:53:52 user nova-compute[74980]:     </memballoon>
Nov 02 17:53:52 user nova-compute[74980]:   </devices>
Nov 02 17:53:52 user nova-compute[74980]: </domain>
Nov 02 17:53:52 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:53:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1998029217',display_name='tempest-TestVolumeBootPattern-server-1998029217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1998029217',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-58nubt4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:53:25Z,user_data=None,user_id='9b309bc195c84c68a52e095927f874f0',uuid=3d4f3b83-46ac-4723-b7f0-31c0769ab31e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "address": "fa:16:3e:cd:5e:c6", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1bbfd-b8", "ovs_interfaceid": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "address": "fa:16:3e:cd:5e:c6", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1bbfd-b8", "ovs_interfaceid": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:5e:c6,bridge_name='br-int',has_traffic_filtering=True,id=0cc1bbfd-b848-4519-b244-1ac391ea362d,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1bbfd-b8') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG os_vif [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:5e:c6,bridge_name='br-int',has_traffic_filtering=True,id=0cc1bbfd-b848-4519-b244-1ac391ea362d,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1bbfd-b8') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad329b1c-e333-5928-8345-7d677204f6eb', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cc1bbfd-b8, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0cc1bbfd-b8, col_values=(('qos', UUID('8bde4f53-2d3d-44ab-9f04-69d0c91bf23b')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0cc1bbfd-b8, col_values=(('external_ids', {'iface-id': '0cc1bbfd-b848-4519-b244-1ac391ea362d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:5e:c6', 'vm-uuid': '3d4f3b83-46ac-4723-b7f0-31c0769ab31e'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:52 user nova-compute[74980]: INFO os_vif [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:5e:c6,bridge_name='br-int',has_traffic_filtering=True,id=0cc1bbfd-b848-4519-b244-1ac391ea362d,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1bbfd-b8')
Nov 02 17:53:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:53:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] No VIF found with MAC fa:16:3e:cd:5e:c6, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:53:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-17612c3b-5a89-4c21-a822-d280004655df req-89cc048f-dfea-4c90-8751-2a4e4321950a service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received event network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:53:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-17612c3b-5a89-4c21-a822-d280004655df req-89cc048f-dfea-4c90-8751-2a4e4321950a service nova] Acquiring lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:53:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-17612c3b-5a89-4c21-a822-d280004655df req-89cc048f-dfea-4c90-8751-2a4e4321950a service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:53:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-17612c3b-5a89-4c21-a822-d280004655df req-89cc048f-dfea-4c90-8751-2a4e4321950a service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:53:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-17612c3b-5a89-4c21-a822-d280004655df req-89cc048f-dfea-4c90-8751-2a4e4321950a service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] No waiting events found dispatching network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:53:53 user nova-compute[74980]: WARNING nova.compute.manager [req-17612c3b-5a89-4c21-a822-d280004655df req-89cc048f-dfea-4c90-8751-2a4e4321950a service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received unexpected event network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d for instance with vm_state building and task_state spawning.
Nov 02 17:53:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:53:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:53:55 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Instance spawned successfully.
Nov 02 17:53:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:53:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:53:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:53:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:53:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:53:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:53:55 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:53:55 user nova-compute[74980]: INFO nova.compute.manager [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 02 17:53:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:53:55 user nova-compute[74980]: INFO nova.compute.manager [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Took 31.36 seconds to build instance.
Nov 02 17:53:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-042fbbec-1fbb-446b-bee6-49205aac4a0a tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.487s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:53:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-a8e3e2b1-5beb-44a8-9f93-260bb12b56a6 req-7e988215-8819-40e9-9834-87d3d1f396ec service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received event network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:53:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a8e3e2b1-5beb-44a8-9f93-260bb12b56a6 req-7e988215-8819-40e9-9834-87d3d1f396ec service nova] Acquiring lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:53:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a8e3e2b1-5beb-44a8-9f93-260bb12b56a6 req-7e988215-8819-40e9-9834-87d3d1f396ec service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:53:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a8e3e2b1-5beb-44a8-9f93-260bb12b56a6 req-7e988215-8819-40e9-9834-87d3d1f396ec service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:53:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-a8e3e2b1-5beb-44a8-9f93-260bb12b56a6 req-7e988215-8819-40e9-9834-87d3d1f396ec service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] No waiting events found dispatching network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:53:56 user nova-compute[74980]: WARNING nova.compute.manager [req-a8e3e2b1-5beb-44a8-9f93-260bb12b56a6 req-7e988215-8819-40e9-9834-87d3d1f396ec service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received unexpected event network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d for instance with vm_state active and task_state None.
Nov 02 17:53:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:53:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:53:59 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74980) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 17:54:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:00 user nova-compute[74980]: INFO nova.compute.manager [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Rescuing
Nov 02 17:54:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "refresh_cache-e4819d7e-1ce3-4202-be42-e20671aa0b42" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:54:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquired lock "refresh_cache-e4819d7e-1ce3-4202-be42-e20671aa0b42" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:54:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:54:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Updating instance_info_cache with network_info: [{"id": "93016e95-3426-4947-a5da-a37369870ffe", "address": "fa:16:3e:d2:ad:f5", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93016e95-34", "ovs_interfaceid": "93016e95-3426-4947-a5da-a37369870ffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:54:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Releasing lock "refresh_cache-e4819d7e-1ce3-4202-be42-e20671aa0b42" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG nova.compute.manager [req-d15f9149-e81a-44aa-aa59-ec4c97209d06 req-351a755c-c884-44c1-96c1-5dac176255f6 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-unplugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d15f9149-e81a-44aa-aa59-ec4c97209d06 req-351a755c-c884-44c1-96c1-5dac176255f6 service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d15f9149-e81a-44aa-aa59-ec4c97209d06 req-351a755c-c884-44c1-96c1-5dac176255f6 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d15f9149-e81a-44aa-aa59-ec4c97209d06 req-351a755c-c884-44c1-96c1-5dac176255f6 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG nova.compute.manager [req-d15f9149-e81a-44aa-aa59-ec4c97209d06 req-351a755c-c884-44c1-96c1-5dac176255f6 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-unplugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:54:01 user nova-compute[74980]: WARNING nova.compute.manager [req-d15f9149-e81a-44aa-aa59-ec4c97209d06 req-351a755c-c884-44c1-96c1-5dac176255f6 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received unexpected event network-vif-unplugged-93016e95-3426-4947-a5da-a37369870ffe for instance with vm_state active and task_state rescuing.
Nov 02 17:54:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:01 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Instance destroyed successfully.
Nov 02 17:54:01 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Attempting a stable device rescue
Nov 02 17:54:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74980) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Instance directory exists: not creating {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 17:54:01 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Creating image(s)
Nov 02 17:54:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "/opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "/opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'trusted_certs' on Instance uuid e4819d7e-1ce3-4202-be42-e20671aa0b42 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "e47126d74b2759440493ff20ef76a023b0c0b4a4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "e47126d74b2759440493ff20ef76a023b0c0b4a4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e47126d74b2759440493ff20ef76a023b0c0b4a4.part --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e47126d74b2759440493ff20ef76a023b0c0b4a4.part --force-share --output=json" returned: 0 in 0.198s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.images [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] dea837f7-9884-43e1-8b25-7740a4f525ca was qcow2, converting to raw {{(pid=74980) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.privsep.utils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74980) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e47126d74b2759440493ff20ef76a023b0c0b4a4.part /opt/stack/data/nova/instances/_base/e47126d74b2759440493ff20ef76a023b0c0b4a4.converted {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e47126d74b2759440493ff20ef76a023b0c0b4a4.part /opt/stack/data/nova/instances/_base/e47126d74b2759440493ff20ef76a023b0c0b4a4.converted" returned: 0 in 0.391s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e47126d74b2759440493ff20ef76a023b0c0b4a4.converted --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:54:03 user nova-compute[74980]: WARNING nova.compute.manager [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received unexpected event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe for instance with vm_state active and task_state rescuing.
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:54:03 user nova-compute[74980]: WARNING nova.compute.manager [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received unexpected event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe for instance with vm_state active and task_state rescuing.
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:54:03 user nova-compute[74980]: WARNING nova.compute.manager [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received unexpected event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe for instance with vm_state active and task_state rescuing.
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-unplugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-unplugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:54:03 user nova-compute[74980]: WARNING nova.compute.manager [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received unexpected event network-vif-unplugged-93016e95-3426-4947-a5da-a37369870ffe for instance with vm_state active and task_state rescuing.
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.compute.manager [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:54:03 user nova-compute[74980]: WARNING nova.compute.manager [req-0d71fec6-e548-4af3-be43-fcdd1cf4d6ef req-9dee950a-9c61-4c2c-a284-d573da1183cd service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received unexpected event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe for instance with vm_state active and task_state rescuing.
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e47126d74b2759440493ff20ef76a023b0c0b4a4.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "e47126d74b2759440493ff20ef76a023b0c0b4a4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.804s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "e47126d74b2759440493ff20ef76a023b0c0b4a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "e47126d74b2759440493ff20ef76a023b0c0b4a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e47126d74b2759440493ff20ef76a023b0c0b4a4 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e47126d74b2759440493ff20ef76a023b0c0b4a4 --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e47126d74b2759440493ff20ef76a023b0c0b4a4,backing_fmt=raw /opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/disk.rescue {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e47126d74b2759440493ff20ef76a023b0c0b4a4,backing_fmt=raw /opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/disk.rescue" returned: 0 in 0.059s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "e47126d74b2759440493ff20ef76a023b0c0b4a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'migration_context' on Instance uuid e4819d7e-1ce3-4202-be42-e20671aa0b42 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.objects.base [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Object Instance<e4819d7e-1ce3-4202-be42-e20671aa0b42> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Start _get_guest_xml network_info=[{"id": "93016e95-3426-4947-a5da-a37369870ffe", "address": "fa:16:3e:d2:ad:f5", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "vif_mac": "fa:16:3e:d2:ad:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93016e95-34", "ovs_interfaceid": "93016e95-3426-4947-a5da-a37369870ffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dea837f7-9884-43e1-8b25-7740a4f525ca', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whxTIJLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e4819d7e-1ce3-4202-be42-e20671aa0b42', 'attached_at': '', 'detached_at': '', 'volume_id': '5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f', 'serial': '5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '35e07e2d-3c83-4381-92a4-6681df746b60', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'resources' on Instance uuid e4819d7e-1ce3-4202-be42-e20671aa0b42 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.objects.base [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Object Instance<e4819d7e-1ce3-4202-be42-e20671aa0b42> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'numa_topology' on Instance uuid e4819d7e-1ce3-4202-be42-e20671aa0b42 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.objects.base [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Object Instance<e4819d7e-1ce3-4202-be42-e20671aa0b42> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:54:03 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:54:03 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:54:03 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4819d7e-1ce3-4202-be42-e20671aa0b42 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG nova.objects.base [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Object Instance<e4819d7e-1ce3-4202-be42-e20671aa0b42> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whxTIJLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:54:04 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:54:04 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:54:04 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd893705-749a-4d89-bc8d-086ab74a3b23]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = whxTIJLD\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 02 17:54:04 user nova-compute[74980]: node.name = iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f
Nov 02 17:54:04 user nova-compute[74980]: node.tpgt = -1
Nov 02 17:54:04 user nova-compute[74980]: node.startup = automatic
Nov 02 17:54:04 user nova-compute[74980]: node.leading_login = No
Nov 02 17:54:04 user nova-compute[74980]: iface.iscsi_ifacename = default
Nov 02 17:54:04 user nova-compute[74980]: iface.net_ifacename = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.ipaddress = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.prefix_len = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.hwaddress = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.transport_name = tcp
Nov 02 17:54:04 user nova-compute[74980]: iface.initiatorname = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.state = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.vlan_id = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.vlan_priority = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.vlan_state = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.iface_num = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.mtu = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.port = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.bootproto = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.subnet_mask = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.gateway = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.dhcp_alt_client_id_state = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.dhcp_alt_client_id = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.dhcp_dns = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.dhcp_learn_iqn = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.dhcp_req_vendor_id_state = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.dhcp_vendor_id_state = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.dhcp_vendor_id = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.dhcp_slp_da = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.fragmentation = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.gratuitous_arp = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.incoming_forwarding = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.tos_state = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.tos = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.ttl = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.delayed_ack = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.tcp_nagle = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.tcp_wsf_state = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.tcp_wsf = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.tcp_timer_scale = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.tcp_timestamp = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.redirect = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.def_task_mgmt_timeout = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.header_digest = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.data_digest = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.immediate_data = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.initial_r2t = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.data_seq_inorder = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.data_pdu_inorder = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.erl = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.max_receive_data_len = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.first_burst_len = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.max_outstanding_r2t = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.max_burst_len = 0
Nov 02 17:54:04 user nova-compute[74980]: iface.chap_auth = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.bidi_chap = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.strict_login_compliance = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.discovery_auth = <empty>
Nov 02 17:54:04 user nova-compute[74980]: iface.discovery_logout = <empty>
Nov 02 17:54:04 user nova-compute[74980]: node.discovery_address = <empty>
Nov 02 17:54:04 user nova-compute[74980]: node.discovery_port = 0
Nov 02 17:54:04 user nova-compute[74980]: node.discovery_type = static
Nov 02 17:54:04 user nova-compute[74980]: node.session.initial_cmdsn = 0
Nov 02 17:54:04 user nova-compute[74980]: node.session.initial_login_retry_max = 8
Nov 02 17:54:04 user nova-compute[74980]: node.session.xmit_thread_priority = -20
Nov 02 17:54:04 user nova-compute[74980]: node.session.cmds_max = 128
Nov 02 17:54:04 user nova-compute[74980]: node.session.queue_depth = 32
Nov 02 17:54:04 user nova-compute[74980]: node.session.nr_sessions = 1
Nov 02 17:54:04 user nova-compute[74980]: node.session.auth.authmethod = CHAP
Nov 02 17:54:04 user nova-compute[74980]: node.session.auth.username = whxTIJLD
Nov 02 17:54:04 user nova-compute[74980]: node.session.auth.password = ***
Nov 02 17:54:04 user nova-compute[74980]: node.session.auth.username_in = <empty>
Nov 02 17:54:04 user nova-compute[74980]: node.session.auth.password_in = <empty>
Nov 02 17:54:04 user nova-compute[74980]: node.session.auth.chap_algs = MD5
Nov 02 17:54:04 user nova-compute[74980]: node.session.timeo.replacement_timeout = 120
Nov 02 17:54:04 user nova-compute[74980]: node.session.err_timeo.abort_timeout = 15
Nov 02 17:54:04 user nova-compute[74980]: node.session.err_timeo.lu_reset_timeout = 30
Nov 02 17:54:04 user nova-compute[74980]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 02 17:54:04 user nova-compute[74980]: node.session.err_timeo.host_reset_timeout = 60
Nov 02 17:54:04 user nova-compute[74980]: node.session.iscsi.FastAbort = Yes
Nov 02 17:54:04 user nova-compute[74980]: node.session.iscsi.InitialR2T = No
Nov 02 17:54:04 user nova-compute[74980]: node.session.iscsi.ImmediateData = Yes
Nov 02 17:54:04 user nova-compute[74980]: node.session.iscsi.FirstBurstLength = 262144
Nov 02 17:54:04 user nova-compute[74980]: node.session.iscsi.MaxBurstLength = 16776192
Nov 02 17:54:04 user nova-compute[74980]: node.session.iscsi.DefaultTime2Retain = 0
Nov 02 17:54:04 user nova-compute[74980]: node.session.iscsi.DefaultTime2Wait = 2
Nov 02 17:54:04 user nova-compute[74980]: node.session.iscsi.MaxConnections = 1
Nov 02 17:54:04 user nova-compute[74980]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 02 17:54:04 user nova-compute[74980]: node.session.iscsi.ERL = 0
Nov 02 17:54:04 user nova-compute[74980]: node.session.scan = manual
Nov 02 17:54:04 user nova-compute[74980]: node.session.reopen_max = 0
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].address = 172.16.0.220
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].port = 3260
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].startup = manual
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].tcp.window_size = 524288
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].tcp.type_of_service = 0
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].timeo.logout_timeout = 15
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].timeo.login_timeout = 15
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].timeo.auth_timeout = 45
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].timeo.noop_out_interval = 5
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].timeo.noop_out_timeout = 5
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].iscsi.HeaderDigest = None
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].iscsi.DataDigest = None
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].iscsi.IFMarker = No
Nov 02 17:54:04 user nova-compute[74980]: node.conn[0].iscsi.OFMarker = No
Nov 02 17:54:04 user nova-compute[74980]: # END RECORD
Nov 02 17:54:04 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.191s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f18220b-1d1d-40f9-a9d0-04ffffe42e85]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.049s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1e7fd2-7fa2-4805-af52-9f73f24d7be2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v whxTIJLD {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v whxTIJLD" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1f2337-edd9-4081-a5c9-91a0e2864556]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'whxTIJLD'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b799240c-a182-4fdd-9762-c20103207b69]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[381525d3-a308-4049-864f-03888f5a350a]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:54:04 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:54:04 user nova-compute[74980]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 (non-flash)
Nov 02 17:54:04 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:54:04 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:54:04 user nova-compute[74980]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 (non-flash)
Nov 02 17:54:04 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] HCTL ('33', '0', '0', 0) found on session 44 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.012s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3a818d-a4a3-4280-ba0e-f4556b949da6]: (4, ('0 0 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Searching for a device in session 44 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whxTIJLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.372s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] <== connect_volume: return (373ms) {'type': 'block', 'scsi_wwn': '23862623039313539', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862623039313539', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-274175433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-274175433',id=42,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:52:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11e1bb23618243ddb099bc6855aa2f64',ramdisk_id='',reservation_id='r-4azmqki5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-36491096',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:52:58Z,user_data=None,user_id='fef01429fb294195984431fd3699f78b',uuid=e4819d7e-1ce3-4202-be42-e20671aa0b42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93016e95-3426-4947-a5da-a37369870ffe", "address": "fa:16:3e:d2:ad:f5", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "vif_mac": "fa:16:3e:d2:ad:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93016e95-34", "ovs_interfaceid": "93016e95-3426-4947-a5da-a37369870ffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converting VIF {"id": "93016e95-3426-4947-a5da-a37369870ffe", "address": "fa:16:3e:d2:ad:f5", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "vif_mac": "fa:16:3e:d2:ad:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93016e95-34", "ovs_interfaceid": "93016e95-3426-4947-a5da-a37369870ffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:ad:f5,bridge_name='br-int',has_traffic_filtering=True,id=93016e95-3426-4947-a5da-a37369870ffe,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93016e95-34') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG nova.objects.instance [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'pci_devices' on Instance uuid e4819d7e-1ce3-4202-be42-e20671aa0b42 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG nova.objects.base [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Object Instance<e4819d7e-1ce3-4202-be42-e20671aa0b42> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74980) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:54:04 user nova-compute[74980]:   <uuid>e4819d7e-1ce3-4202-be42-e20671aa0b42</uuid>
Nov 02 17:54:04 user nova-compute[74980]:   <name>instance-0000002a</name>
Nov 02 17:54:04 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:54:04 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:54:04 user nova-compute[74980]:   <metadata>
Nov 02 17:54:04 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:54:04 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:54:04 user nova-compute[74980]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-274175433</nova:name>
Nov 02 17:54:04 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:54:03</nova:creationTime>
Nov 02 17:54:04 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:54:04 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:54:04 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:54:04 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:54:04 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:54:04 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:54:04 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:54:04 user nova-compute[74980]:       <nova:owner>
Nov 02 17:54:04 user nova-compute[74980]:         <nova:user uuid="fef01429fb294195984431fd3699f78b">tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member</nova:user>
Nov 02 17:54:04 user nova-compute[74980]:         <nova:project uuid="11e1bb23618243ddb099bc6855aa2f64">tempest-ServerBootFromVolumeStableRescueTest-36491096</nova:project>
Nov 02 17:54:04 user nova-compute[74980]:       </nova:owner>
Nov 02 17:54:04 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:54:04 user nova-compute[74980]:       <nova:ports>
Nov 02 17:54:04 user nova-compute[74980]:         <nova:port uuid="93016e95-3426-4947-a5da-a37369870ffe">
Nov 02 17:54:04 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 17:54:04 user nova-compute[74980]:         </nova:port>
Nov 02 17:54:04 user nova-compute[74980]:       </nova:ports>
Nov 02 17:54:04 user nova-compute[74980]:     </nova:instance>
Nov 02 17:54:04 user nova-compute[74980]:   </metadata>
Nov 02 17:54:04 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:54:04 user nova-compute[74980]:     <system>
Nov 02 17:54:04 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:54:04 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:54:04 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:54:04 user nova-compute[74980]:       <entry name="serial">e4819d7e-1ce3-4202-be42-e20671aa0b42</entry>
Nov 02 17:54:04 user nova-compute[74980]:       <entry name="uuid">e4819d7e-1ce3-4202-be42-e20671aa0b42</entry>
Nov 02 17:54:04 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:54:04 user nova-compute[74980]:     </system>
Nov 02 17:54:04 user nova-compute[74980]:   </sysinfo>
Nov 02 17:54:04 user nova-compute[74980]:   <os>
Nov 02 17:54:04 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:54:04 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:54:04 user nova-compute[74980]:   </os>
Nov 02 17:54:04 user nova-compute[74980]:   <features>
Nov 02 17:54:04 user nova-compute[74980]:     <acpi/>
Nov 02 17:54:04 user nova-compute[74980]:     <apic/>
Nov 02 17:54:04 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:54:04 user nova-compute[74980]:   </features>
Nov 02 17:54:04 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:54:04 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:54:04 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:54:04 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:54:04 user nova-compute[74980]:   </clock>
Nov 02 17:54:04 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:54:04 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:54:04 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:54:04 user nova-compute[74980]:   </cpu>
Nov 02 17:54:04 user nova-compute[74980]:   <devices>
Nov 02 17:54:04 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:54:04 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:54:04 user nova-compute[74980]:       <source dev="/dev/sdb"/>
Nov 02 17:54:04 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:54:04 user nova-compute[74980]:       <serial>5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f</serial>
Nov 02 17:54:04 user nova-compute[74980]:     </disk>
Nov 02 17:54:04 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:54:04 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:54:04 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/disk.rescue"/>
Nov 02 17:54:04 user nova-compute[74980]:       <target dev="vdb" bus="virtio"/>
Nov 02 17:54:04 user nova-compute[74980]:       <boot order="1"/>
Nov 02 17:54:04 user nova-compute[74980]:     </disk>
Nov 02 17:54:04 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:54:04 user nova-compute[74980]:       <mac address="fa:16:3e:d2:ad:f5"/>
Nov 02 17:54:04 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:54:04 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:54:04 user nova-compute[74980]:       <target dev="tap93016e95-34"/>
Nov 02 17:54:04 user nova-compute[74980]:     </interface>
Nov 02 17:54:04 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:54:04 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/console.log" append="off"/>
Nov 02 17:54:04 user nova-compute[74980]:     </serial>
Nov 02 17:54:04 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:54:04 user nova-compute[74980]:     <video>
Nov 02 17:54:04 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:54:04 user nova-compute[74980]:     </video>
Nov 02 17:54:04 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:54:04 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:54:04 user nova-compute[74980]:     </rng>
Nov 02 17:54:04 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:54:04 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:54:04 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:54:04 user nova-compute[74980]:     </memballoon>
Nov 02 17:54:04 user nova-compute[74980]:   </devices>
Nov 02 17:54:04 user nova-compute[74980]: </domain>
Nov 02 17:54:04 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:54:04 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Instance destroyed successfully.
Nov 02 17:54:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:54:04 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] No VIF found with MAC fa:16:3e:d2:ad:f5, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:54:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-fa57cece-7760-4b45-bc44-ec40563e148a req-2e9f75f3-5d06-40a9-b1ed-29c1331fd9f3 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:54:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fa57cece-7760-4b45-bc44-ec40563e148a req-2e9f75f3-5d06-40a9-b1ed-29c1331fd9f3 service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fa57cece-7760-4b45-bc44-ec40563e148a req-2e9f75f3-5d06-40a9-b1ed-29c1331fd9f3 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-fa57cece-7760-4b45-bc44-ec40563e148a req-2e9f75f3-5d06-40a9-b1ed-29c1331fd9f3 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-fa57cece-7760-4b45-bc44-ec40563e148a req-2e9f75f3-5d06-40a9-b1ed-29c1331fd9f3 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:54:06 user nova-compute[74980]: WARNING nova.compute.manager [req-fa57cece-7760-4b45-bc44-ec40563e148a req-2e9f75f3-5d06-40a9-b1ed-29c1331fd9f3 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received unexpected event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe for instance with vm_state active and task_state rescuing.
Nov 02 17:54:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:08 user nova-compute[74980]: DEBUG nova.compute.manager [req-dc157dc6-edfa-479f-aa8b-643a6235afa9 req-cb43cb48-453a-4b7e-a7f5-081ece8ecbc0 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:54:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dc157dc6-edfa-479f-aa8b-643a6235afa9 req-cb43cb48-453a-4b7e-a7f5-081ece8ecbc0 service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dc157dc6-edfa-479f-aa8b-643a6235afa9 req-cb43cb48-453a-4b7e-a7f5-081ece8ecbc0 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-dc157dc6-edfa-479f-aa8b-643a6235afa9 req-cb43cb48-453a-4b7e-a7f5-081ece8ecbc0 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:08 user nova-compute[74980]: DEBUG nova.compute.manager [req-dc157dc6-edfa-479f-aa8b-643a6235afa9 req-cb43cb48-453a-4b7e-a7f5-081ece8ecbc0 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:54:08 user nova-compute[74980]: WARNING nova.compute.manager [req-dc157dc6-edfa-479f-aa8b-643a6235afa9 req-cb43cb48-453a-4b7e-a7f5-081ece8ecbc0 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received unexpected event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe for instance with vm_state active and task_state rescuing.
Nov 02 17:54:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-b0c356f8-db55-4eda-abbc-7e9c56584ddb tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:54:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:27 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:54:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:28 user nova-compute[74980]: INFO nova.compute.manager [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Terminating instance
Nov 02 17:54:28 user nova-compute[74980]: DEBUG nova.compute.manager [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG nova.compute.manager [req-5fa960d8-5109-4e57-88b6-b0a30d98f042 req-efff959f-87b8-4a02-a0b6-3c11bf8ba3a5 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-unplugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5fa960d8-5109-4e57-88b6-b0a30d98f042 req-efff959f-87b8-4a02-a0b6-3c11bf8ba3a5 service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5fa960d8-5109-4e57-88b6-b0a30d98f042 req-efff959f-87b8-4a02-a0b6-3c11bf8ba3a5 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5fa960d8-5109-4e57-88b6-b0a30d98f042 req-efff959f-87b8-4a02-a0b6-3c11bf8ba3a5 service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG nova.compute.manager [req-5fa960d8-5109-4e57-88b6-b0a30d98f042 req-efff959f-87b8-4a02-a0b6-3c11bf8ba3a5 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-unplugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG nova.compute.manager [req-5fa960d8-5109-4e57-88b6-b0a30d98f042 req-efff959f-87b8-4a02-a0b6-3c11bf8ba3a5 service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-unplugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:54:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Instance destroyed successfully.
Nov 02 17:54:29 user nova-compute[74980]: DEBUG nova.objects.instance [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'resources' on Instance uuid cfef8d27-a749-4469-912b-b272c0080f03 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-250854749',display_name='tempest-AttachVolumeTestJSON-server-250854749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-250854749',id=39,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6JAtpXxXAMk37Fjkmu/ZPyEKNAoZCsurgqR46mBWz93eP3XOv624lEH1cEe8AD13EovSi2qgytX7qPhQWZ2yoWROF90MH23x4k9KH5UB+HXi+XcSNSHRnM1ZBy5kZltQ==',key_name='tempest-keypair-503867642',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8271dee2adb499dae5bbd63662036e0',ramdisk_id='',reservation_id='r-l2gruwx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847432967',owner_user_name='tempest-AttachVolumeTestJSON-847432967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:52:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dea42f332a54314a6ffc0790bd66240',uuid=cfef8d27-a749-4469-912b-b272c0080f03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converting VIF {"id": "ea0afd21-0732-4572-97d1-63b55c6e5655", "address": "fa:16:3e:d9:e5:54", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea0afd21-07", "ovs_interfaceid": "ea0afd21-0732-4572-97d1-63b55c6e5655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG os_vif [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea0afd21-07, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d619696f-2f9f-4ee8-889a-e52463599fd5) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: INFO os_vif [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:e5:54,bridge_name='br-int',has_traffic_filtering=True,id=ea0afd21-0732-4572-97d1-63b55c6e5655,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea0afd21-07')
Nov 02 17:54:29 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Deleting instance files /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03_del
Nov 02 17:54:29 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Deletion of /opt/stack/data/nova/instances/cfef8d27-a749-4469-912b-b272c0080f03_del complete
Nov 02 17:54:29 user nova-compute[74980]: INFO nova.compute.manager [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 02 17:54:29 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: cfef8d27-a749-4469-912b-b272c0080f03] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:30 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Took 1.15 seconds to deallocate network for instance.
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:54:30 user nova-compute[74980]: WARNING nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received unexpected event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with vm_state deleted and task_state None.
Nov 02 17:54:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:54:30 user nova-compute[74980]: WARNING nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received unexpected event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with vm_state deleted and task_state None.
Nov 02 17:54:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:54:30 user nova-compute[74980]: WARNING nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received unexpected event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with vm_state deleted and task_state None.
Nov 02 17:54:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-unplugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-unplugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:54:30 user nova-compute[74980]: WARNING nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received unexpected event network-vif-unplugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with vm_state deleted and task_state None.
Nov 02 17:54:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] Acquiring lock "cfef8d27-a749-4469-912b-b272c0080f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] Lock "cfef8d27-a749-4469-912b-b272c0080f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] No waiting events found dispatching network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:54:30 user nova-compute[74980]: WARNING nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received unexpected event network-vif-plugged-ea0afd21-0732-4572-97d1-63b55c6e5655 for instance with vm_state deleted and task_state None.
Nov 02 17:54:30 user nova-compute[74980]: DEBUG nova.compute.manager [req-41fb7e4f-1aba-4253-862a-213150ad08a8 req-7e9d1b6d-61fd-4fa6-9c6e-bc64d649798e service nova] [instance: cfef8d27-a749-4469-912b-b272c0080f03] Received event network-vif-deleted-ea0afd21-0732-4572-97d1-63b55c6e5655 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:30 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Deleted allocations for instance cfef8d27-a749-4469-912b-b272c0080f03
Nov 02 17:54:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-47fb4a1d-5000-4c10-9e17-6b0c6413e46c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "cfef8d27-a749-4469-912b-b272c0080f03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.573s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:32 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:54:32 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:54:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:32 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:54:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:54:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:54:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:54:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:54:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:54:34 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:54:34 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:54:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8358MB free_disk=24.84819793701172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:54:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:54:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:54:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance b219f919-44a8-49d1-9b20-36bbb1056120 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:54:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e4819d7e-1ce3-4202-be42-e20671aa0b42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:54:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 3d4f3b83-46ac-4723-b7f0-31c0769ab31e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:54:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:54:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:54:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:34 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:54:34 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:54:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:54:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:37 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:54:37 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:54:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:39 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:54:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:42 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:54:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:45 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:54:45 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:54:45 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 17:54:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:54:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:54:45 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:54:45 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid a1f33052-902f-44ef-b758-67cfc144416c {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:54:45 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Updating instance_info_cache with network_info: [{"id": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "address": "fa:16:3e:7c:b8:1b", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6fd444-02", "ovs_interfaceid": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:54:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:54:46 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:54:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:54:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:54:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:54:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:54:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid a1f33052-902f-44ef-b758-67cfc144416c {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid 6ea56f31-932f-42f8-987c-13ef46d2d9f7 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid b219f919-44a8-49d1-9b20-36bbb1056120 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid e4819d7e-1ce3-4202-be42-e20671aa0b42 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid 3d4f3b83-46ac-4723-b7f0-31c0769ab31e {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "a1f33052-902f-44ef-b758-67cfc144416c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "a1f33052-902f-44ef-b758-67cfc144416c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "b219f919-44a8-49d1-9b20-36bbb1056120" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "b219f919-44a8-49d1-9b20-36bbb1056120" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "a1f33052-902f-44ef-b758-67cfc144416c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "b219f919-44a8-49d1-9b20-36bbb1056120" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:54:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:55:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:15 user nova-compute[74980]: INFO nova.compute.manager [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Terminating instance
Nov 02 17:55:15 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG nova.compute.manager [req-ba2872e4-88d8-42c5-96e1-9d240b4693ec req-0cc09b50-e95c-46f8-9faa-432fb733f0d6 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received event network-vif-unplugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ba2872e4-88d8-42c5-96e1-9d240b4693ec req-0cc09b50-e95c-46f8-9faa-432fb733f0d6 service nova] Acquiring lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ba2872e4-88d8-42c5-96e1-9d240b4693ec req-0cc09b50-e95c-46f8-9faa-432fb733f0d6 service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ba2872e4-88d8-42c5-96e1-9d240b4693ec req-0cc09b50-e95c-46f8-9faa-432fb733f0d6 service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG nova.compute.manager [req-ba2872e4-88d8-42c5-96e1-9d240b4693ec req-0cc09b50-e95c-46f8-9faa-432fb733f0d6 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] No waiting events found dispatching network-vif-unplugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG nova.compute.manager [req-ba2872e4-88d8-42c5-96e1-9d240b4693ec req-0cc09b50-e95c-46f8-9faa-432fb733f0d6 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received event network-vif-unplugged-0cc1bbfd-b848-4519-b244-1ac391ea362d for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:15 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Instance destroyed successfully.
Nov 02 17:55:15 user nova-compute[74980]: DEBUG nova.objects.instance [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lazy-loading 'resources' on Instance uuid 3d4f3b83-46ac-4723-b7f0-31c0769ab31e {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:53:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1998029217',display_name='tempest-TestVolumeBootPattern-server-1998029217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1998029217',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:53:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-58nubt4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:53:56Z,user_data=None,user_id='9b309bc195c84c68a52e095927f874f0',uuid=3d4f3b83-46ac-4723-b7f0-31c0769ab31e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "address": "fa:16:3e:cd:5e:c6", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1bbfd-b8", "ovs_interfaceid": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "address": "fa:16:3e:cd:5e:c6", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cc1bbfd-b8", "ovs_interfaceid": "0cc1bbfd-b848-4519-b244-1ac391ea362d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:5e:c6,bridge_name='br-int',has_traffic_filtering=True,id=0cc1bbfd-b848-4519-b244-1ac391ea362d,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1bbfd-b8') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG os_vif [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:5e:c6,bridge_name='br-int',has_traffic_filtering=True,id=0cc1bbfd-b848-4519-b244-1ac391ea362d,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1bbfd-b8') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cc1bbfd-b8, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8bde4f53-2d3d-44ab-9f04-69d0c91bf23b) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:15 user nova-compute[74980]: INFO os_vif [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:5e:c6,bridge_name='br-int',has_traffic_filtering=True,id=0cc1bbfd-b848-4519-b244-1ac391ea362d,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cc1bbfd-b8')
Nov 02 17:55:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtAHjRnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:55:15 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:55:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc02bca4-c81b-465b-b1a4-9abf3878f99b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ac1578b-6ce5-461c-8be0-4c0e4920cbb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e53d813-02b3-477f-9d70-a4774a9f97fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:55:15 user nova-compute[74980]: No targets found.
Nov 02 17:55:15 user nova-compute[74980]: iSNS:
Nov 02 17:55:15 user nova-compute[74980]: No targets found.
Nov 02 17:55:15 user nova-compute[74980]: STATIC:
Nov 02 17:55:15 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f
Nov 02 17:55:15 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:55:15 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:55:15 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:3ac1578b-6ce5-461c-8be0-4c0e4920cbb4
Nov 02 17:55:15 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:55:15 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:55:15 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30
Nov 02 17:55:15 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:55:15 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:55:15 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187
Nov 02 17:55:15 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:55:15 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:55:15 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:5e53d813-02b3-477f-9d70-a4774a9f97fd
Nov 02 17:55:15 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:55:15 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:55:15 user nova-compute[74980]: FIRMWARE:
Nov 02 17:55:15 user nova-compute[74980]: No targets found.
Nov 02 17:55:15 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:55:15 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:55:15 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae00b83e-0630-4e18-b189-9eca58686948]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ac1578b-6ce5-461c-8be0-4c0e4920cbb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e53d813-02b3-477f-9d70-a4774a9f97fd\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05bf79b-f0a1-4b54-aeec-21bf7b44d154]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e53d813-02b3-477f-9d70-a4774a9f97fd (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac1578b-6ce5-461c-8be0-4c0e4920cbb4 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:55:15 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:55:15 user nova-compute[74980]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 (non-flash)
Nov 02 17:55:15 user nova-compute[74980]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e53d813-02b3-477f-9d70-a4774a9f97fd (non-flash)
Nov 02 17:55:15 user nova-compute[74980]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac1578b-6ce5-461c-8be0-4c0e4920cbb4 (non-flash)
Nov 02 17:55:15 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:55:15 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:55:15 user nova-compute[74980]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 (non-flash)
Nov 02 17:55:15 user nova-compute[74980]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e53d813-02b3-477f-9d70-a4774a9f97fd (non-flash)
Nov 02 17:55:15 user nova-compute[74980]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac1578b-6ce5-461c-8be0-4c0e4920cbb4 (non-flash)
Nov 02 17:55:15 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f599453f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30'): ({'sdc'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Removing single pathed devices sdc {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:55:15 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce40dcf-07af-4775-8146-d1b7c095e95d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.032s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c91ed8e-effe-4da3-952a-b5a3fc40447e]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flushing IO for device /dev/sdc {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d175e290-ab3e-4447-8f90-a970cbeca892]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[77af2e43-cb4f-41a7-a587-aa96ea91a295]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_38c3b91d', '/dev/disk/by-id/scsi-1SCST_BIO38c3b91d-e66ad823efdbcd15', '/dev/disk/by-id/scsi-26536366164383233') {{(pid=86001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 17:55:16 user nova-compute[74980]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_38c3b91d
Nov 02 17:55:16 user nova-compute[74980]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO38c3b91d-e66ad823efdbcd15
Nov 02 17:55:16 user nova-compute[74980]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26536366164383233
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a761aa3-b26f-465d-8b3f-64e7bff9c58f]: (4, None) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8670543-aa05-430e-8322-2d2f74dadb90]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79e242a-9fea-4709-a19c-8703e7541c4a]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30, portal: 172.16.0.220,3260]
Nov 02 17:55:16 user nova-compute[74980]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30, portal: 172.16.0.220,3260] successful.
Nov 02 17:55:16 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac250962-bf2b-4578-9f5b-7b8cf59ef5ce]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== disconnect_volume: return (371ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:55:16 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Deleting instance files /opt/stack/data/nova/instances/3d4f3b83-46ac-4723-b7f0-31c0769ab31e_del
Nov 02 17:55:16 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Deletion of /opt/stack/data/nova/instances/3d4f3b83-46ac-4723-b7f0-31c0769ab31e_del complete
Nov 02 17:55:16 user nova-compute[74980]: INFO nova.compute.manager [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 02 17:55:16 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:55:17 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Took 0.83 seconds to deallocate network for instance.
Nov 02 17:55:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received event network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] Acquiring lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] No waiting events found dispatching network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:55:17 user nova-compute[74980]: WARNING nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received unexpected event network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d for instance with vm_state active and task_state deleting.
Nov 02 17:55:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received event network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] Acquiring lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] No waiting events found dispatching network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:55:17 user nova-compute[74980]: WARNING nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received unexpected event network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d for instance with vm_state active and task_state deleting.
Nov 02 17:55:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received event network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] Acquiring lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] No waiting events found dispatching network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:55:17 user nova-compute[74980]: WARNING nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received unexpected event network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d for instance with vm_state active and task_state deleting.
Nov 02 17:55:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received event network-vif-unplugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] Acquiring lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] No waiting events found dispatching network-vif-unplugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received event network-vif-unplugged-0cc1bbfd-b848-4519-b244-1ac391ea362d for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received event network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] Acquiring lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] No waiting events found dispatching network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:55:17 user nova-compute[74980]: WARNING nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received unexpected event network-vif-plugged-0cc1bbfd-b848-4519-b244-1ac391ea362d for instance with vm_state active and task_state deleting.
Nov 02 17:55:17 user nova-compute[74980]: DEBUG nova.compute.manager [req-da52a777-9627-4c81-a2b1-2cee2cb76227 req-96346ae3-2b37-4f8c-91ac-599770a2ba29 service nova] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Received event network-vif-deleted-0cc1bbfd-b848-4519-b244-1ac391ea362d {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:55:18 user nova-compute[74980]: INFO nova.compute.manager [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Took 0.96 seconds to detach 1 volumes for instance.
Nov 02 17:55:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 3d4f3b83-46ac-4723-b7f0-31c0769ab31e] Deleting volume: 3dec4d33-33ff-4b6e-9e03-c6a5af95ef30 {{(pid=74980) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 17:55:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:18 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:55:18 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:55:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:18 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Deleted allocations for instance 3d4f3b83-46ac-4723-b7f0-31c0769ab31e
Nov 02 17:55:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d287d966-3ea6-4842-8ee5-b63ac7bfb84d tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "3d4f3b83-46ac-4723-b7f0-31c0769ab31e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.509s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:55:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:22 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:55:22 user nova-compute[74980]: INFO nova.compute.claims [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Claim successful on node user
Nov 02 17:55:22 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:55:23 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:55:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG nova.policy [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dea42f332a54314a6ffc0790bd66240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8271dee2adb499dae5bbd63662036e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:55:23 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Creating image(s)
Nov 02 17:55:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "/opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "/opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.167s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk 1073741824" returned: 0 in 0.054s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:23 user nova-compute[74980]: DEBUG nova.network.neutron [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Successfully created port: 80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:55:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.193s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:24 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 17:55:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:24 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Cannot resize image /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 17:55:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 17:55:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Ensure instance console log exists: /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:55:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:24 user nova-compute[74980]: DEBUG nova.network.neutron [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Successfully updated port: 80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "refresh_cache-c5d05f2c-89ab-4b7c-9919-09f99711971a" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquired lock "refresh_cache-c5d05f2c-89ab-4b7c-9919-09f99711971a" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.network.neutron [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-a5b5600b-2c8e-4f15-a538-25676bf8dae5 req-ed65d197-f80d-413a-ad5f-255d1e0ccee9 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received event network-changed-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.compute.manager [req-a5b5600b-2c8e-4f15-a538-25676bf8dae5 req-ed65d197-f80d-413a-ad5f-255d1e0ccee9 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Refreshing instance network info cache due to event network-changed-80e69c2d-d566-4b77-bceb-fa2560c841e1. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a5b5600b-2c8e-4f15-a538-25676bf8dae5 req-ed65d197-f80d-413a-ad5f-255d1e0ccee9 service nova] Acquiring lock "refresh_cache-c5d05f2c-89ab-4b7c-9919-09f99711971a" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.network.neutron [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.network.neutron [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Updating instance_info_cache with network_info: [{"id": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "address": "fa:16:3e:17:14:8f", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e69c2d-d5", "ovs_interfaceid": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Releasing lock "refresh_cache-c5d05f2c-89ab-4b7c-9919-09f99711971a" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.compute.manager [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Instance network_info: |[{"id": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "address": "fa:16:3e:17:14:8f", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e69c2d-d5", "ovs_interfaceid": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a5b5600b-2c8e-4f15-a538-25676bf8dae5 req-ed65d197-f80d-413a-ad5f-255d1e0ccee9 service nova] Acquired lock "refresh_cache-c5d05f2c-89ab-4b7c-9919-09f99711971a" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.network.neutron [req-a5b5600b-2c8e-4f15-a538-25676bf8dae5 req-ed65d197-f80d-413a-ad5f-255d1e0ccee9 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Refreshing network info cache for port 80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Start _get_guest_xml network_info=[{"id": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "address": "fa:16:3e:17:14:8f", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e69c2d-d5", "ovs_interfaceid": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:55:25 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:55:25 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1991154766',display_name='tempest-AttachVolumeTestJSON-server-1991154766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1991154766',id=44,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA61GfL1H38rFu0y7iZ/50Z78oaDee/cEhZgYycU5C5gO8Bv4sWiBEBgLlIlKH2VYQhwcMgDrD/caSha4bH9zG+eKu3P3edCG/JN2e0gZkwvWq8FuluXgBrJ1e+CyH/2SA==',key_name='tempest-keypair-1300994011',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8271dee2adb499dae5bbd63662036e0',ramdisk_id='',reservation_id='r-sr0it5j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-847432967',owner_user_name='tempest-AttachVolumeTestJSON-847432967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:55:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dea42f332a54314a6ffc0790bd66240',uuid=c5d05f2c-89ab-4b7c-9919-09f99711971a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "address": "fa:16:3e:17:14:8f", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e69c2d-d5", "ovs_interfaceid": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converting VIF {"id": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "address": "fa:16:3e:17:14:8f", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e69c2d-d5", "ovs_interfaceid": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:14:8f,bridge_name='br-int',has_traffic_filtering=True,id=80e69c2d-d566-4b77-bceb-fa2560c841e1,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e69c2d-d5') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.objects.instance [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'pci_devices' on Instance uuid c5d05f2c-89ab-4b7c-9919-09f99711971a {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:55:25 user nova-compute[74980]:   <uuid>c5d05f2c-89ab-4b7c-9919-09f99711971a</uuid>
Nov 02 17:55:25 user nova-compute[74980]:   <name>instance-0000002c</name>
Nov 02 17:55:25 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:55:25 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:55:25 user nova-compute[74980]:   <metadata>
Nov 02 17:55:25 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:55:25 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:55:25 user nova-compute[74980]:       <nova:name>tempest-AttachVolumeTestJSON-server-1991154766</nova:name>
Nov 02 17:55:25 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:55:25</nova:creationTime>
Nov 02 17:55:25 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:55:25 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:55:25 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:55:25 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:55:25 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:55:25 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:55:25 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:55:25 user nova-compute[74980]:       <nova:owner>
Nov 02 17:55:25 user nova-compute[74980]:         <nova:user uuid="3dea42f332a54314a6ffc0790bd66240">tempest-AttachVolumeTestJSON-847432967-project-member</nova:user>
Nov 02 17:55:25 user nova-compute[74980]:         <nova:project uuid="d8271dee2adb499dae5bbd63662036e0">tempest-AttachVolumeTestJSON-847432967</nova:project>
Nov 02 17:55:25 user nova-compute[74980]:       </nova:owner>
Nov 02 17:55:25 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 17:55:25 user nova-compute[74980]:       <nova:ports>
Nov 02 17:55:25 user nova-compute[74980]:         <nova:port uuid="80e69c2d-d566-4b77-bceb-fa2560c841e1">
Nov 02 17:55:25 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 17:55:25 user nova-compute[74980]:         </nova:port>
Nov 02 17:55:25 user nova-compute[74980]:       </nova:ports>
Nov 02 17:55:25 user nova-compute[74980]:     </nova:instance>
Nov 02 17:55:25 user nova-compute[74980]:   </metadata>
Nov 02 17:55:25 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:55:25 user nova-compute[74980]:     <system>
Nov 02 17:55:25 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:55:25 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:55:25 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:55:25 user nova-compute[74980]:       <entry name="serial">c5d05f2c-89ab-4b7c-9919-09f99711971a</entry>
Nov 02 17:55:25 user nova-compute[74980]:       <entry name="uuid">c5d05f2c-89ab-4b7c-9919-09f99711971a</entry>
Nov 02 17:55:25 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:55:25 user nova-compute[74980]:     </system>
Nov 02 17:55:25 user nova-compute[74980]:   </sysinfo>
Nov 02 17:55:25 user nova-compute[74980]:   <os>
Nov 02 17:55:25 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:55:25 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:55:25 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:55:25 user nova-compute[74980]:   </os>
Nov 02 17:55:25 user nova-compute[74980]:   <features>
Nov 02 17:55:25 user nova-compute[74980]:     <acpi/>
Nov 02 17:55:25 user nova-compute[74980]:     <apic/>
Nov 02 17:55:25 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:55:25 user nova-compute[74980]:   </features>
Nov 02 17:55:25 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:55:25 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:55:25 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:55:25 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:55:25 user nova-compute[74980]:   </clock>
Nov 02 17:55:25 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:55:25 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:55:25 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:55:25 user nova-compute[74980]:   </cpu>
Nov 02 17:55:25 user nova-compute[74980]:   <devices>
Nov 02 17:55:25 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 17:55:25 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 17:55:25 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk"/>
Nov 02 17:55:25 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:55:25 user nova-compute[74980]:     </disk>
Nov 02 17:55:25 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:55:25 user nova-compute[74980]:       <mac address="fa:16:3e:17:14:8f"/>
Nov 02 17:55:25 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:55:25 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:55:25 user nova-compute[74980]:       <target dev="tap80e69c2d-d5"/>
Nov 02 17:55:25 user nova-compute[74980]:     </interface>
Nov 02 17:55:25 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:55:25 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/console.log" append="off"/>
Nov 02 17:55:25 user nova-compute[74980]:     </serial>
Nov 02 17:55:25 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:55:25 user nova-compute[74980]:     <video>
Nov 02 17:55:25 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:55:25 user nova-compute[74980]:     </video>
Nov 02 17:55:25 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:55:25 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:55:25 user nova-compute[74980]:     </rng>
Nov 02 17:55:25 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:55:25 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:55:25 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:55:25 user nova-compute[74980]:     </memballoon>
Nov 02 17:55:25 user nova-compute[74980]:   </devices>
Nov 02 17:55:25 user nova-compute[74980]: </domain>
Nov 02 17:55:25 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1991154766',display_name='tempest-AttachVolumeTestJSON-server-1991154766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1991154766',id=44,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA61GfL1H38rFu0y7iZ/50Z78oaDee/cEhZgYycU5C5gO8Bv4sWiBEBgLlIlKH2VYQhwcMgDrD/caSha4bH9zG+eKu3P3edCG/JN2e0gZkwvWq8FuluXgBrJ1e+CyH/2SA==',key_name='tempest-keypair-1300994011',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8271dee2adb499dae5bbd63662036e0',ramdisk_id='',reservation_id='r-sr0it5j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-847432967',owner_user_name='tempest-AttachVolumeTestJSON-847432967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:55:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dea42f332a54314a6ffc0790bd66240',uuid=c5d05f2c-89ab-4b7c-9919-09f99711971a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "address": "fa:16:3e:17:14:8f", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e69c2d-d5", "ovs_interfaceid": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converting VIF {"id": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "address": "fa:16:3e:17:14:8f", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e69c2d-d5", "ovs_interfaceid": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:14:8f,bridge_name='br-int',has_traffic_filtering=True,id=80e69c2d-d566-4b77-bceb-fa2560c841e1,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e69c2d-d5') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG os_vif [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:14:8f,bridge_name='br-int',has_traffic_filtering=True,id=80e69c2d-d566-4b77-bceb-fa2560c841e1,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e69c2d-d5') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94f6a737-68a4-5944-b0eb-7e398b31740d', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80e69c2d-d5, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80e69c2d-d5, col_values=(('qos', UUID('d7dae3c0-dd1c-48a0-8d8c-a7e5bfb8b126')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80e69c2d-d5, col_values=(('external_ids', {'iface-id': '80e69c2d-d566-4b77-bceb-fa2560c841e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:14:8f', 'vm-uuid': 'c5d05f2c-89ab-4b7c-9919-09f99711971a'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:25 user nova-compute[74980]: INFO os_vif [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:14:8f,bridge_name='br-int',has_traffic_filtering=True,id=80e69c2d-d566-4b77-bceb-fa2560c841e1,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e69c2d-d5')
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:55:25 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] No VIF found with MAC fa:16:3e:17:14:8f, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:55:26 user nova-compute[74980]: DEBUG nova.network.neutron [req-a5b5600b-2c8e-4f15-a538-25676bf8dae5 req-ed65d197-f80d-413a-ad5f-255d1e0ccee9 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Updated VIF entry in instance network info cache for port 80e69c2d-d566-4b77-bceb-fa2560c841e1. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:55:26 user nova-compute[74980]: DEBUG nova.network.neutron [req-a5b5600b-2c8e-4f15-a538-25676bf8dae5 req-ed65d197-f80d-413a-ad5f-255d1e0ccee9 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Updating instance_info_cache with network_info: [{"id": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "address": "fa:16:3e:17:14:8f", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e69c2d-d5", "ovs_interfaceid": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:55:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a5b5600b-2c8e-4f15-a538-25676bf8dae5 req-ed65d197-f80d-413a-ad5f-255d1e0ccee9 service nova] Releasing lock "refresh_cache-c5d05f2c-89ab-4b7c-9919-09f99711971a" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:55:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:27 user nova-compute[74980]: DEBUG nova.compute.manager [req-5de1815d-525b-4a0d-a533-edc54370576f req-61195202-aeb9-46ca-9ce4-ccf1f20e23b4 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received event network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:55:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5de1815d-525b-4a0d-a533-edc54370576f req-61195202-aeb9-46ca-9ce4-ccf1f20e23b4 service nova] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5de1815d-525b-4a0d-a533-edc54370576f req-61195202-aeb9-46ca-9ce4-ccf1f20e23b4 service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:27 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5de1815d-525b-4a0d-a533-edc54370576f req-61195202-aeb9-46ca-9ce4-ccf1f20e23b4 service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:27 user nova-compute[74980]: DEBUG nova.compute.manager [req-5de1815d-525b-4a0d-a533-edc54370576f req-61195202-aeb9-46ca-9ce4-ccf1f20e23b4 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] No waiting events found dispatching network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:55:27 user nova-compute[74980]: WARNING nova.compute.manager [req-5de1815d-525b-4a0d-a533-edc54370576f req-61195202-aeb9-46ca-9ce4-ccf1f20e23b4 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received unexpected event network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 for instance with vm_state building and task_state spawning.
Nov 02 17:55:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:29 user nova-compute[74980]: DEBUG nova.compute.manager [req-08ab7c6e-28ea-4358-a376-9603fc025bf1 req-2346d5bf-d94d-4c17-90bc-3e0cc758e25b service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received event network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:55:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-08ab7c6e-28ea-4358-a376-9603fc025bf1 req-2346d5bf-d94d-4c17-90bc-3e0cc758e25b service nova] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-08ab7c6e-28ea-4358-a376-9603fc025bf1 req-2346d5bf-d94d-4c17-90bc-3e0cc758e25b service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-08ab7c6e-28ea-4358-a376-9603fc025bf1 req-2346d5bf-d94d-4c17-90bc-3e0cc758e25b service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:29 user nova-compute[74980]: DEBUG nova.compute.manager [req-08ab7c6e-28ea-4358-a376-9603fc025bf1 req-2346d5bf-d94d-4c17-90bc-3e0cc758e25b service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] No waiting events found dispatching network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:55:29 user nova-compute[74980]: WARNING nova.compute.manager [req-08ab7c6e-28ea-4358-a376-9603fc025bf1 req-2346d5bf-d94d-4c17-90bc-3e0cc758e25b service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received unexpected event network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 for instance with vm_state building and task_state spawning.
Nov 02 17:55:29 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:55:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:55:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:55:29 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Instance spawned successfully.
Nov 02 17:55:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:55:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:55:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:55:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:55:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:55:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:55:29 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:55:29 user nova-compute[74980]: INFO nova.compute.manager [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Took 6.48 seconds to spawn the instance on the hypervisor.
Nov 02 17:55:29 user nova-compute[74980]: DEBUG nova.compute.manager [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:55:29 user nova-compute[74980]: INFO nova.compute.manager [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Took 7.27 seconds to build instance.
Nov 02 17:55:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e0bd8eb7-ef1f-4cad-af84-b370dad184c9 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.386s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:30 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:55:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:32 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:55:32 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:55:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:32 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:55:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:55:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/disk.rescue --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:55:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:55:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:55:34 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:55:34 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:55:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8536MB free_disk=24.844791412353516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:55:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:55:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:55:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance b219f919-44a8-49d1-9b20-36bbb1056120 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:55:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e4819d7e-1ce3-4202-be42-e20671aa0b42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:55:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c5d05f2c-89ab-4b7c-9919-09f99711971a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:55:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:55:34 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:55:35 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:55:35 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:55:35 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:55:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:55:36 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:55:36 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:55:36 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:55:40 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:55:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:55:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:55:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:55:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:55:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:55:42 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:55:42 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:55:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:46 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:55:46 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:55:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:55:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:55:46 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:55:47 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Updating instance_info_cache with network_info: [{"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:55:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-6ea56f31-932f-42f8-987c-13ef46d2d9f7" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:55:47 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:55:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:51 user nova-compute[74980]: INFO nova.compute.manager [None req-a9cf7ddf-c790-465f-8c9b-87c335f5e9c5 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Unrescuing
Nov 02 17:55:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a9cf7ddf-c790-465f-8c9b-87c335f5e9c5 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "refresh_cache-e4819d7e-1ce3-4202-be42-e20671aa0b42" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:55:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a9cf7ddf-c790-465f-8c9b-87c335f5e9c5 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquired lock "refresh_cache-e4819d7e-1ce3-4202-be42-e20671aa0b42" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:55:51 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a9cf7ddf-c790-465f-8c9b-87c335f5e9c5 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:55:51 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a9cf7ddf-c790-465f-8c9b-87c335f5e9c5 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Updating instance_info_cache with network_info: [{"id": "93016e95-3426-4947-a5da-a37369870ffe", "address": "fa:16:3e:d2:ad:f5", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93016e95-34", "ovs_interfaceid": "93016e95-3426-4947-a5da-a37369870ffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:55:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a9cf7ddf-c790-465f-8c9b-87c335f5e9c5 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Releasing lock "refresh_cache-e4819d7e-1ce3-4202-be42-e20671aa0b42" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:55:51 user nova-compute[74980]: DEBUG nova.objects.instance [None req-a9cf7ddf-c790-465f-8c9b-87c335f5e9c5 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'flavor' on Instance uuid e4819d7e-1ce3-4202-be42-e20671aa0b42 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:55:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-2ccd3dc6-2ace-4628-9b0e-6289d5eb65c5 req-b6fca572-e265-47f8-92e5-69cd349b744d service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-unplugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:55:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2ccd3dc6-2ace-4628-9b0e-6289d5eb65c5 req-b6fca572-e265-47f8-92e5-69cd349b744d service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2ccd3dc6-2ace-4628-9b0e-6289d5eb65c5 req-b6fca572-e265-47f8-92e5-69cd349b744d service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2ccd3dc6-2ace-4628-9b0e-6289d5eb65c5 req-b6fca572-e265-47f8-92e5-69cd349b744d service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-2ccd3dc6-2ace-4628-9b0e-6289d5eb65c5 req-b6fca572-e265-47f8-92e5-69cd349b744d service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-unplugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:55:52 user nova-compute[74980]: WARNING nova.compute.manager [req-2ccd3dc6-2ace-4628-9b0e-6289d5eb65c5 req-b6fca572-e265-47f8-92e5-69cd349b744d service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received unexpected event network-vif-unplugged-93016e95-3426-4947-a5da-a37369870ffe for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:55:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:52 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Instance destroyed successfully.
Nov 02 17:55:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-4622ef1a-fed9-43a6-9601-50af20d47faf req-8bb76859-f39e-48e5-8594-0b10e9e70dea service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:55:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4622ef1a-fed9-43a6-9601-50af20d47faf req-8bb76859-f39e-48e5-8594-0b10e9e70dea service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4622ef1a-fed9-43a6-9601-50af20d47faf req-8bb76859-f39e-48e5-8594-0b10e9e70dea service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4622ef1a-fed9-43a6-9601-50af20d47faf req-8bb76859-f39e-48e5-8594-0b10e9e70dea service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-4622ef1a-fed9-43a6-9601-50af20d47faf req-8bb76859-f39e-48e5-8594-0b10e9e70dea service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:55:54 user nova-compute[74980]: WARNING nova.compute.manager [req-4622ef1a-fed9-43a6-9601-50af20d47faf req-8bb76859-f39e-48e5-8594-0b10e9e70dea service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received unexpected event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:55:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-4622ef1a-fed9-43a6-9601-50af20d47faf req-8bb76859-f39e-48e5-8594-0b10e9e70dea service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:55:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4622ef1a-fed9-43a6-9601-50af20d47faf req-8bb76859-f39e-48e5-8594-0b10e9e70dea service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4622ef1a-fed9-43a6-9601-50af20d47faf req-8bb76859-f39e-48e5-8594-0b10e9e70dea service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4622ef1a-fed9-43a6-9601-50af20d47faf req-8bb76859-f39e-48e5-8594-0b10e9e70dea service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-4622ef1a-fed9-43a6-9601-50af20d47faf req-8bb76859-f39e-48e5-8594-0b10e9e70dea service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:55:54 user nova-compute[74980]: WARNING nova.compute.manager [req-4622ef1a-fed9-43a6-9601-50af20d47faf req-8bb76859-f39e-48e5-8594-0b10e9e70dea service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received unexpected event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe for instance with vm_state rescued and task_state unrescuing.
Nov 02 17:55:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:55:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a9cf7ddf-c790-465f-8c9b-87c335f5e9c5 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:55:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-226939bb-33f7-4ec7-a569-5e7c805fb1e9 req-0e20c9ac-c400-4d0c-9066-25bd9e70e555 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:55:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-226939bb-33f7-4ec7-a569-5e7c805fb1e9 req-0e20c9ac-c400-4d0c-9066-25bd9e70e555 service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:55:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-226939bb-33f7-4ec7-a569-5e7c805fb1e9 req-0e20c9ac-c400-4d0c-9066-25bd9e70e555 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:55:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-226939bb-33f7-4ec7-a569-5e7c805fb1e9 req-0e20c9ac-c400-4d0c-9066-25bd9e70e555 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:55:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-226939bb-33f7-4ec7-a569-5e7c805fb1e9 req-0e20c9ac-c400-4d0c-9066-25bd9e70e555 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:55:56 user nova-compute[74980]: WARNING nova.compute.manager [req-226939bb-33f7-4ec7-a569-5e7c805fb1e9 req-0e20c9ac-c400-4d0c-9066-25bd9e70e555 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received unexpected event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe for instance with vm_state active and task_state None.
Nov 02 17:56:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:56:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:56:31 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:56:32 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:56:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:56:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:56:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:56:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:56:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:56:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:56:33 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:56:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:56:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:56:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:56:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:56:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:56:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:56:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:56:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:56:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:56:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:56:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:56:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:56:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:56:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:56:35 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:56:35 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:56:35 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8446MB free_disk=24.808116912841797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance b219f919-44a8-49d1-9b20-36bbb1056120 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e4819d7e-1ce3-4202-be42-e20671aa0b42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c5d05f2c-89ab-4b7c-9919-09f99711971a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:56:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:39 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:56:39 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:56:40 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:56:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:56:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:56:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:56:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:56:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:44 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:56:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:56:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:56:46 user nova-compute[74980]: DEBUG nova.compute.manager [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:56:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:56:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:56:46 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:56:46 user nova-compute[74980]: INFO nova.compute.claims [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Claim successful on node user
Nov 02 17:56:46 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:56:46 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:56:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:56:46 user nova-compute[74980]: DEBUG nova.compute.manager [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG nova.compute.manager [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG nova.network.neutron [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:56:47 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:56:47 user nova-compute[74980]: DEBUG nova.compute.manager [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:56:47 user nova-compute[74980]: INFO nova.virt.block_device [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Booting with volume db4e1993-6de1-41df-82ab-43b1b1ade12d at /dev/vda
Nov 02 17:56:47 user nova-compute[74980]: DEBUG nova.policy [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b309bc195c84c68a52e095927f874f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84de25c95ef24520aa7c06012991dd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG os_brick.utils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6bc076-7935-4096-92c3-fbebe7b93ad4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9af0222-42e1-4246-829d-f91495049008]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a356f6-2596-4bff-89da-8375622ad603]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a4ac48-11af-4d3d-9d15-23e099673c40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:56:47 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fc6b91-eedb-4a62-8fd6-fbb2889619e8]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG os_brick.utils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Updating existing volume attachment record: fc6bbdd7-ea6a-4400-b7b3-ff4246210bda {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-b219f919-44a8-49d1-9b20-36bbb1056120" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-b219f919-44a8-49d1-9b20-36bbb1056120" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG nova.network.neutron [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Successfully created port: 61ccb3b9-dca8-49af-a15e-719e21bacde5 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Updating instance_info_cache with network_info: [{"id": "00f75489-496c-4666-a645-0dacdcadcc02", "address": "fa:16:3e:cc:e6:cc", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f75489-49", "ovs_interfaceid": "00f75489-496c-4666-a645-0dacdcadcc02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-b219f919-44a8-49d1-9b20-36bbb1056120" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:56:47 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:56:48 user nova-compute[74980]: DEBUG nova.network.neutron [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Successfully updated port: 61ccb3b9-dca8-49af-a15e-719e21bacde5 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:56:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "refresh_cache-9d824cd1-a689-445c-a1a7-ee08c3dda81b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:56:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquired lock "refresh_cache-9d824cd1-a689-445c-a1a7-ee08c3dda81b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:56:48 user nova-compute[74980]: DEBUG nova.network.neutron [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:56:48 user nova-compute[74980]: DEBUG nova.compute.manager [req-112b71e3-efd0-4b4b-adf8-d9dc343b9738 req-c5cb8aaa-ea9f-4721-9c94-447b9ac246d0 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Received event network-changed-61ccb3b9-dca8-49af-a15e-719e21bacde5 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:56:48 user nova-compute[74980]: DEBUG nova.compute.manager [req-112b71e3-efd0-4b4b-adf8-d9dc343b9738 req-c5cb8aaa-ea9f-4721-9c94-447b9ac246d0 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Refreshing instance network info cache due to event network-changed-61ccb3b9-dca8-49af-a15e-719e21bacde5. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:56:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-112b71e3-efd0-4b4b-adf8-d9dc343b9738 req-c5cb8aaa-ea9f-4721-9c94-447b9ac246d0 service nova] Acquiring lock "refresh_cache-9d824cd1-a689-445c-a1a7-ee08c3dda81b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:56:48 user nova-compute[74980]: DEBUG nova.network.neutron [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:56:48 user nova-compute[74980]: DEBUG nova.network.neutron [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Updating instance_info_cache with network_info: [{"id": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "address": "fa:16:3e:5a:c6:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ccb3b9-dc", "ovs_interfaceid": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:56:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Releasing lock "refresh_cache-9d824cd1-a689-445c-a1a7-ee08c3dda81b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:56:48 user nova-compute[74980]: DEBUG nova.compute.manager [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Instance network_info: |[{"id": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "address": "fa:16:3e:5a:c6:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ccb3b9-dc", "ovs_interfaceid": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:56:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-112b71e3-efd0-4b4b-adf8-d9dc343b9738 req-c5cb8aaa-ea9f-4721-9c94-447b9ac246d0 service nova] Acquired lock "refresh_cache-9d824cd1-a689-445c-a1a7-ee08c3dda81b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:56:48 user nova-compute[74980]: DEBUG nova.network.neutron [req-112b71e3-efd0-4b4b-adf8-d9dc343b9738 req-c5cb8aaa-ea9f-4721-9c94-447b9ac246d0 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Refreshing network info cache for port 61ccb3b9-dca8-49af-a15e-719e21bacde5 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:56:49 user nova-compute[74980]: DEBUG nova.network.neutron [req-112b71e3-efd0-4b4b-adf8-d9dc343b9738 req-c5cb8aaa-ea9f-4721-9c94-447b9ac246d0 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Updated VIF entry in instance network info cache for port 61ccb3b9-dca8-49af-a15e-719e21bacde5. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:56:49 user nova-compute[74980]: DEBUG nova.network.neutron [req-112b71e3-efd0-4b4b-adf8-d9dc343b9738 req-c5cb8aaa-ea9f-4721-9c94-447b9ac246d0 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Updating instance_info_cache with network_info: [{"id": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "address": "fa:16:3e:5a:c6:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ccb3b9-dc", "ovs_interfaceid": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:56:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-112b71e3-efd0-4b4b-adf8-d9dc343b9738 req-c5cb8aaa-ea9f-4721-9c94-447b9ac246d0 service nova] Releasing lock "refresh_cache-9d824cd1-a689-445c-a1a7-ee08c3dda81b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:56:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:56:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:56:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:56:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:56:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:56:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:56:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:56:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:56:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:56:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:56:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:57:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Creating image(s)
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Ensure instance console log exists: /opt/stack/data/nova/instances/9d824cd1-a689-445c-a1a7-ee08c3dda81b/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Start _get_guest_xml network_info=[{"id": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "address": "fa:16:3e:5a:c6:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ccb3b9-dc", "ovs_interfaceid": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfImBGcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9d824cd1-a689-445c-a1a7-ee08c3dda81b', 'attached_at': '', 'detached_at': '', 'volume_id': 'db4e1993-6de1-41df-82ab-43b1b1ade12d', 'serial': 'db4e1993-6de1-41df-82ab-43b1b1ade12d'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'fc6bbdd7-ea6a-4400-b7b3-ff4246210bda', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:57:06 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:57:06 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfImBGcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:57:06 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:57:06 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:57:06 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bb831f-91a1-42e0-a609-128beb08a0a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:57:06 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec072bb1-894b-4d04-ae16-935a20e245b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d] added
Nov 02 17:57:06 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4534db93-2cd2-4b1c-a5dd-e2f2d0f53ed3]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff91bbb8-f395-49b1-8878-2adf9f5a7391]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hfImBGcr {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hfImBGcr" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f022ea8f-1a30-49a0-a392-01eb8e5c2c92]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hfImBGcr'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[886cf0b9-1bfd-4919-bb3a-6eadad0ab809]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f2ec30-360e-4e5f-9de0-06a8ce6b344a]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:57:06 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:57:06 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:57:06 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:57:06 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0922f793-718d-4776-9428-8294bfcee5bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d, portal: 172.16.0.220,3260]
Nov 02 17:57:06 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d, portal: 172.16.0.220,3260] successful.
Nov 02 17:57:06 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e7f0f5-c209-4ccb-b2dc-29a9f8838222]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f10f94-5d78-4303-b993-a5d0eef165c6]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:57:06 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:57:06 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:57:06 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:57:06 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:57:06 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:57:06 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:57:06 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:57:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcfad9a-4797-442d-ab25-6407e11e1656]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:07 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfImBGcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23337343430613830', 'path': '/dev/sdc'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337343430613830', 'path': '/dev/sdc'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:56:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1571384647',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1571384647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1571384647',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8tR5q470TKj+pGoRDdXv8Q99CS/D2aIzjsMdcF2iz+pxW4ejWtjdC9leH8HqGFLK4SK4JUNVh/ij0BCXZVv7IzZQZv2lSKJkN+2zfOOH0+i2z5ejMK6fcQU61V4/NKpg==',key_name='tempest-keypair-1504017220',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-zupwxft0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:56:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b309bc195c84c68a52e095927f874f0',uuid=9d824cd1-a689-445c-a1a7-ee08c3dda81b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "address": "fa:16:3e:5a:c6:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ccb3b9-dc", "ovs_interfaceid": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "address": "fa:16:3e:5a:c6:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ccb3b9-dc", "ovs_interfaceid": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c6:41,bridge_name='br-int',has_traffic_filtering=True,id=61ccb3b9-dca8-49af-a15e-719e21bacde5,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ccb3b9-dc') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG nova.objects.instance [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d824cd1-a689-445c-a1a7-ee08c3dda81b {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:57:08 user nova-compute[74980]:   <uuid>9d824cd1-a689-445c-a1a7-ee08c3dda81b</uuid>
Nov 02 17:57:08 user nova-compute[74980]:   <name>instance-0000002d</name>
Nov 02 17:57:08 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:57:08 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:57:08 user nova-compute[74980]:   <metadata>
Nov 02 17:57:08 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:57:08 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:57:08 user nova-compute[74980]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1571384647</nova:name>
Nov 02 17:57:08 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:57:06</nova:creationTime>
Nov 02 17:57:08 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:57:08 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:57:08 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:57:08 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:57:08 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:57:08 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:57:08 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:57:08 user nova-compute[74980]:       <nova:owner>
Nov 02 17:57:08 user nova-compute[74980]:         <nova:user uuid="9b309bc195c84c68a52e095927f874f0">tempest-TestVolumeBootPattern-352919040-project-member</nova:user>
Nov 02 17:57:08 user nova-compute[74980]:         <nova:project uuid="84de25c95ef24520aa7c06012991dd97">tempest-TestVolumeBootPattern-352919040</nova:project>
Nov 02 17:57:08 user nova-compute[74980]:       </nova:owner>
Nov 02 17:57:08 user nova-compute[74980]:       <nova:ports>
Nov 02 17:57:08 user nova-compute[74980]:         <nova:port uuid="61ccb3b9-dca8-49af-a15e-719e21bacde5">
Nov 02 17:57:08 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 17:57:08 user nova-compute[74980]:         </nova:port>
Nov 02 17:57:08 user nova-compute[74980]:       </nova:ports>
Nov 02 17:57:08 user nova-compute[74980]:     </nova:instance>
Nov 02 17:57:08 user nova-compute[74980]:   </metadata>
Nov 02 17:57:08 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:57:08 user nova-compute[74980]:     <system>
Nov 02 17:57:08 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:57:08 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:57:08 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:57:08 user nova-compute[74980]:       <entry name="serial">9d824cd1-a689-445c-a1a7-ee08c3dda81b</entry>
Nov 02 17:57:08 user nova-compute[74980]:       <entry name="uuid">9d824cd1-a689-445c-a1a7-ee08c3dda81b</entry>
Nov 02 17:57:08 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:57:08 user nova-compute[74980]:     </system>
Nov 02 17:57:08 user nova-compute[74980]:   </sysinfo>
Nov 02 17:57:08 user nova-compute[74980]:   <os>
Nov 02 17:57:08 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:57:08 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:57:08 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:57:08 user nova-compute[74980]:   </os>
Nov 02 17:57:08 user nova-compute[74980]:   <features>
Nov 02 17:57:08 user nova-compute[74980]:     <acpi/>
Nov 02 17:57:08 user nova-compute[74980]:     <apic/>
Nov 02 17:57:08 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:57:08 user nova-compute[74980]:   </features>
Nov 02 17:57:08 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:57:08 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:57:08 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:57:08 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:57:08 user nova-compute[74980]:   </clock>
Nov 02 17:57:08 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:57:08 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:57:08 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:57:08 user nova-compute[74980]:   </cpu>
Nov 02 17:57:08 user nova-compute[74980]:   <devices>
Nov 02 17:57:08 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:57:08 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:57:08 user nova-compute[74980]:       <source dev="/dev/sdc"/>
Nov 02 17:57:08 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:57:08 user nova-compute[74980]:       <serial>db4e1993-6de1-41df-82ab-43b1b1ade12d</serial>
Nov 02 17:57:08 user nova-compute[74980]:     </disk>
Nov 02 17:57:08 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:57:08 user nova-compute[74980]:       <mac address="fa:16:3e:5a:c6:41"/>
Nov 02 17:57:08 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:57:08 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:57:08 user nova-compute[74980]:       <target dev="tap61ccb3b9-dc"/>
Nov 02 17:57:08 user nova-compute[74980]:     </interface>
Nov 02 17:57:08 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:57:08 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/9d824cd1-a689-445c-a1a7-ee08c3dda81b/console.log" append="off"/>
Nov 02 17:57:08 user nova-compute[74980]:     </serial>
Nov 02 17:57:08 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:57:08 user nova-compute[74980]:     <video>
Nov 02 17:57:08 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:57:08 user nova-compute[74980]:     </video>
Nov 02 17:57:08 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:57:08 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:57:08 user nova-compute[74980]:     </rng>
Nov 02 17:57:08 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:57:08 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:57:08 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:57:08 user nova-compute[74980]:     </memballoon>
Nov 02 17:57:08 user nova-compute[74980]:   </devices>
Nov 02 17:57:08 user nova-compute[74980]: </domain>
Nov 02 17:57:08 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:56:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1571384647',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1571384647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1571384647',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8tR5q470TKj+pGoRDdXv8Q99CS/D2aIzjsMdcF2iz+pxW4ejWtjdC9leH8HqGFLK4SK4JUNVh/ij0BCXZVv7IzZQZv2lSKJkN+2zfOOH0+i2z5ejMK6fcQU61V4/NKpg==',key_name='tempest-keypair-1504017220',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-zupwxft0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:56:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b309bc195c84c68a52e095927f874f0',uuid=9d824cd1-a689-445c-a1a7-ee08c3dda81b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "address": "fa:16:3e:5a:c6:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ccb3b9-dc", "ovs_interfaceid": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "address": "fa:16:3e:5a:c6:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ccb3b9-dc", "ovs_interfaceid": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c6:41,bridge_name='br-int',has_traffic_filtering=True,id=61ccb3b9-dca8-49af-a15e-719e21bacde5,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ccb3b9-dc') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG os_vif [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c6:41,bridge_name='br-int',has_traffic_filtering=True,id=61ccb3b9-dca8-49af-a15e-719e21bacde5,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ccb3b9-dc') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c940915c-58e1-527d-b3c5-dacfaf4d2bc6', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61ccb3b9-dc, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61ccb3b9-dc, col_values=(('qos', UUID('b6b73dea-f6bc-483b-b283-2040fb55e581')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61ccb3b9-dc, col_values=(('external_ids', {'iface-id': '61ccb3b9-dca8-49af-a15e-719e21bacde5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:c6:41', 'vm-uuid': '9d824cd1-a689-445c-a1a7-ee08c3dda81b'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:08 user nova-compute[74980]: INFO os_vif [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:c6:41,bridge_name='br-int',has_traffic_filtering=True,id=61ccb3b9-dca8-49af-a15e-719e21bacde5,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ccb3b9-dc')
Nov 02 17:57:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:57:08 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] No VIF found with MAC fa:16:3e:5a:c6:41, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:57:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-b1ff14f0-772b-473e-a554-08cf705c06ae req-d9d71f45-fc95-459d-a4d7-1f853165c6e4 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Received event network-vif-plugged-61ccb3b9-dca8-49af-a15e-719e21bacde5 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:57:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b1ff14f0-772b-473e-a554-08cf705c06ae req-d9d71f45-fc95-459d-a4d7-1f853165c6e4 service nova] Acquiring lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:57:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b1ff14f0-772b-473e-a554-08cf705c06ae req-d9d71f45-fc95-459d-a4d7-1f853165c6e4 service nova] Lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:57:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-b1ff14f0-772b-473e-a554-08cf705c06ae req-d9d71f45-fc95-459d-a4d7-1f853165c6e4 service nova] Lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:57:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-b1ff14f0-772b-473e-a554-08cf705c06ae req-d9d71f45-fc95-459d-a4d7-1f853165c6e4 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] No waiting events found dispatching network-vif-plugged-61ccb3b9-dca8-49af-a15e-719e21bacde5 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:57:09 user nova-compute[74980]: WARNING nova.compute.manager [req-b1ff14f0-772b-473e-a554-08cf705c06ae req-d9d71f45-fc95-459d-a4d7-1f853165c6e4 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Received unexpected event network-vif-plugged-61ccb3b9-dca8-49af-a15e-719e21bacde5 for instance with vm_state building and task_state spawning.
Nov 02 17:57:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:57:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:57:11 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Instance spawned successfully.
Nov 02 17:57:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:57:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:57:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:57:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:57:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:57:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:57:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:57:11 user nova-compute[74980]: INFO nova.compute.manager [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 02 17:57:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:57:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-77ee0eb5-9742-4ae7-a96a-41e2ba2471ea req-f39ccf6e-f9f5-4dec-ad90-b14f91cdd258 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Received event network-vif-plugged-61ccb3b9-dca8-49af-a15e-719e21bacde5 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:57:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-77ee0eb5-9742-4ae7-a96a-41e2ba2471ea req-f39ccf6e-f9f5-4dec-ad90-b14f91cdd258 service nova] Acquiring lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:57:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-77ee0eb5-9742-4ae7-a96a-41e2ba2471ea req-f39ccf6e-f9f5-4dec-ad90-b14f91cdd258 service nova] Lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:57:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-77ee0eb5-9742-4ae7-a96a-41e2ba2471ea req-f39ccf6e-f9f5-4dec-ad90-b14f91cdd258 service nova] Lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:57:11 user nova-compute[74980]: DEBUG nova.compute.manager [req-77ee0eb5-9742-4ae7-a96a-41e2ba2471ea req-f39ccf6e-f9f5-4dec-ad90-b14f91cdd258 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] No waiting events found dispatching network-vif-plugged-61ccb3b9-dca8-49af-a15e-719e21bacde5 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:57:11 user nova-compute[74980]: WARNING nova.compute.manager [req-77ee0eb5-9742-4ae7-a96a-41e2ba2471ea req-f39ccf6e-f9f5-4dec-ad90-b14f91cdd258 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Received unexpected event network-vif-plugged-61ccb3b9-dca8-49af-a15e-719e21bacde5 for instance with vm_state building and task_state spawning.
Nov 02 17:57:11 user nova-compute[74980]: INFO nova.compute.manager [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Took 25.09 seconds to build instance.
Nov 02 17:57:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-39c38c00-4a93-4ccd-a186-0fc248186396 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.184s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:57:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-a2464ae4-3fd2-41f9-81c6-265bb9aa40e0 req-d8be4014-c1b9-4beb-8811-2cd8cfe3862e service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received event network-changed-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:57:13 user nova-compute[74980]: DEBUG nova.compute.manager [req-a2464ae4-3fd2-41f9-81c6-265bb9aa40e0 req-d8be4014-c1b9-4beb-8811-2cd8cfe3862e service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Refreshing instance network info cache due to event network-changed-80e69c2d-d566-4b77-bceb-fa2560c841e1. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:57:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a2464ae4-3fd2-41f9-81c6-265bb9aa40e0 req-d8be4014-c1b9-4beb-8811-2cd8cfe3862e service nova] Acquiring lock "refresh_cache-c5d05f2c-89ab-4b7c-9919-09f99711971a" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:57:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a2464ae4-3fd2-41f9-81c6-265bb9aa40e0 req-d8be4014-c1b9-4beb-8811-2cd8cfe3862e service nova] Acquired lock "refresh_cache-c5d05f2c-89ab-4b7c-9919-09f99711971a" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:57:13 user nova-compute[74980]: DEBUG nova.network.neutron [req-a2464ae4-3fd2-41f9-81c6-265bb9aa40e0 req-d8be4014-c1b9-4beb-8811-2cd8cfe3862e service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Refreshing network info cache for port 80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:57:14 user nova-compute[74980]: DEBUG nova.network.neutron [req-a2464ae4-3fd2-41f9-81c6-265bb9aa40e0 req-d8be4014-c1b9-4beb-8811-2cd8cfe3862e service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Updated VIF entry in instance network info cache for port 80e69c2d-d566-4b77-bceb-fa2560c841e1. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:57:14 user nova-compute[74980]: DEBUG nova.network.neutron [req-a2464ae4-3fd2-41f9-81c6-265bb9aa40e0 req-d8be4014-c1b9-4beb-8811-2cd8cfe3862e service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Updating instance_info_cache with network_info: [{"id": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "address": "fa:16:3e:17:14:8f", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e69c2d-d5", "ovs_interfaceid": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:57:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a2464ae4-3fd2-41f9-81c6-265bb9aa40e0 req-d8be4014-c1b9-4beb-8811-2cd8cfe3862e service nova] Releasing lock "refresh_cache-c5d05f2c-89ab-4b7c-9919-09f99711971a" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:57:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG nova.objects.instance [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'flavor' on Instance uuid c5d05f2c-89ab-4b7c-9919-09f99711971a {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:57:19 user nova-compute[74980]: INFO nova.compute.manager [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Attaching volume 439ce827-fe5d-470b-b09f-5a5383cd56a8 to /dev/vdb
Nov 02 17:57:19 user nova-compute[74980]: DEBUG os_brick.utils [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae719ebd-0ba2-4720-9273-fc6170997634]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc50401-3ea6-4cbe-81c3-02dfb23e5047]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7c8fe4-c9f6-4128-a0ac-3c98331f9fbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5242f172-7c7d-493b-a1f4-490f584b2f2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:57:19 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:57:19 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2379ea92-0a66-492e-8f4e-7712439fbefd]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG os_brick.utils [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:57:19 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Updating existing volume attachment record: 4ec865df-6e24-4254-b632-24230afc163a {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:57:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:57:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:57:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:57:34 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:57:35 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:57:35 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:57:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:57:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:57:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:57:35 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:57:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:57:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:57:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:35 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:57:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:37 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:57:37 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:57:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8487MB free_disk=24.805740356445312GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:57:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:57:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:57:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:57:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:57:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance b219f919-44a8-49d1-9b20-36bbb1056120 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:57:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance e4819d7e-1ce3-4202-be42-e20671aa0b42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:57:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c5d05f2c-89ab-4b7c-9919-09f99711971a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:57:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 9d824cd1-a689-445c-a1a7-ee08c3dda81b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:57:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:57:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:57:37 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:57:37 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:57:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:57:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.366s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:57:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OeADFUBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:57:39 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:57:39 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:57:39 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f1eae8-64f7-4670-b51b-7864889badab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:57:39 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1335d308-5616-4d0f-8e12-15b6366e09a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8] added
Nov 02 17:57:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc53e75-b280-4bc2-809c-e94d97545863]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32616ac-9e65-4b53-bec4-1bdabdaec84b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OeADFUBp {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OeADFUBp" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c56a53d-7be4-447e-b963-36ddd8305596]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OeADFUBp'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[692ff049-d645-4bdc-a8e7-f5b11911e685]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00d86b3-d15f-44b2-85dc-e568e4dabbdf]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:57:39 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:57:39 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:57:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:57:39 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:57:39 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:57:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[104e4f72-525a-42bc-adf7-2c73a95635d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8, portal: 172.16.0.220,3260]
Nov 02 17:57:39 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8, portal: 172.16.0.220,3260] successful.
Nov 02 17:57:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f24db2-cf9f-4428-ae1d-eb21c1c1e24b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32ce5a3-5062-407c-acf0-77ec992afbf4]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:57:39 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:57:39 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:57:39 user nova-compute[74980]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 (non-flash)
Nov 02 17:57:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:57:39 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:57:39 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:57:39 user nova-compute[74980]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 (non-flash)
Nov 02 17:57:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a198c33a-4de0-4acb-a5fc-9127e2383626]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:57:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OeADFUBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:57:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:57:40 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26561613335376431', 'path': '/dev/sde'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:57:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561613335376431', 'path': '/dev/sde'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:57:40 user nova-compute[74980]: DEBUG nova.objects.instance [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'flavor' on Instance uuid c5d05f2c-89ab-4b7c-9919-09f99711971a {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:57:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:57:40 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:57:40 user nova-compute[74980]:   <source dev="/dev/sde"/>
Nov 02 17:57:40 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:57:40 user nova-compute[74980]:   <serial>439ce827-fe5d-470b-b09f-5a5383cd56a8</serial>
Nov 02 17:57:40 user nova-compute[74980]: </disk>
Nov 02 17:57:40 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:57:41 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:57:41 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:57:41 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] No VIF found with MAC fa:16:3e:17:14:8f, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:57:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-def42174-7382-4bad-98b5-1d454433ca07 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.984s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:57:41 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:57:41 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:57:41 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:57:42 user nova-compute[74980]: INFO nova.compute.manager [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Terminating instance
Nov 02 17:57:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-aadbaae2-8b31-42d3-9427-0f21092c46a9 req-3f85b7e0-b592-4a0e-83b5-edbc62c50ec7 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-unplugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-aadbaae2-8b31-42d3-9427-0f21092c46a9 req-3f85b7e0-b592-4a0e-83b5-edbc62c50ec7 service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-aadbaae2-8b31-42d3-9427-0f21092c46a9 req-3f85b7e0-b592-4a0e-83b5-edbc62c50ec7 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-aadbaae2-8b31-42d3-9427-0f21092c46a9 req-3f85b7e0-b592-4a0e-83b5-edbc62c50ec7 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-aadbaae2-8b31-42d3-9427-0f21092c46a9 req-3f85b7e0-b592-4a0e-83b5-edbc62c50ec7 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-unplugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-aadbaae2-8b31-42d3-9427-0f21092c46a9 req-3f85b7e0-b592-4a0e-83b5-edbc62c50ec7 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-unplugged-93016e95-3426-4947-a5da-a37369870ffe for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:42 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Instance destroyed successfully.
Nov 02 17:57:42 user nova-compute[74980]: DEBUG nova.objects.instance [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'resources' on Instance uuid e4819d7e-1ce3-4202-be42-e20671aa0b42 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-274175433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-274175433',id=42,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11e1bb23618243ddb099bc6855aa2f64',ramdisk_id='',reservation_id='r-4azmqki5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-36491096',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:55:56Z,user_data=None,user_id='fef01429fb294195984431fd3699f78b',uuid=e4819d7e-1ce3-4202-be42-e20671aa0b42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93016e95-3426-4947-a5da-a37369870ffe", "address": "fa:16:3e:d2:ad:f5", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93016e95-34", "ovs_interfaceid": "93016e95-3426-4947-a5da-a37369870ffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converting VIF {"id": "93016e95-3426-4947-a5da-a37369870ffe", "address": "fa:16:3e:d2:ad:f5", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93016e95-34", "ovs_interfaceid": "93016e95-3426-4947-a5da-a37369870ffe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:ad:f5,bridge_name='br-int',has_traffic_filtering=True,id=93016e95-3426-4947-a5da-a37369870ffe,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93016e95-34') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG os_vif [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:ad:f5,bridge_name='br-int',has_traffic_filtering=True,id=93016e95-3426-4947-a5da-a37369870ffe,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93016e95-34') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93016e95-34, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c108f41-6d4a-4666-86a9-67c879128e19) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:42 user nova-compute[74980]: INFO os_vif [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:ad:f5,bridge_name='br-int',has_traffic_filtering=True,id=93016e95-3426-4947-a5da-a37369870ffe,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93016e95-34')
Nov 02 17:57:42 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'whxTIJLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:57:42 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:57:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4f4e43-6374-4bed-b96f-47e71283fee4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:57:42 user nova-compute[74980]: No targets found.
Nov 02 17:57:42 user nova-compute[74980]: iSNS:
Nov 02 17:57:42 user nova-compute[74980]: No targets found.
Nov 02 17:57:42 user nova-compute[74980]: STATIC:
Nov 02 17:57:42 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f
Nov 02 17:57:42 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:57:42 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:57:42 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187
Nov 02 17:57:42 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:57:42 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:57:42 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d
Nov 02 17:57:42 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:57:42 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:57:42 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8
Nov 02 17:57:42 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:57:42 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:57:42 user nova-compute[74980]: FIRMWARE:
Nov 02 17:57:42 user nova-compute[74980]: No targets found.
Nov 02 17:57:42 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:57:42 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:57:42 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a01f82-0292-4059-8a90-03f07dbb9fb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:42 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f643573-effd-49a8-ae85-752a03eff79b]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:57:43 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:57:43 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:57:43 user nova-compute[74980]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 (non-flash)
Nov 02 17:57:43 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:57:43 user nova-compute[74980]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f (non-flash)
Nov 02 17:57:43 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:57:43 user nova-compute[74980]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 (non-flash)
Nov 02 17:57:43 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f599453c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b27ef78-e550-4580-b6ac-8ceb2e512b0f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0ce992-87bc-47d5-81d2-0792bb400bf9]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1a8d9b-d252-42f4-a58a-adb4695f3bce]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6c49dc-260f-49d5-a435-78045c15613e]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e3360f5d', '/dev/disk/by-id/scsi-1SCST_BIOe3360f5d-8bb0915920fe4f3f', '/dev/disk/by-id/scsi-23862623039313539') {{(pid=86001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e9f0f4-ac92-4df6-a447-0a2881ed3e42]: (4, None) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25e722b-2f18-4a1c-b35d-f08c8d8a7d99]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc2d045-1fbc-49b2-a170-f934c933d66e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f, portal: 172.16.0.220,3260]
Nov 02 17:57:43 user nova-compute[74980]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f, portal: 172.16.0.220,3260] successful.
Nov 02 17:57:43 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a36f6a2-3934-4a9c-87fe-e09e81ebfa0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb32999e-3895-435e-b415-f9455fc4f406]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] <== disconnect_volume: return (345ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:57:43 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Deleting instance files /opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42_del
Nov 02 17:57:43 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Deletion of /opt/stack/data/nova/instances/e4819d7e-1ce3-4202-be42-e20671aa0b42_del complete
Nov 02 17:57:43 user nova-compute[74980]: INFO nova.compute.manager [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 02 17:57:43 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:57:43 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Took 0.49 seconds to deallocate network for instance.
Nov 02 17:57:43 user nova-compute[74980]: DEBUG nova.compute.manager [req-cf2020e4-4038-4ec4-bbb0-18fc452e656b req-f3a160ee-b903-4bca-83ad-820a2853caf0 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-deleted-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:57:43 user nova-compute[74980]: INFO nova.compute.manager [req-cf2020e4-4038-4ec4-bbb0-18fc452e656b req-f3a160ee-b903-4bca-83ad-820a2853caf0 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Neutron deleted interface 93016e95-3426-4947-a5da-a37369870ffe; detaching it from the instance and deleting it from the info cache
Nov 02 17:57:43 user nova-compute[74980]: DEBUG nova.network.neutron [req-cf2020e4-4038-4ec4-bbb0-18fc452e656b req-f3a160ee-b903-4bca-83ad-820a2853caf0 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:57:43 user nova-compute[74980]: DEBUG nova.compute.manager [req-cf2020e4-4038-4ec4-bbb0-18fc452e656b req-f3a160ee-b903-4bca-83ad-820a2853caf0 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Detach interface failed, port_id=93016e95-3426-4947-a5da-a37369870ffe, reason: Instance e4819d7e-1ce3-4202-be42-e20671aa0b42 could not be found. {{(pid=74980) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 17:57:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-d04917b7-76e5-4e2b-94d1-22007247a853 req-6b386edd-c195-4b95-bfe1-0a8b92d4ed66 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:57:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d04917b7-76e5-4e2b-94d1-22007247a853 req-6b386edd-c195-4b95-bfe1-0a8b92d4ed66 service nova] Acquiring lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:57:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d04917b7-76e5-4e2b-94d1-22007247a853 req-6b386edd-c195-4b95-bfe1-0a8b92d4ed66 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:57:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d04917b7-76e5-4e2b-94d1-22007247a853 req-6b386edd-c195-4b95-bfe1-0a8b92d4ed66 service nova] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:57:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-d04917b7-76e5-4e2b-94d1-22007247a853 req-6b386edd-c195-4b95-bfe1-0a8b92d4ed66 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] No waiting events found dispatching network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:57:44 user nova-compute[74980]: WARNING nova.compute.manager [req-d04917b7-76e5-4e2b-94d1-22007247a853 req-6b386edd-c195-4b95-bfe1-0a8b92d4ed66 service nova] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Received unexpected event network-vif-plugged-93016e95-3426-4947-a5da-a37369870ffe for instance with vm_state active and task_state deleting.
Nov 02 17:57:45 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:57:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:47 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG nova.objects.instance [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'flavor' on Instance uuid c5d05f2c-89ab-4b7c-9919-09f99711971a {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.312s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:57:48 user nova-compute[74980]: INFO nova.compute.manager [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: e4819d7e-1ce3-4202-be42-e20671aa0b42] Took 4.29 seconds to detach 1 volumes for instance.
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:57:48 user nova-compute[74980]: INFO nova.compute.manager [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Attaching volume 7c082c6b-a44b-45cc-9899-8ea7038f19b3 to /dev/vdc
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG os_brick.utils [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[07931d62-7fe9-4fd7-9a5b-b16846cead25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da942e2-de21-4879-856b-55c36583e437]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8cbd40-04f9-4f1c-8ef5-bab80c2b2c98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fc460a-1805-413a-b315-1b4769686444]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:57:48 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3362454e-602b-4677-bfe5-9f0bab28c124]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG os_brick.utils [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Updating existing volume attachment record: a231d71e-710d-4bb9-b6fc-9af22e25cf6e {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:57:48 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Deleted allocations for instance e4819d7e-1ce3-4202-be42-e20671aa0b42
Nov 02 17:57:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0ac9bbfb-b8b7-442d-88ac-efd110528e73 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "e4819d7e-1ce3-4202-be42-e20671aa0b42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.422s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:57:49 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:57:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:57:49 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Didn't find any instances for network info cache update. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 17:57:52 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:57:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:58:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVZIwDMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:58:07 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:58:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:58:07 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:58:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:58:07 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:58:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e905471c-f7b6-4836-ac39-d859359d513b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:58:07 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4baccaf-200e-4d13-8916-0869a034e52e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3] added
Nov 02 17:58:07 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bf64c1-841e-437b-ae18-7ad425f22793]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:58:07 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[003b46ea-7014-40af-9b95-6269898f9be9]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVZIwDMU {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVZIwDMU" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75fec3b-978b-48dd-b6f1-8eb23ac8df73]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KVZIwDMU'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbf2c23-5525-4274-a99c-63199ba8dae0]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[43708f3f-1363-4a77-a33e-e56ca683f37f]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:58:08 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:58:08 user nova-compute[74980]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 (non-flash)
Nov 02 17:58:08 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:58:08 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:58:08 user nova-compute[74980]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 (non-flash)
Nov 02 17:58:08 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[827e8b16-cd45-47d8-aa37-0ddd2ee2fd9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3, portal: 172.16.0.220,3260]
Nov 02 17:58:08 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3, portal: 172.16.0.220,3260] successful.
Nov 02 17:58:08 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dcd999-ee1d-4d10-b8cd-b33639f9f7e1]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fa7176-2d2f-4ee8-a622-c93bc58ecf48]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:58:08 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:58:08 user nova-compute[74980]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 (non-flash)
Nov 02 17:58:08 user nova-compute[74980]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 (non-flash)
Nov 02 17:58:08 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:58:08 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:58:08 user nova-compute[74980]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 (non-flash)
Nov 02 17:58:08 user nova-compute[74980]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 (non-flash)
Nov 02 17:58:08 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb21cf2-8f2c-4334-b031-4fd1b480f8ea]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:08 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:58:09 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:58:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVZIwDMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:58:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:58:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26464626431356137', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:58:09 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464626431356137', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:58:09 user nova-compute[74980]: DEBUG nova.objects.instance [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'flavor' on Instance uuid c5d05f2c-89ab-4b7c-9919-09f99711971a {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:58:09 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 17:58:09 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:58:09 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:58:09 user nova-compute[74980]:   <target dev="vdc" bus="virtio"/>
Nov 02 17:58:09 user nova-compute[74980]:   <serial>7c082c6b-a44b-45cc-9899-8ea7038f19b3</serial>
Nov 02 17:58:09 user nova-compute[74980]: </disk>
Nov 02 17:58:09 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 17:58:09 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:58:09 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:58:09 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:58:09 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] No VIF found with MAC fa:16:3e:17:14:8f, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:58:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a928a1c3-c187-4ada-b634-1fecd4e54f0c tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.578s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:11 user nova-compute[74980]: INFO nova.compute.manager [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Detaching volume 439ce827-fe5d-470b-b09f-5a5383cd56a8
Nov 02 17:58:11 user nova-compute[74980]: INFO nova.virt.block_device [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Attempting to driver detach volume 439ce827-fe5d-470b-b09f-5a5383cd56a8 from mountpoint /dev/vdb
Nov 02 17:58:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Attempting to detach device vdb from instance c5d05f2c-89ab-4b7c-9919-09f99711971a from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:58:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:58:11 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:58:11 user nova-compute[74980]:   <source dev="/dev/sde"/>
Nov 02 17:58:11 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:58:11 user nova-compute[74980]:   <serial>439ce827-fe5d-470b-b09f-5a5383cd56a8</serial>
Nov 02 17:58:11 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:58:11 user nova-compute[74980]: </disk>
Nov 02 17:58:11 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:58:11 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Successfully detached device vdb from instance c5d05f2c-89ab-4b7c-9919-09f99711971a from the persistent domain config.
Nov 02 17:58:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c5d05f2c-89ab-4b7c-9919-09f99711971a from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:58:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:58:11 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:58:11 user nova-compute[74980]:   <source dev="/dev/sde"/>
Nov 02 17:58:11 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 17:58:11 user nova-compute[74980]:   <serial>439ce827-fe5d-470b-b09f-5a5383cd56a8</serial>
Nov 02 17:58:11 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 17:58:11 user nova-compute[74980]: </disk>
Nov 02 17:58:11 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:58:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c5d05f2c-89ab-4b7c-9919-09f99711971a {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:58:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:58:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:58:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:58:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:58:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:27 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:58:31 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c5d05f2c-89ab-4b7c-9919-09f99711971a is timed out.
Nov 02 17:58:31 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Successfully detached device vdb from instance c5d05f2c-89ab-4b7c-9919-09f99711971a from the live domain config.
Nov 02 17:58:31 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OeADFUBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:58:31 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[858932ba-f6d2-47b7-b4f4-36d50444529b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:58:31 user nova-compute[74980]: No targets found.
Nov 02 17:58:31 user nova-compute[74980]: iSNS:
Nov 02 17:58:31 user nova-compute[74980]: No targets found.
Nov 02 17:58:31 user nova-compute[74980]: STATIC:
Nov 02 17:58:31 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187
Nov 02 17:58:31 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:58:31 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:58:31 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d
Nov 02 17:58:31 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:58:31 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:58:31 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3
Nov 02 17:58:31 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:58:31 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:58:31 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8
Nov 02 17:58:31 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:58:31 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:58:31 user nova-compute[74980]: FIRMWARE:
Nov 02 17:58:31 user nova-compute[74980]: No targets found.
Nov 02 17:58:31 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:58:31 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:58:31 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc88bcac-f56b-4fb4-88cc-9d255cb09221]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b3bebc-4d8e-4283-84eb-a74036edb4e9]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:58:31 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:58:31 user nova-compute[74980]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 (non-flash)
Nov 02 17:58:31 user nova-compute[74980]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 (non-flash)
Nov 02 17:58:31 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:58:31 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:58:31 user nova-compute[74980]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 (non-flash)
Nov 02 17:58:31 user nova-compute[74980]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 (non-flash)
Nov 02 17:58:31 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59c40d9e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8'): ({'sde'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Removing single pathed devices sde {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c7739b-c918-4ebf-83e1-fa99ceb87c95]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3075d437-352d-4a0d-8121-a7154bef48af]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Flushing IO for device /dev/sde {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82cdb58-5dd4-4a1e-8f3c-7cdc1689db38]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d23156e-7ebb-4cb6-9202-24df5dfbaab2]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] SCSI volumes sde have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e01032-f567-4c40-9bb2-ed9c50ca09d1]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ad9c5c-3cd2-4eda-8d30-e2b623f06580]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8, portal: 172.16.0.220,3260]
Nov 02 17:58:31 user nova-compute[74980]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8, portal: 172.16.0.220,3260] successful.
Nov 02 17:58:31 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:58:31 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:439ce827-fe5d-470b-b09f-5a5383cd56a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4fa474-9e55-4025-ad23-e7b16add56b7]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:58:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:58:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] <== disconnect_volume: return (343ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:58:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:58:32 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG nova.objects.instance [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'flavor' on Instance uuid c5d05f2c-89ab-4b7c-9919-09f99711971a {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-50cfbfcc-6876-406b-a9e0-76224aed6bec tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.906s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "b219f919-44a8-49d1-9b20-36bbb1056120" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "b219f919-44a8-49d1-9b20-36bbb1056120" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "b219f919-44a8-49d1-9b20-36bbb1056120-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "b219f919-44a8-49d1-9b20-36bbb1056120-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "b219f919-44a8-49d1-9b20-36bbb1056120-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:33 user nova-compute[74980]: INFO nova.compute.manager [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Terminating instance
Nov 02 17:58:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-39ebabce-10f3-4fe7-88e5-3e1d412b18fc req-d5cf473a-c773-4353-963b-b9b112501c67 service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Received event network-vif-unplugged-00f75489-496c-4666-a645-0dacdcadcc02 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-39ebabce-10f3-4fe7-88e5-3e1d412b18fc req-d5cf473a-c773-4353-963b-b9b112501c67 service nova] Acquiring lock "b219f919-44a8-49d1-9b20-36bbb1056120-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-39ebabce-10f3-4fe7-88e5-3e1d412b18fc req-d5cf473a-c773-4353-963b-b9b112501c67 service nova] Lock "b219f919-44a8-49d1-9b20-36bbb1056120-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-39ebabce-10f3-4fe7-88e5-3e1d412b18fc req-d5cf473a-c773-4353-963b-b9b112501c67 service nova] Lock "b219f919-44a8-49d1-9b20-36bbb1056120-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-39ebabce-10f3-4fe7-88e5-3e1d412b18fc req-d5cf473a-c773-4353-963b-b9b112501c67 service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] No waiting events found dispatching network-vif-unplugged-00f75489-496c-4666-a645-0dacdcadcc02 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG nova.compute.manager [req-39ebabce-10f3-4fe7-88e5-3e1d412b18fc req-d5cf473a-c773-4353-963b-b9b112501c67 service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Received event network-vif-unplugged-00f75489-496c-4666-a645-0dacdcadcc02 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:33 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Instance destroyed successfully.
Nov 02 17:58:33 user nova-compute[74980]: DEBUG nova.objects.instance [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'resources' on Instance uuid b219f919-44a8-49d1-9b20-36bbb1056120 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1441054969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1441054969',id=41,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:49:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11e1bb23618243ddb099bc6855aa2f64',ramdisk_id='',reservation_id='r-yoioigui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-36491096',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:51:07Z,user_data=None,user_id='fef01429fb294195984431fd3699f78b',uuid=b219f919-44a8-49d1-9b20-36bbb1056120,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00f75489-496c-4666-a645-0dacdcadcc02", "address": "fa:16:3e:cc:e6:cc", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f75489-49", "ovs_interfaceid": "00f75489-496c-4666-a645-0dacdcadcc02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converting VIF {"id": "00f75489-496c-4666-a645-0dacdcadcc02", "address": "fa:16:3e:cc:e6:cc", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00f75489-49", "ovs_interfaceid": "00f75489-496c-4666-a645-0dacdcadcc02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e6:cc,bridge_name='br-int',has_traffic_filtering=True,id=00f75489-496c-4666-a645-0dacdcadcc02,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00f75489-49') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG os_vif [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e6:cc,bridge_name='br-int',has_traffic_filtering=True,id=00f75489-496c-4666-a645-0dacdcadcc02,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00f75489-49') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00f75489-49, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5478bfa5-3fd8-4e82-a646-0feaca60f0df) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:58:33 user nova-compute[74980]: INFO os_vif [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e6:cc,bridge_name='br-int',has_traffic_filtering=True,id=00f75489-496c-4666-a645-0dacdcadcc02,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00f75489-49')
Nov 02 17:58:33 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Deleting instance files /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120_del
Nov 02 17:58:33 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Deletion of /opt/stack/data/nova/instances/b219f919-44a8-49d1-9b20-36bbb1056120_del complete
Nov 02 17:58:33 user nova-compute[74980]: INFO nova.compute.manager [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 02 17:58:33 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:33 user nova-compute[74980]: INFO nova.compute.manager [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Detaching volume 7c082c6b-a44b-45cc-9899-8ea7038f19b3
Nov 02 17:58:33 user nova-compute[74980]: INFO nova.virt.block_device [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Attempting to driver detach volume 7c082c6b-a44b-45cc-9899-8ea7038f19b3 from mountpoint /dev/vdc
Nov 02 17:58:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Attempting to detach device vdc from instance c5d05f2c-89ab-4b7c-9919-09f99711971a from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:58:33 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:58:33 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:58:33 user nova-compute[74980]:   <target dev="vdc" bus="virtio"/>
Nov 02 17:58:33 user nova-compute[74980]:   <serial>7c082c6b-a44b-45cc-9899-8ea7038f19b3</serial>
Nov 02 17:58:33 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 17:58:33 user nova-compute[74980]: </disk>
Nov 02 17:58:33 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:58:33 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Successfully detached device vdc from instance c5d05f2c-89ab-4b7c-9919-09f99711971a from the persistent domain config.
Nov 02 17:58:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c5d05f2c-89ab-4b7c-9919-09f99711971a from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 17:58:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 17:58:33 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:58:33 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 17:58:33 user nova-compute[74980]:   <target dev="vdc" bus="virtio"/>
Nov 02 17:58:33 user nova-compute[74980]:   <serial>7c082c6b-a44b-45cc-9899-8ea7038f19b3</serial>
Nov 02 17:58:33 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 17:58:33 user nova-compute[74980]: </disk>
Nov 02 17:58:33 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 17:58:34 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:58:34 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Took 0.43 seconds to deallocate network for instance.
Nov 02 17:58:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c5d05f2c-89ab-4b7c-9919-09f99711971a {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 17:58:34 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Refreshing inventories for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 17:58:34 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Updating ProviderTree inventory for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 17:58:34 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Updating inventory in ProviderTree for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 17:58:34 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Refreshing aggregate associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, aggregates: None {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 17:58:34 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Refreshing trait associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 17:58:34 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:58:34 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:58:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:34 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Deleted allocations for instance b219f919-44a8-49d1-9b20-36bbb1056120
Nov 02 17:58:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0feb55cf-30ae-46a8-9b7c-089bbf8ba243 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "b219f919-44a8-49d1-9b20-36bbb1056120" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.749s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-3bb7401d-eb45-4260-9e02-4e108bb9ce3d req-80df5ea8-896f-4d5a-929d-421bd7d627ec service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Received event network-vif-plugged-00f75489-496c-4666-a645-0dacdcadcc02 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:58:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3bb7401d-eb45-4260-9e02-4e108bb9ce3d req-80df5ea8-896f-4d5a-929d-421bd7d627ec service nova] Acquiring lock "b219f919-44a8-49d1-9b20-36bbb1056120-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3bb7401d-eb45-4260-9e02-4e108bb9ce3d req-80df5ea8-896f-4d5a-929d-421bd7d627ec service nova] Lock "b219f919-44a8-49d1-9b20-36bbb1056120-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3bb7401d-eb45-4260-9e02-4e108bb9ce3d req-80df5ea8-896f-4d5a-929d-421bd7d627ec service nova] Lock "b219f919-44a8-49d1-9b20-36bbb1056120-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-3bb7401d-eb45-4260-9e02-4e108bb9ce3d req-80df5ea8-896f-4d5a-929d-421bd7d627ec service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] No waiting events found dispatching network-vif-plugged-00f75489-496c-4666-a645-0dacdcadcc02 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:58:35 user nova-compute[74980]: WARNING nova.compute.manager [req-3bb7401d-eb45-4260-9e02-4e108bb9ce3d req-80df5ea8-896f-4d5a-929d-421bd7d627ec service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Received unexpected event network-vif-plugged-00f75489-496c-4666-a645-0dacdcadcc02 for instance with vm_state deleted and task_state None.
Nov 02 17:58:35 user nova-compute[74980]: DEBUG nova.compute.manager [req-3bb7401d-eb45-4260-9e02-4e108bb9ce3d req-80df5ea8-896f-4d5a-929d-421bd7d627ec service nova] [instance: b219f919-44a8-49d1-9b20-36bbb1056120] Received event network-vif-deleted-00f75489-496c-4666-a645-0dacdcadcc02 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:58:35 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:58:35 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:58:35 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:58:36 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:58:36 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:58:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:36 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:58:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:58:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG nova.compute.manager [req-bbcec5cd-21ed-4e33-8acd-1622243cbbf1 req-da70ef1f-cc4b-4de4-b9ee-168cec258609 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Received event network-changed-61ccb3b9-dca8-49af-a15e-719e21bacde5 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG nova.compute.manager [req-bbcec5cd-21ed-4e33-8acd-1622243cbbf1 req-da70ef1f-cc4b-4de4-b9ee-168cec258609 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Refreshing instance network info cache due to event network-changed-61ccb3b9-dca8-49af-a15e-719e21bacde5. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bbcec5cd-21ed-4e33-8acd-1622243cbbf1 req-da70ef1f-cc4b-4de4-b9ee-168cec258609 service nova] Acquiring lock "refresh_cache-9d824cd1-a689-445c-a1a7-ee08c3dda81b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bbcec5cd-21ed-4e33-8acd-1622243cbbf1 req-da70ef1f-cc4b-4de4-b9ee-168cec258609 service nova] Acquired lock "refresh_cache-9d824cd1-a689-445c-a1a7-ee08c3dda81b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG nova.network.neutron [req-bbcec5cd-21ed-4e33-8acd-1622243cbbf1 req-da70ef1f-cc4b-4de4-b9ee-168cec258609 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Refreshing network info cache for port 61ccb3b9-dca8-49af-a15e-719e21bacde5 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:58:37 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:58:37 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:58:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8644MB free_disk=24.92141342163086GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance c5d05f2c-89ab-4b7c-9919-09f99711971a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 9d824cd1-a689-445c-a1a7-ee08c3dda81b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:58:37 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:58:38 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:58:38 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:58:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:38 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:58:38 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 17:58:38 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] There are 0 instances to clean {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 17:58:38 user nova-compute[74980]: DEBUG nova.network.neutron [req-bbcec5cd-21ed-4e33-8acd-1622243cbbf1 req-da70ef1f-cc4b-4de4-b9ee-168cec258609 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Updated VIF entry in instance network info cache for port 61ccb3b9-dca8-49af-a15e-719e21bacde5. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:58:38 user nova-compute[74980]: DEBUG nova.network.neutron [req-bbcec5cd-21ed-4e33-8acd-1622243cbbf1 req-da70ef1f-cc4b-4de4-b9ee-168cec258609 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Updating instance_info_cache with network_info: [{"id": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "address": "fa:16:3e:5a:c6:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ccb3b9-dc", "ovs_interfaceid": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:58:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-bbcec5cd-21ed-4e33-8acd-1622243cbbf1 req-da70ef1f-cc4b-4de4-b9ee-168cec258609 service nova] Releasing lock "refresh_cache-9d824cd1-a689-445c-a1a7-ee08c3dda81b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:58:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:43 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:58:43 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:58:43 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:58:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:46 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:58:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:50 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:58:50 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:58:50 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 17:58:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:58:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:58:50 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:58:50 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid a1f33052-902f-44ef-b758-67cfc144416c {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:58:51 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Updating instance_info_cache with network_info: [{"id": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "address": "fa:16:3e:7c:b8:1b", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6fd444-02", "ovs_interfaceid": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:58:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-a1f33052-902f-44ef-b758-67cfc144416c" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:58:51 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:58:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:51 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 17:58:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 17:58:51 user nova-compute[74980]: INFO nova.compute.claims [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Claim successful on node user
Nov 02 17:58:52 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:58:52 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:58:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 17:58:52 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 17:58:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 17:58:52 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 17:58:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 17:58:52 user nova-compute[74980]: INFO nova.virt.block_device [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Booting with volume snapshot 094abce3-77d0-4190-97ca-d64e40c076ad at /dev/vda
Nov 02 17:58:52 user nova-compute[74980]: DEBUG nova.policy [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b309bc195c84c68a52e095927f874f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84de25c95ef24520aa7c06012991dd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 17:58:52 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Successfully created port: ed090e0a-b1c6-4d90-bf92-7fcb65140394 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 17:58:53 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Successfully updated port: ed090e0a-b1c6-4d90-bf92-7fcb65140394 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 17:58:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "refresh_cache-cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:58:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquired lock "refresh_cache-cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:58:53 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 17:58:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-6880e144-0da3-45f6-a53d-a8a67696a57b req-84c2cefe-05bb-4799-99f3-267d12b6e729 service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Received event network-changed-ed090e0a-b1c6-4d90-bf92-7fcb65140394 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:58:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-6880e144-0da3-45f6-a53d-a8a67696a57b req-84c2cefe-05bb-4799-99f3-267d12b6e729 service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Refreshing instance network info cache due to event network-changed-ed090e0a-b1c6-4d90-bf92-7fcb65140394. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 17:58:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6880e144-0da3-45f6-a53d-a8a67696a57b req-84c2cefe-05bb-4799-99f3-267d12b6e729 service nova] Acquiring lock "refresh_cache-cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:58:53 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 17:58:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:53 user nova-compute[74980]: DEBUG nova.network.neutron [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Updating instance_info_cache with network_info: [{"id": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "address": "fa:16:3e:5f:e6:3a", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped090e0a-b1", "ovs_interfaceid": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:58:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Releasing lock "refresh_cache-cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:58:53 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Instance network_info: |[{"id": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "address": "fa:16:3e:5f:e6:3a", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped090e0a-b1", "ovs_interfaceid": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 17:58:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6880e144-0da3-45f6-a53d-a8a67696a57b req-84c2cefe-05bb-4799-99f3-267d12b6e729 service nova] Acquired lock "refresh_cache-cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:58:53 user nova-compute[74980]: DEBUG nova.network.neutron [req-6880e144-0da3-45f6-a53d-a8a67696a57b req-84c2cefe-05bb-4799-99f3-267d12b6e729 service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Refreshing network info cache for port ed090e0a-b1c6-4d90-bf92-7fcb65140394 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG nova.network.neutron [req-6880e144-0da3-45f6-a53d-a8a67696a57b req-84c2cefe-05bb-4799-99f3-267d12b6e729 service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Updated VIF entry in instance network info cache for port ed090e0a-b1c6-4d90-bf92-7fcb65140394. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG nova.network.neutron [req-6880e144-0da3-45f6-a53d-a8a67696a57b req-84c2cefe-05bb-4799-99f3-267d12b6e729 service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Updating instance_info_cache with network_info: [{"id": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "address": "fa:16:3e:5f:e6:3a", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped090e0a-b1", "ovs_interfaceid": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-6880e144-0da3-45f6-a53d-a8a67696a57b req-84c2cefe-05bb-4799-99f3-267d12b6e729 service nova] Releasing lock "refresh_cache-cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:58:54 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c5d05f2c-89ab-4b7c-9919-09f99711971a is timed out.
Nov 02 17:58:54 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Successfully detached device vdc from instance c5d05f2c-89ab-4b7c-9919-09f99711971a from the live domain config.
Nov 02 17:58:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVZIwDMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:58:54 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee432953-64e6-4905-8006-2890ce6b4cb8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:58:54 user nova-compute[74980]: No targets found.
Nov 02 17:58:54 user nova-compute[74980]: iSNS:
Nov 02 17:58:54 user nova-compute[74980]: No targets found.
Nov 02 17:58:54 user nova-compute[74980]: STATIC:
Nov 02 17:58:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187
Nov 02 17:58:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:58:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:58:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d
Nov 02 17:58:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:58:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:58:54 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3
Nov 02 17:58:54 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:58:54 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:58:54 user nova-compute[74980]: FIRMWARE:
Nov 02 17:58:54 user nova-compute[74980]: No targets found.
Nov 02 17:58:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:58:54 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:58:54 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0d20cf-7972-4ce6-8b20-9377208d7ac1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c60803-ebd7-4647-9440-6d95041c8178]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:58:54 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:58:54 user nova-compute[74980]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 (non-flash)
Nov 02 17:58:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:58:54 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:58:54 user nova-compute[74980]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 (non-flash)
Nov 02 17:58:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b4478b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f87bea0-356b-44d2-9d0f-4cff4ae5f120]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bd8fb9-5421-43ba-bb8a-628cdc38de6f]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0790d4-a0b2-4bf3-93c5-9c234d9cad6b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f59c93-9132-4f9a-b0a7-3dc54864c0da]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[050c2788-f131-4af3-aef9-16bd2aaa698c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2d5eec-47b1-4935-a2a8-1468ea54aa6d]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3, portal: 172.16.0.220,3260]
Nov 02 17:58:54 user nova-compute[74980]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3, portal: 172.16.0.220,3260] successful.
Nov 02 17:58:54 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c082c6b-a44b-45cc-9899-8ea7038f19b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e9f69a-31f5-4f27-ac3c-3f45ef653c4f]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] <== disconnect_volume: return (279ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:58:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:58:55 user nova-compute[74980]: DEBUG nova.objects.instance [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'flavor' on Instance uuid c5d05f2c-89ab-4b7c-9919-09f99711971a {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:58:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e4ceb42-e275-4e8a-8a06-ddf79c506e61 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.699s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:56 user nova-compute[74980]: INFO nova.compute.manager [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Terminating instance
Nov 02 17:58:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:58:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-24ff66a5-44a1-429c-8c03-205616db6dae req-f6dd281f-88f6-4996-b4ce-95ff1a4af2e2 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received event network-vif-unplugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-24ff66a5-44a1-429c-8c03-205616db6dae req-f6dd281f-88f6-4996-b4ce-95ff1a4af2e2 service nova] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-24ff66a5-44a1-429c-8c03-205616db6dae req-f6dd281f-88f6-4996-b4ce-95ff1a4af2e2 service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-24ff66a5-44a1-429c-8c03-205616db6dae req-f6dd281f-88f6-4996-b4ce-95ff1a4af2e2 service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-24ff66a5-44a1-429c-8c03-205616db6dae req-f6dd281f-88f6-4996-b4ce-95ff1a4af2e2 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] No waiting events found dispatching network-vif-unplugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-24ff66a5-44a1-429c-8c03-205616db6dae req-f6dd281f-88f6-4996-b4ce-95ff1a4af2e2 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received event network-vif-unplugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:57 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Instance destroyed successfully.
Nov 02 17:58:57 user nova-compute[74980]: DEBUG nova.objects.instance [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lazy-loading 'resources' on Instance uuid c5d05f2c-89ab-4b7c-9919-09f99711971a {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1991154766',display_name='tempest-AttachVolumeTestJSON-server-1991154766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1991154766',id=44,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA61GfL1H38rFu0y7iZ/50Z78oaDee/cEhZgYycU5C5gO8Bv4sWiBEBgLlIlKH2VYQhwcMgDrD/caSha4bH9zG+eKu3P3edCG/JN2e0gZkwvWq8FuluXgBrJ1e+CyH/2SA==',key_name='tempest-keypair-1300994011',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:55:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8271dee2adb499dae5bbd63662036e0',ramdisk_id='',reservation_id='r-sr0it5j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-847432967',owner_user_name='tempest-AttachVolumeTestJSON-847432967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:55:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dea42f332a54314a6ffc0790bd66240',uuid=c5d05f2c-89ab-4b7c-9919-09f99711971a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "address": "fa:16:3e:17:14:8f", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e69c2d-d5", "ovs_interfaceid": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converting VIF {"id": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "address": "fa:16:3e:17:14:8f", "network": {"id": "28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1562491229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8271dee2adb499dae5bbd63662036e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e69c2d-d5", "ovs_interfaceid": "80e69c2d-d566-4b77-bceb-fa2560c841e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:14:8f,bridge_name='br-int',has_traffic_filtering=True,id=80e69c2d-d566-4b77-bceb-fa2560c841e1,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e69c2d-d5') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG os_vif [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:14:8f,bridge_name='br-int',has_traffic_filtering=True,id=80e69c2d-d566-4b77-bceb-fa2560c841e1,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e69c2d-d5') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80e69c2d-d5, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7dae3c0-dd1c-48a0-8d8c-a7e5bfb8b126) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:58:57 user nova-compute[74980]: INFO os_vif [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:14:8f,bridge_name='br-int',has_traffic_filtering=True,id=80e69c2d-d566-4b77-bceb-fa2560c841e1,network=Network(28d6f5f7-4fcb-4e11-a883-36d0ea4acc4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e69c2d-d5')
Nov 02 17:58:57 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Deleting instance files /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a_del
Nov 02 17:58:57 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Deletion of /opt/stack/data/nova/instances/c5d05f2c-89ab-4b7c-9919-09f99711971a_del complete
Nov 02 17:58:57 user nova-compute[74980]: INFO nova.compute.manager [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 02 17:58:57 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:58:57 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG os_brick.utils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c353cf90-9be0-48e9-809b-7dcaeda321f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[029c01c7-d4f1-4d38-8721-e119e9aa12c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c77359e-4754-420c-9ac4-dafdbc647d25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ed2ed3-b10a-489f-8668-1f21d9a9d940]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 17:58:58 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[585ff94f-1f29-4206-bdf8-f5538a1a7e86]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG os_brick.utils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Updating existing volume attachment record: 0acf29b8-9130-4e4f-970a-934b124050b5 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:58:58 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Took 1.17 seconds to deallocate network for instance.
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:59 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Deleted allocations for instance c5d05f2c-89ab-4b7c-9919-09f99711971a
Nov 02 17:58:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received event network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] No waiting events found dispatching network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:58:59 user nova-compute[74980]: WARNING nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received unexpected event network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 for instance with vm_state deleted and task_state None.
Nov 02 17:58:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received event network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] No waiting events found dispatching network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:58:59 user nova-compute[74980]: WARNING nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received unexpected event network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 for instance with vm_state deleted and task_state None.
Nov 02 17:58:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received event network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] No waiting events found dispatching network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:58:59 user nova-compute[74980]: WARNING nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received unexpected event network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 for instance with vm_state deleted and task_state None.
Nov 02 17:58:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received event network-vif-unplugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] No waiting events found dispatching network-vif-unplugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:58:59 user nova-compute[74980]: WARNING nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received unexpected event network-vif-unplugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 for instance with vm_state deleted and task_state None.
Nov 02 17:58:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received event network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] Acquiring lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] No waiting events found dispatching network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:58:59 user nova-compute[74980]: WARNING nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received unexpected event network-vif-plugged-80e69c2d-d566-4b77-bceb-fa2560c841e1 for instance with vm_state deleted and task_state None.
Nov 02 17:58:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-7552a782-f273-4688-975a-2ed67d616e9d req-4f7a59e1-89a4-4af7-9a78-9c191279b789 service nova] [instance: c5d05f2c-89ab-4b7c-9919-09f99711971a] Received event network-vif-deleted-80e69c2d-d566-4b77-bceb-fa2560c841e1 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:58:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-c20b71f3-3fda-48b3-8125-dea1918f9076 tempest-AttachVolumeTestJSON-847432967 tempest-AttachVolumeTestJSON-847432967-project-member] Lock "c5d05f2c-89ab-4b7c-9919-09f99711971a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.431s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:59:02 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:59:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74980) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 17:59:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:59:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:59:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:59:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:59:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:59:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 17:59:17 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Creating image(s)
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Ensure instance console log exists: /opt/stack/data/nova/instances/cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Start _get_guest_xml network_info=[{"id": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "address": "fa:16:3e:5f:e6:3a", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped090e0a-b1", "ovs_interfaceid": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-02T17:58:39Z,direct_url=<?>,disk_format='qcow2',id=d9c4a295-3ab2-48c2-857c-803c19f023d2,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1564584755',owner='84de25c95ef24520aa7c06012991dd97',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-02T17:58:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPgbkvqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1', 'attached_at': '', 'detached_at': '', 'volume_id': '93f15c01-3f9e-4beb-b528-25cea479d84f', 'serial': '93f15c01-3f9e-4beb-b528-25cea479d84f'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '0acf29b8-9130-4e4f-970a-934b124050b5', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 17:59:17 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:59:17 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-02T17:58:39Z,direct_url=<?>,disk_format='qcow2',id=d9c4a295-3ab2-48c2-857c-803c19f023d2,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1564584755',owner='84de25c95ef24520aa7c06012991dd97',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-02T17:58:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPgbkvqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:59:17 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:59:17 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:59:17 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f451596d-7f55-4bb8-8c99-511b35fa17a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 17:59:17 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d97a11-9b40-42f1-81af-4ebfe4900108]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f] added
Nov 02 17:59:17 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f086eba1-a3c8-4322-a4f3-cfc004b2617a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[29812d13-3d55-4c27-8894-f7f8276b2d6c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPgbkvqz {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPgbkvqz" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b482667-d857-4067-9a10-1993ff94511c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VPgbkvqz'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b994ec-8343-48c8-8061-e251e7d14fdf]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb373aab-1a5f-4fd8-a2b2-d38efeec225f]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:59:17 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:59:17 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:59:17 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:59:17 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5488f094-1f02-44a2-9e3e-43de690ff04e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f, portal: 172.16.0.220,3260]
Nov 02 17:59:17 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f, portal: 172.16.0.220,3260] successful.
Nov 02 17:59:17 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45f20c2-7b6c-48f1-838c-5e27f76781dd]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be1d77e-4e7e-46aa-b82f-07685f88952e]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:59:17 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:59:17 user nova-compute[74980]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f (non-flash)
Nov 02 17:59:17 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:59:17 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:59:17 user nova-compute[74980]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f (non-flash)
Nov 02 17:59:17 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1c74bc-6350-4f29-ae9e-7808ffe75c5f]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:17 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:59:18 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 17:59:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPgbkvqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 17:59:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:59:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26634356165393836', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:59:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634356165393836', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-586757160',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-586757160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-586757160',id=46,image_ref='d9c4a295-3ab2-48c2-857c-803c19f023d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRlHkD3W2y8k3lqoNQI4eRY1xIDsgdhkbKxOYRzY5sTR55YwH7MpsGDlR0Fqnze7i6hke2ns1BZXVW8AtIT+RJpoYYMIRoBl2FKWA57Xptk7n33cPgG+LQonBGTdbLTNg==',key_name='tempest-keypair-1857279324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-j3l6byxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-352919040',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:58:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b309bc195c84c68a52e095927f874f0',uuid=cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "address": "fa:16:3e:5f:e6:3a", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped090e0a-b1", "ovs_interfaceid": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "address": "fa:16:3e:5f:e6:3a", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped090e0a-b1", "ovs_interfaceid": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e6:3a,bridge_name='br-int',has_traffic_filtering=True,id=ed090e0a-b1c6-4d90-bf92-7fcb65140394,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped090e0a-b1') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG nova.objects.instance [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lazy-loading 'pci_devices' on Instance uuid cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] End _get_guest_xml xml=<domain type="kvm">
Nov 02 17:59:19 user nova-compute[74980]:   <uuid>cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1</uuid>
Nov 02 17:59:19 user nova-compute[74980]:   <name>instance-0000002e</name>
Nov 02 17:59:19 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 17:59:19 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 17:59:19 user nova-compute[74980]:   <metadata>
Nov 02 17:59:19 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 17:59:19 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 17:59:19 user nova-compute[74980]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-586757160</nova:name>
Nov 02 17:59:19 user nova-compute[74980]:       <nova:creationTime>2023-11-02 17:59:17</nova:creationTime>
Nov 02 17:59:19 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 17:59:19 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 17:59:19 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 17:59:19 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 17:59:19 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 17:59:19 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 17:59:19 user nova-compute[74980]:       </nova:flavor>
Nov 02 17:59:19 user nova-compute[74980]:       <nova:owner>
Nov 02 17:59:19 user nova-compute[74980]:         <nova:user uuid="9b309bc195c84c68a52e095927f874f0">tempest-TestVolumeBootPattern-352919040-project-member</nova:user>
Nov 02 17:59:19 user nova-compute[74980]:         <nova:project uuid="84de25c95ef24520aa7c06012991dd97">tempest-TestVolumeBootPattern-352919040</nova:project>
Nov 02 17:59:19 user nova-compute[74980]:       </nova:owner>
Nov 02 17:59:19 user nova-compute[74980]:       <nova:root type="image" uuid="d9c4a295-3ab2-48c2-857c-803c19f023d2"/>
Nov 02 17:59:19 user nova-compute[74980]:       <nova:ports>
Nov 02 17:59:19 user nova-compute[74980]:         <nova:port uuid="ed090e0a-b1c6-4d90-bf92-7fcb65140394">
Nov 02 17:59:19 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 17:59:19 user nova-compute[74980]:         </nova:port>
Nov 02 17:59:19 user nova-compute[74980]:       </nova:ports>
Nov 02 17:59:19 user nova-compute[74980]:     </nova:instance>
Nov 02 17:59:19 user nova-compute[74980]:   </metadata>
Nov 02 17:59:19 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 17:59:19 user nova-compute[74980]:     <system>
Nov 02 17:59:19 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 17:59:19 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 17:59:19 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 17:59:19 user nova-compute[74980]:       <entry name="serial">cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1</entry>
Nov 02 17:59:19 user nova-compute[74980]:       <entry name="uuid">cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1</entry>
Nov 02 17:59:19 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 17:59:19 user nova-compute[74980]:     </system>
Nov 02 17:59:19 user nova-compute[74980]:   </sysinfo>
Nov 02 17:59:19 user nova-compute[74980]:   <os>
Nov 02 17:59:19 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 17:59:19 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 17:59:19 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 17:59:19 user nova-compute[74980]:   </os>
Nov 02 17:59:19 user nova-compute[74980]:   <features>
Nov 02 17:59:19 user nova-compute[74980]:     <acpi/>
Nov 02 17:59:19 user nova-compute[74980]:     <apic/>
Nov 02 17:59:19 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 17:59:19 user nova-compute[74980]:   </features>
Nov 02 17:59:19 user nova-compute[74980]:   <clock offset="utc">
Nov 02 17:59:19 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 17:59:19 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 17:59:19 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 17:59:19 user nova-compute[74980]:   </clock>
Nov 02 17:59:19 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 17:59:19 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 17:59:19 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 17:59:19 user nova-compute[74980]:   </cpu>
Nov 02 17:59:19 user nova-compute[74980]:   <devices>
Nov 02 17:59:19 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 17:59:19 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 17:59:19 user nova-compute[74980]:       <source dev="/dev/sdb"/>
Nov 02 17:59:19 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 17:59:19 user nova-compute[74980]:       <serial>93f15c01-3f9e-4beb-b528-25cea479d84f</serial>
Nov 02 17:59:19 user nova-compute[74980]:     </disk>
Nov 02 17:59:19 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 17:59:19 user nova-compute[74980]:       <mac address="fa:16:3e:5f:e6:3a"/>
Nov 02 17:59:19 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:59:19 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 17:59:19 user nova-compute[74980]:       <target dev="taped090e0a-b1"/>
Nov 02 17:59:19 user nova-compute[74980]:     </interface>
Nov 02 17:59:19 user nova-compute[74980]:     <serial type="pty">
Nov 02 17:59:19 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1/console.log" append="off"/>
Nov 02 17:59:19 user nova-compute[74980]:     </serial>
Nov 02 17:59:19 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 17:59:19 user nova-compute[74980]:     <video>
Nov 02 17:59:19 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 17:59:19 user nova-compute[74980]:     </video>
Nov 02 17:59:19 user nova-compute[74980]:     <rng model="virtio">
Nov 02 17:59:19 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 17:59:19 user nova-compute[74980]:     </rng>
Nov 02 17:59:19 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 17:59:19 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 17:59:19 user nova-compute[74980]:       <stats period="10"/>
Nov 02 17:59:19 user nova-compute[74980]:     </memballoon>
Nov 02 17:59:19 user nova-compute[74980]:   </devices>
Nov 02 17:59:19 user nova-compute[74980]: </domain>
Nov 02 17:59:19 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-586757160',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-586757160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-586757160',id=46,image_ref='d9c4a295-3ab2-48c2-857c-803c19f023d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRlHkD3W2y8k3lqoNQI4eRY1xIDsgdhkbKxOYRzY5sTR55YwH7MpsGDlR0Fqnze7i6hke2ns1BZXVW8AtIT+RJpoYYMIRoBl2FKWA57Xptk7n33cPgG+LQonBGTdbLTNg==',key_name='tempest-keypair-1857279324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-j3l6byxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-352919040',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T17:58:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b309bc195c84c68a52e095927f874f0',uuid=cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "address": "fa:16:3e:5f:e6:3a", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped090e0a-b1", "ovs_interfaceid": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "address": "fa:16:3e:5f:e6:3a", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped090e0a-b1", "ovs_interfaceid": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e6:3a,bridge_name='br-int',has_traffic_filtering=True,id=ed090e0a-b1c6-4d90-bf92-7fcb65140394,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped090e0a-b1') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG os_vif [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e6:3a,bridge_name='br-int',has_traffic_filtering=True,id=ed090e0a-b1c6-4d90-bf92-7fcb65140394,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped090e0a-b1') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '857a3c12-d06b-5148-a10c-afb47558b791', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped090e0a-b1, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped090e0a-b1, col_values=(('qos', UUID('b2ff114b-cea5-4cf4-beb4-492e459b5d22')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped090e0a-b1, col_values=(('external_ids', {'iface-id': 'ed090e0a-b1c6-4d90-bf92-7fcb65140394', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:e6:3a', 'vm-uuid': 'cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:19 user nova-compute[74980]: INFO os_vif [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e6:3a,bridge_name='br-int',has_traffic_filtering=True,id=ed090e0a-b1c6-4d90-bf92-7fcb65140394,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped090e0a-b1')
Nov 02 17:59:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 17:59:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] No VIF found with MAC fa:16:3e:5f:e6:3a, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 17:59:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:20 user nova-compute[74980]: DEBUG nova.compute.manager [req-60fdc77c-cc59-480f-bdb2-3c3bc1b17f8a req-035262a9-1c4b-417e-937e-b1767d1c0e12 service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Received event network-vif-plugged-ed090e0a-b1c6-4d90-bf92-7fcb65140394 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:59:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-60fdc77c-cc59-480f-bdb2-3c3bc1b17f8a req-035262a9-1c4b-417e-937e-b1767d1c0e12 service nova] Acquiring lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:59:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-60fdc77c-cc59-480f-bdb2-3c3bc1b17f8a req-035262a9-1c4b-417e-937e-b1767d1c0e12 service nova] Lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:59:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-60fdc77c-cc59-480f-bdb2-3c3bc1b17f8a req-035262a9-1c4b-417e-937e-b1767d1c0e12 service nova] Lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:59:20 user nova-compute[74980]: DEBUG nova.compute.manager [req-60fdc77c-cc59-480f-bdb2-3c3bc1b17f8a req-035262a9-1c4b-417e-937e-b1767d1c0e12 service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] No waiting events found dispatching network-vif-plugged-ed090e0a-b1c6-4d90-bf92-7fcb65140394 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:59:20 user nova-compute[74980]: WARNING nova.compute.manager [req-60fdc77c-cc59-480f-bdb2-3c3bc1b17f8a req-035262a9-1c4b-417e-937e-b1767d1c0e12 service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Received unexpected event network-vif-plugged-ed090e0a-b1c6-4d90-bf92-7fcb65140394 for instance with vm_state building and task_state spawning.
Nov 02 17:59:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 17:59:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 17:59:22 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Instance spawned successfully.
Nov 02 17:59:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 17:59:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:59:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 17:59:22 user nova-compute[74980]: INFO nova.compute.manager [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Took 4.82 seconds to spawn the instance on the hypervisor.
Nov 02 17:59:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 17:59:22 user nova-compute[74980]: INFO nova.compute.manager [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Took 30.66 seconds to build instance.
Nov 02 17:59:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a24cb181-012b-4e0f-8e59-e38a27e2e056 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.755s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:59:22 user nova-compute[74980]: DEBUG nova.compute.manager [req-87651fdf-3822-4918-bcb8-c132d38c9e70 req-ea55e8e9-95e3-458e-beae-e0aa2ec1a3c2 service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Received event network-vif-plugged-ed090e0a-b1c6-4d90-bf92-7fcb65140394 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:59:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-87651fdf-3822-4918-bcb8-c132d38c9e70 req-ea55e8e9-95e3-458e-beae-e0aa2ec1a3c2 service nova] Acquiring lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:59:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-87651fdf-3822-4918-bcb8-c132d38c9e70 req-ea55e8e9-95e3-458e-beae-e0aa2ec1a3c2 service nova] Lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:59:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-87651fdf-3822-4918-bcb8-c132d38c9e70 req-ea55e8e9-95e3-458e-beae-e0aa2ec1a3c2 service nova] Lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:59:22 user nova-compute[74980]: DEBUG nova.compute.manager [req-87651fdf-3822-4918-bcb8-c132d38c9e70 req-ea55e8e9-95e3-458e-beae-e0aa2ec1a3c2 service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] No waiting events found dispatching network-vif-plugged-ed090e0a-b1c6-4d90-bf92-7fcb65140394 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:59:22 user nova-compute[74980]: WARNING nova.compute.manager [req-87651fdf-3822-4918-bcb8-c132d38c9e70 req-ea55e8e9-95e3-458e-beae-e0aa2ec1a3c2 service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Received unexpected event network-vif-plugged-ed090e0a-b1c6-4d90-bf92-7fcb65140394 for instance with vm_state active and task_state None.
Nov 02 17:59:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:59:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:59:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:59:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:59:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:59:23 user nova-compute[74980]: INFO nova.compute.manager [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Terminating instance
Nov 02 17:59:23 user nova-compute[74980]: DEBUG nova.compute.manager [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 17:59:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-f53672e8-fb56-4113-b3b1-08b304fb96a8 req-c32f288b-e511-4d1f-b95d-1a874816a5fe service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received event network-vif-unplugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:59:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f53672e8-fb56-4113-b3b1-08b304fb96a8 req-c32f288b-e511-4d1f-b95d-1a874816a5fe service nova] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:59:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f53672e8-fb56-4113-b3b1-08b304fb96a8 req-c32f288b-e511-4d1f-b95d-1a874816a5fe service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:59:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f53672e8-fb56-4113-b3b1-08b304fb96a8 req-c32f288b-e511-4d1f-b95d-1a874816a5fe service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:59:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-f53672e8-fb56-4113-b3b1-08b304fb96a8 req-c32f288b-e511-4d1f-b95d-1a874816a5fe service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] No waiting events found dispatching network-vif-unplugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:59:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-f53672e8-fb56-4113-b3b1-08b304fb96a8 req-c32f288b-e511-4d1f-b95d-1a874816a5fe service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received event network-vif-unplugged-c27b6981-9e85-4496-a959-a3ae4e377b34 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:24 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Instance destroyed successfully.
Nov 02 17:59:24 user nova-compute[74980]: DEBUG nova.objects.instance [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'resources' on Instance uuid 6ea56f31-932f-42f8-987c-13ef46d2d9f7 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-463257605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-463257605',id=38,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11e1bb23618243ddb099bc6855aa2f64',ramdisk_id='',reservation_id='r-9drnnags',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-36491096',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:47:23Z,user_data=None,user_id='fef01429fb294195984431fd3699f78b',uuid=6ea56f31-932f-42f8-987c-13ef46d2d9f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converting VIF {"id": "c27b6981-9e85-4496-a959-a3ae4e377b34", "address": "fa:16:3e:da:ca:e6", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc27b6981-9e", "ovs_interfaceid": "c27b6981-9e85-4496-a959-a3ae4e377b34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:ca:e6,bridge_name='br-int',has_traffic_filtering=True,id=c27b6981-9e85-4496-a959-a3ae4e377b34,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc27b6981-9e') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_vif [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:ca:e6,bridge_name='br-int',has_traffic_filtering=True,id=c27b6981-9e85-4496-a959-a3ae4e377b34,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc27b6981-9e') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc27b6981-9e, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5571764b-2359-44cf-b26c-ae9f689a02de) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:24 user nova-compute[74980]: INFO os_vif [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:ca:e6,bridge_name='br-int',has_traffic_filtering=True,id=c27b6981-9e85-4496-a959-a3ae4e377b34,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc27b6981-9e')
Nov 02 17:59:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgGUnODw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 17:59:24 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[15acb026-62c7-42df-a3d9-40b3eb268bc6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 17:59:24 user nova-compute[74980]: No targets found.
Nov 02 17:59:24 user nova-compute[74980]: iSNS:
Nov 02 17:59:24 user nova-compute[74980]: No targets found.
Nov 02 17:59:24 user nova-compute[74980]: STATIC:
Nov 02 17:59:24 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187
Nov 02 17:59:24 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:59:24 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:59:24 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d
Nov 02 17:59:24 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:59:24 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:59:24 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f
Nov 02 17:59:24 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 17:59:24 user nova-compute[74980]:                 Iface Name: default
Nov 02 17:59:24 user nova-compute[74980]: FIRMWARE:
Nov 02 17:59:24 user nova-compute[74980]: No targets found.
Nov 02 17:59:24 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 17:59:24 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 17:59:24 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8412ef2-8439-4749-b984-3b3a18acc574]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb2c834-4654-45a4-a95a-e31511d72c62]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:59:24 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:59:24 user nova-compute[74980]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f (non-flash)
Nov 02 17:59:24 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 (non-flash)
Nov 02 17:59:24 user nova-compute[74980]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 17:59:24 user nova-compute[74980]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f (non-flash)
Nov 02 17:59:24 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b4126c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187'): ({'sdd'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Removing single pathed devices sdd {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6136e19a-4423-4c16-807e-15fb8a6cd7aa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8850b956-ca9b-4f48-9751-a8917c0a9b55]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Flushing IO for device /dev/sdd {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45fb015-f090-4b04-bc24-144647eca3c9]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5b1668-ef73-4d99-8ced-c6aa7b129289]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] SCSI volumes sdd have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0ed744-d7c0-4cb3-ae32-16fd30ee0f50]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[266e5a8f-a6db-4b7e-bfca-9633081f21ca]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187, portal: 172.16.0.220,3260]
Nov 02 17:59:24 user nova-compute[74980]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187, portal: 172.16.0.220,3260] successful.
Nov 02 17:59:24 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53f2f947-128b-4fb6-a7ae-b47bb2f37187 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a75584-e8a9-42be-b53e-fa66876d9bc7]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] <== disconnect_volume: return (307ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 17:59:24 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Deleting instance files /opt/stack/data/nova/instances/6ea56f31-932f-42f8-987c-13ef46d2d9f7_del
Nov 02 17:59:24 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Deletion of /opt/stack/data/nova/instances/6ea56f31-932f-42f8-987c-13ef46d2d9f7_del complete
Nov 02 17:59:24 user nova-compute[74980]: INFO nova.compute.manager [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 02 17:59:24 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 17:59:24 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 17:59:25 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:59:25 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Took 0.49 seconds to deallocate network for instance.
Nov 02 17:59:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-92d5bc67-7918-4311-b1b9-93dab7bac049 req-6f2a3b8b-bec8-45ef-9136-0201f9ee896f service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:59:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-92d5bc67-7918-4311-b1b9-93dab7bac049 req-6f2a3b8b-bec8-45ef-9136-0201f9ee896f service nova] Acquiring lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:59:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-92d5bc67-7918-4311-b1b9-93dab7bac049 req-6f2a3b8b-bec8-45ef-9136-0201f9ee896f service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:59:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-92d5bc67-7918-4311-b1b9-93dab7bac049 req-6f2a3b8b-bec8-45ef-9136-0201f9ee896f service nova] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:59:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-92d5bc67-7918-4311-b1b9-93dab7bac049 req-6f2a3b8b-bec8-45ef-9136-0201f9ee896f service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] No waiting events found dispatching network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 17:59:26 user nova-compute[74980]: WARNING nova.compute.manager [req-92d5bc67-7918-4311-b1b9-93dab7bac049 req-6f2a3b8b-bec8-45ef-9136-0201f9ee896f service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received unexpected event network-vif-plugged-c27b6981-9e85-4496-a959-a3ae4e377b34 for instance with vm_state active and task_state deleting.
Nov 02 17:59:26 user nova-compute[74980]: DEBUG nova.compute.manager [req-92d5bc67-7918-4311-b1b9-93dab7bac049 req-6f2a3b8b-bec8-45ef-9136-0201f9ee896f service nova] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Received event network-vif-deleted-c27b6981-9e85-4496-a959-a3ae4e377b34 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 17:59:26 user nova-compute[74980]: INFO nova.compute.manager [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: 6ea56f31-932f-42f8-987c-13ef46d2d9f7] Took 1.02 seconds to detach 1 volumes for instance.
Nov 02 17:59:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:59:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:59:26 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:59:26 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:59:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:59:26 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Deleted allocations for instance 6ea56f31-932f-42f8-987c-13ef46d2d9f7
Nov 02 17:59:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-552a662d-cb3c-43de-ad91-dd7cfd4902e4 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "6ea56f31-932f-42f8-987c-13ef46d2d9f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.166s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:59:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 17:59:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 17:59:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:59:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 17:59:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:35 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:59:36 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:59:36 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:59:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:59:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:59:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:59:36 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 17:59:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:59:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 17:59:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:36 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 17:59:37 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 17:59:37 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:59:37 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 17:59:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8674MB free_disk=24.94664764404297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 17:59:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 17:59:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 17:59:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance a1f33052-902f-44ef-b758-67cfc144416c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:59:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 9d824cd1-a689-445c-a1a7-ee08c3dda81b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:59:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 17:59:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 17:59:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 17:59:37 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 17:59:37 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 17:59:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 17:59:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 17:59:38 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:59:38 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:59:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:43 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:59:43 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:59:43 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 17:59:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:48 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:59:48 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:59:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:52 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 17:59:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 17:59:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-9d824cd1-a689-445c-a1a7-ee08c3dda81b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 17:59:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-9d824cd1-a689-445c-a1a7-ee08c3dda81b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 17:59:52 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 17:59:52 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Updating instance_info_cache with network_info: [{"id": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "address": "fa:16:3e:5a:c6:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ccb3b9-dc", "ovs_interfaceid": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 17:59:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-9d824cd1-a689-445c-a1a7-ee08c3dda81b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 17:59:53 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 17:59:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 17:59:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "a1f33052-902f-44ef-b758-67cfc144416c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "a1f33052-902f-44ef-b758-67cfc144416c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "a1f33052-902f-44ef-b758-67cfc144416c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "a1f33052-902f-44ef-b758-67cfc144416c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "a1f33052-902f-44ef-b758-67cfc144416c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:00:14 user nova-compute[74980]: INFO nova.compute.manager [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Terminating instance
Nov 02 18:00:14 user nova-compute[74980]: DEBUG nova.compute.manager [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-e19418e3-5915-4c64-8d21-d3e2fea7e6fe req-ae0a32f8-0285-493a-81c1-9d124c98f032 service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Received event network-vif-unplugged-fb6fd444-023b-4b51-b56c-e5fc136d6a53 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e19418e3-5915-4c64-8d21-d3e2fea7e6fe req-ae0a32f8-0285-493a-81c1-9d124c98f032 service nova] Acquiring lock "a1f33052-902f-44ef-b758-67cfc144416c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e19418e3-5915-4c64-8d21-d3e2fea7e6fe req-ae0a32f8-0285-493a-81c1-9d124c98f032 service nova] Lock "a1f33052-902f-44ef-b758-67cfc144416c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e19418e3-5915-4c64-8d21-d3e2fea7e6fe req-ae0a32f8-0285-493a-81c1-9d124c98f032 service nova] Lock "a1f33052-902f-44ef-b758-67cfc144416c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-e19418e3-5915-4c64-8d21-d3e2fea7e6fe req-ae0a32f8-0285-493a-81c1-9d124c98f032 service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] No waiting events found dispatching network-vif-unplugged-fb6fd444-023b-4b51-b56c-e5fc136d6a53 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:00:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-e19418e3-5915-4c64-8d21-d3e2fea7e6fe req-ae0a32f8-0285-493a-81c1-9d124c98f032 service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Received event network-vif-unplugged-fb6fd444-023b-4b51-b56c-e5fc136d6a53 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 18:00:15 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Instance destroyed successfully.
Nov 02 18:00:15 user nova-compute[74980]: DEBUG nova.objects.instance [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lazy-loading 'resources' on Instance uuid a1f33052-902f-44ef-b758-67cfc144416c {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1219821736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1219821736',id=34,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:39:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11e1bb23618243ddb099bc6855aa2f64',ramdisk_id='',reservation_id='r-k14uvbf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-36491096',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:41:45Z,user_data=None,user_id='fef01429fb294195984431fd3699f78b',uuid=a1f33052-902f-44ef-b758-67cfc144416c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "address": "fa:16:3e:7c:b8:1b", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6fd444-02", "ovs_interfaceid": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converting VIF {"id": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "address": "fa:16:3e:7c:b8:1b", "network": {"id": "ae8a0727-db1c-40d1-a71e-5943cbbd3062", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1587655106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11e1bb23618243ddb099bc6855aa2f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6fd444-02", "ovs_interfaceid": "fb6fd444-023b-4b51-b56c-e5fc136d6a53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:b8:1b,bridge_name='br-int',has_traffic_filtering=True,id=fb6fd444-023b-4b51-b56c-e5fc136d6a53,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6fd444-02') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG os_vif [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:b8:1b,bridge_name='br-int',has_traffic_filtering=True,id=fb6fd444-023b-4b51-b56c-e5fc136d6a53,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6fd444-02') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb6fd444-02, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ecdc47a2-5696-4ce9-8e93-ba2c9ef1e142) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:00:15 user nova-compute[74980]: INFO os_vif [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:b8:1b,bridge_name='br-int',has_traffic_filtering=True,id=fb6fd444-023b-4b51-b56c-e5fc136d6a53,network=Network(ae8a0727-db1c-40d1-a71e-5943cbbd3062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6fd444-02')
Nov 02 18:00:15 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Deleting instance files /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c_del
Nov 02 18:00:15 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Deletion of /opt/stack/data/nova/instances/a1f33052-902f-44ef-b758-67cfc144416c_del complete
Nov 02 18:00:15 user nova-compute[74980]: INFO nova.compute.manager [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 02 18:00:15 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: a1f33052-902f-44ef-b758-67cfc144416c] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:00:15 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Took 0.46 seconds to deallocate network for instance.
Nov 02 18:00:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:00:15 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:00:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:00:16 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Deleted allocations for instance a1f33052-902f-44ef-b758-67cfc144416c
Nov 02 18:00:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-0e685abc-35be-4198-8258-b2d95ecf01d3 tempest-ServerBootFromVolumeStableRescueTest-36491096 tempest-ServerBootFromVolumeStableRescueTest-36491096-project-member] Lock "a1f33052-902f-44ef-b758-67cfc144416c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.710s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:00:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-c0688b35-c396-47f3-ae8a-db7c01a145b9 req-026f5b3a-e286-44d4-84ec-19e364923ed6 service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Received event network-vif-plugged-fb6fd444-023b-4b51-b56c-e5fc136d6a53 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:00:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c0688b35-c396-47f3-ae8a-db7c01a145b9 req-026f5b3a-e286-44d4-84ec-19e364923ed6 service nova] Acquiring lock "a1f33052-902f-44ef-b758-67cfc144416c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:00:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c0688b35-c396-47f3-ae8a-db7c01a145b9 req-026f5b3a-e286-44d4-84ec-19e364923ed6 service nova] Lock "a1f33052-902f-44ef-b758-67cfc144416c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:00:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c0688b35-c396-47f3-ae8a-db7c01a145b9 req-026f5b3a-e286-44d4-84ec-19e364923ed6 service nova] Lock "a1f33052-902f-44ef-b758-67cfc144416c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:00:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-c0688b35-c396-47f3-ae8a-db7c01a145b9 req-026f5b3a-e286-44d4-84ec-19e364923ed6 service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] No waiting events found dispatching network-vif-plugged-fb6fd444-023b-4b51-b56c-e5fc136d6a53 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:00:16 user nova-compute[74980]: WARNING nova.compute.manager [req-c0688b35-c396-47f3-ae8a-db7c01a145b9 req-026f5b3a-e286-44d4-84ec-19e364923ed6 service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Received unexpected event network-vif-plugged-fb6fd444-023b-4b51-b56c-e5fc136d6a53 for instance with vm_state deleted and task_state None.
Nov 02 18:00:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-c0688b35-c396-47f3-ae8a-db7c01a145b9 req-026f5b3a-e286-44d4-84ec-19e364923ed6 service nova] [instance: a1f33052-902f-44ef-b758-67cfc144416c] Received event network-vif-deleted-fb6fd444-023b-4b51-b56c-e5fc136d6a53 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:00:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:00:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:00:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:00:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:00:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:36 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:00:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:00:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:00:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:00:36 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:00:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 18:00:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 18:00:36 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:00:36 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:00:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8795MB free_disk=25.070072174072266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:00:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:00:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:00:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 9d824cd1-a689-445c-a1a7-ee08c3dda81b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:00:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:00:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:00:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:00:37 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:00:37 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:00:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:00:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:00:38 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:00:38 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:00:38 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:00:38 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:00:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:00:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:00:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:00:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:00:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-5aee2da9-94a4-467f-9f15-e3d8e5aa0d8b req-abad9c64-7c24-4c0a-9c0d-d7d41242d51f service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Received event network-changed-ed090e0a-b1c6-4d90-bf92-7fcb65140394 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:00:42 user nova-compute[74980]: DEBUG nova.compute.manager [req-5aee2da9-94a4-467f-9f15-e3d8e5aa0d8b req-abad9c64-7c24-4c0a-9c0d-d7d41242d51f service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Refreshing instance network info cache due to event network-changed-ed090e0a-b1c6-4d90-bf92-7fcb65140394. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 18:00:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5aee2da9-94a4-467f-9f15-e3d8e5aa0d8b req-abad9c64-7c24-4c0a-9c0d-d7d41242d51f service nova] Acquiring lock "refresh_cache-cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:00:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5aee2da9-94a4-467f-9f15-e3d8e5aa0d8b req-abad9c64-7c24-4c0a-9c0d-d7d41242d51f service nova] Acquired lock "refresh_cache-cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:00:42 user nova-compute[74980]: DEBUG nova.network.neutron [req-5aee2da9-94a4-467f-9f15-e3d8e5aa0d8b req-abad9c64-7c24-4c0a-9c0d-d7d41242d51f service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Refreshing network info cache for port ed090e0a-b1c6-4d90-bf92-7fcb65140394 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 18:00:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:00:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:00:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:00:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:00:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:00:43 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:00:43 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:00:43 user nova-compute[74980]: INFO nova.compute.manager [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Terminating instance
Nov 02 18:00:43 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 18:00:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:43 user nova-compute[74980]: DEBUG nova.network.neutron [req-5aee2da9-94a4-467f-9f15-e3d8e5aa0d8b req-abad9c64-7c24-4c0a-9c0d-d7d41242d51f service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Updated VIF entry in instance network info cache for port ed090e0a-b1c6-4d90-bf92-7fcb65140394. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 18:00:43 user nova-compute[74980]: DEBUG nova.network.neutron [req-5aee2da9-94a4-467f-9f15-e3d8e5aa0d8b req-abad9c64-7c24-4c0a-9c0d-d7d41242d51f service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Updating instance_info_cache with network_info: [{"id": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "address": "fa:16:3e:5f:e6:3a", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped090e0a-b1", "ovs_interfaceid": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:00:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5aee2da9-94a4-467f-9f15-e3d8e5aa0d8b req-abad9c64-7c24-4c0a-9c0d-d7d41242d51f service nova] Releasing lock "refresh_cache-cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:00:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:44 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Instance destroyed successfully.
Nov 02 18:00:44 user nova-compute[74980]: DEBUG nova.objects.instance [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lazy-loading 'resources' on Instance uuid cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-586757160',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-586757160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-586757160',id=46,image_ref='d9c4a295-3ab2-48c2-857c-803c19f023d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRlHkD3W2y8k3lqoNQI4eRY1xIDsgdhkbKxOYRzY5sTR55YwH7MpsGDlR0Fqnze7i6hke2ns1BZXVW8AtIT+RJpoYYMIRoBl2FKWA57Xptk7n33cPgG+LQonBGTdbLTNg==',key_name='tempest-keypair-1857279324',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:59:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-j3l6byxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-352919040',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:59:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b309bc195c84c68a52e095927f874f0',uuid=cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "address": "fa:16:3e:5f:e6:3a", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped090e0a-b1", "ovs_interfaceid": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "address": "fa:16:3e:5f:e6:3a", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped090e0a-b1", "ovs_interfaceid": "ed090e0a-b1c6-4d90-bf92-7fcb65140394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e6:3a,bridge_name='br-int',has_traffic_filtering=True,id=ed090e0a-b1c6-4d90-bf92-7fcb65140394,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped090e0a-b1') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_vif [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e6:3a,bridge_name='br-int',has_traffic_filtering=True,id=ed090e0a-b1c6-4d90-bf92-7fcb65140394,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped090e0a-b1') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped090e0a-b1, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2ff114b-cea5-4cf4-beb4-492e459b5d22) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:00:44 user nova-compute[74980]: INFO os_vif [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e6:3a,bridge_name='br-int',has_traffic_filtering=True,id=ed090e0a-b1c6-4d90-bf92-7fcb65140394,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped090e0a-b1')
Nov 02 18:00:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPgbkvqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:00:44 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f667231-e4fe-45f2-8127-dd4c4c98549e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 18:00:44 user nova-compute[74980]: No targets found.
Nov 02 18:00:44 user nova-compute[74980]: iSNS:
Nov 02 18:00:44 user nova-compute[74980]: No targets found.
Nov 02 18:00:44 user nova-compute[74980]: STATIC:
Nov 02 18:00:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d
Nov 02 18:00:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 18:00:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 18:00:44 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f
Nov 02 18:00:44 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 18:00:44 user nova-compute[74980]:                 Iface Name: default
Nov 02 18:00:44 user nova-compute[74980]: FIRMWARE:
Nov 02 18:00:44 user nova-compute[74980]: No targets found.
Nov 02 18:00:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 18:00:44 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 18:00:44 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a599ea-02b5-4741-9118-82f492b55c3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d608c3-91f1-45a5-8a51-745456ce8dfe]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 18:00:44 user nova-compute[74980]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f (non-flash)
Nov 02 18:00:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 18:00:44 user nova-compute[74980]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f (non-flash)
Nov 02 18:00:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b4478790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebed97e-8ec4-4fa6-b8b6-164967735c9a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b724f1e3-b052-45aa-abd2-91d15baee030]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[471eed51-1ac7-4347-84df-53bf2cb8f3cf]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cebce6-e9f2-4123-bac6-5d1df2eebfbe]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26634356165393836', '/dev/disk/by-id/scsi-1SCST_BIOccedfd21-f45ae986d46f9a52', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ccedfd21') {{(pid=86001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[530630ee-18b7-463f-ad3f-12548c11a2af]: (4, None) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[16be86e7-d973-433b-8c34-e7f2f8407330]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb44d2c-5934-49a6-8511-b9d8c8f080fd]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f, portal: 172.16.0.220,3260]
Nov 02 18:00:44 user nova-compute[74980]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f, portal: 172.16.0.220,3260] successful.
Nov 02 18:00:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93f15c01-3f9e-4beb-b528-25cea479d84f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3e8625-e0d5-420d-b258-cf30cff46a1d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== disconnect_volume: return (300ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 18:00:44 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Deleting instance files /opt/stack/data/nova/instances/cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1_del
Nov 02 18:00:44 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Deletion of /opt/stack/data/nova/instances/cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1_del complete
Nov 02 18:00:44 user nova-compute[74980]: INFO nova.compute.manager [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-ed117d8c-d3f1-4ee1-ac0d-7219b6a5aaca req-10d01742-9d24-493d-8644-a3b82f1e593b service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Received event network-vif-unplugged-ed090e0a-b1c6-4d90-bf92-7fcb65140394 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ed117d8c-d3f1-4ee1-ac0d-7219b6a5aaca req-10d01742-9d24-493d-8644-a3b82f1e593b service nova] Acquiring lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ed117d8c-d3f1-4ee1-ac0d-7219b6a5aaca req-10d01742-9d24-493d-8644-a3b82f1e593b service nova] Lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ed117d8c-d3f1-4ee1-ac0d-7219b6a5aaca req-10d01742-9d24-493d-8644-a3b82f1e593b service nova] Lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-ed117d8c-d3f1-4ee1-ac0d-7219b6a5aaca req-10d01742-9d24-493d-8644-a3b82f1e593b service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] No waiting events found dispatching network-vif-unplugged-ed090e0a-b1c6-4d90-bf92-7fcb65140394 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-ed117d8c-d3f1-4ee1-ac0d-7219b6a5aaca req-10d01742-9d24-493d-8644-a3b82f1e593b service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Received event network-vif-unplugged-ed090e0a-b1c6-4d90-bf92-7fcb65140394 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-ed117d8c-d3f1-4ee1-ac0d-7219b6a5aaca req-10d01742-9d24-493d-8644-a3b82f1e593b service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Received event network-vif-plugged-ed090e0a-b1c6-4d90-bf92-7fcb65140394 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ed117d8c-d3f1-4ee1-ac0d-7219b6a5aaca req-10d01742-9d24-493d-8644-a3b82f1e593b service nova] Acquiring lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ed117d8c-d3f1-4ee1-ac0d-7219b6a5aaca req-10d01742-9d24-493d-8644-a3b82f1e593b service nova] Lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-ed117d8c-d3f1-4ee1-ac0d-7219b6a5aaca req-10d01742-9d24-493d-8644-a3b82f1e593b service nova] Lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:00:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-ed117d8c-d3f1-4ee1-ac0d-7219b6a5aaca req-10d01742-9d24-493d-8644-a3b82f1e593b service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] No waiting events found dispatching network-vif-plugged-ed090e0a-b1c6-4d90-bf92-7fcb65140394 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:00:44 user nova-compute[74980]: WARNING nova.compute.manager [req-ed117d8c-d3f1-4ee1-ac0d-7219b6a5aaca req-10d01742-9d24-493d-8644-a3b82f1e593b service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Received unexpected event network-vif-plugged-ed090e0a-b1c6-4d90-bf92-7fcb65140394 for instance with vm_state active and task_state deleting.
Nov 02 18:00:45 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:00:45 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Took 0.67 seconds to deallocate network for instance.
Nov 02 18:00:45 user nova-compute[74980]: DEBUG nova.compute.manager [req-77d37f00-3cb6-4f0e-ad3c-047ae7ce7e3d req-56a7a93e-6ec4-4077-9328-9370db4307fa service nova] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Received event network-vif-deleted-ed090e0a-b1c6-4d90-bf92-7fcb65140394 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:00:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:46 user nova-compute[74980]: INFO nova.compute.manager [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Took 1.03 seconds to detach 1 volumes for instance.
Nov 02 18:00:46 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1] Deleting volume: 93f15c01-3f9e-4beb-b528-25cea479d84f {{(pid=74980) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 18:00:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:00:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:00:46 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:00:46 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:00:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:00:46 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Deleted allocations for instance cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1
Nov 02 18:00:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ba3481bc-ab24-4833-ba2b-335916615eb3 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "cfb8fada-b8cb-48a0-84a5-c7f9a4b5f9c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.264s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:00:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:49 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:00:52 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:00:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:00:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:00:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-9d824cd1-a689-445c-a1a7-ee08c3dda81b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:00:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-9d824cd1-a689-445c-a1a7-ee08c3dda81b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:00:52 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:00:52 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 9d824cd1-a689-445c-a1a7-ee08c3dda81b {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:00:52 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Updating instance_info_cache with network_info: [{"id": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "address": "fa:16:3e:5a:c6:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ccb3b9-dc", "ovs_interfaceid": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:00:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-9d824cd1-a689-445c-a1a7-ee08c3dda81b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:00:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:00:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:00:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:07 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:01:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:36 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:01:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:01:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:01:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:01:36 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:01:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 18:01:36 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:01:36 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:01:36 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=25.060176849365234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:01:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:01:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:01:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 9d824cd1-a689-445c-a1a7-ee08c3dda81b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:01:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:01:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:01:37 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:01:37 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:01:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:01:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:01:38 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:01:38 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:01:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:39 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:01:39 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:01:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:01:45 user nova-compute[74980]: INFO nova.compute.manager [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Terminating instance
Nov 02 18:01:45 user nova-compute[74980]: DEBUG nova.compute.manager [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG nova.compute.manager [req-4bb45cbe-4874-4bf7-808e-b8e912c9fe97 req-e0d8518d-e9d4-4a26-9d8b-fb3507b73ea3 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Received event network-vif-unplugged-61ccb3b9-dca8-49af-a15e-719e21bacde5 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4bb45cbe-4874-4bf7-808e-b8e912c9fe97 req-e0d8518d-e9d4-4a26-9d8b-fb3507b73ea3 service nova] Acquiring lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4bb45cbe-4874-4bf7-808e-b8e912c9fe97 req-e0d8518d-e9d4-4a26-9d8b-fb3507b73ea3 service nova] Lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-4bb45cbe-4874-4bf7-808e-b8e912c9fe97 req-e0d8518d-e9d4-4a26-9d8b-fb3507b73ea3 service nova] Lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG nova.compute.manager [req-4bb45cbe-4874-4bf7-808e-b8e912c9fe97 req-e0d8518d-e9d4-4a26-9d8b-fb3507b73ea3 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] No waiting events found dispatching network-vif-unplugged-61ccb3b9-dca8-49af-a15e-719e21bacde5 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:01:45 user nova-compute[74980]: DEBUG nova.compute.manager [req-4bb45cbe-4874-4bf7-808e-b8e912c9fe97 req-e0d8518d-e9d4-4a26-9d8b-fb3507b73ea3 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Received event network-vif-unplugged-61ccb3b9-dca8-49af-a15e-719e21bacde5 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 18:01:46 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Instance destroyed successfully.
Nov 02 18:01:46 user nova-compute[74980]: DEBUG nova.objects.instance [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lazy-loading 'resources' on Instance uuid 9d824cd1-a689-445c-a1a7-ee08c3dda81b {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T17:56:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1571384647',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1571384647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1571384647',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8tR5q470TKj+pGoRDdXv8Q99CS/D2aIzjsMdcF2iz+pxW4ejWtjdC9leH8HqGFLK4SK4JUNVh/ij0BCXZVv7IzZQZv2lSKJkN+2zfOOH0+i2z5ejMK6fcQU61V4/NKpg==',key_name='tempest-keypair-1504017220',keypairs=<?>,launch_index=0,launched_at=2023-11-02T17:57:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-zupwxft0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T17:57:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b309bc195c84c68a52e095927f874f0',uuid=9d824cd1-a689-445c-a1a7-ee08c3dda81b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "address": "fa:16:3e:5a:c6:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ccb3b9-dc", "ovs_interfaceid": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "address": "fa:16:3e:5a:c6:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ccb3b9-dc", "ovs_interfaceid": "61ccb3b9-dca8-49af-a15e-719e21bacde5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:c6:41,bridge_name='br-int',has_traffic_filtering=True,id=61ccb3b9-dca8-49af-a15e-719e21bacde5,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ccb3b9-dc') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_vif [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:c6:41,bridge_name='br-int',has_traffic_filtering=True,id=61ccb3b9-dca8-49af-a15e-719e21bacde5,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ccb3b9-dc') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61ccb3b9-dc, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6b73dea-f6bc-483b-b283-2040fb55e581) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:46 user nova-compute[74980]: INFO os_vif [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:c6:41,bridge_name='br-int',has_traffic_filtering=True,id=61ccb3b9-dca8-49af-a15e-719e21bacde5,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ccb3b9-dc')
Nov 02 18:01:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfImBGcr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:01:46 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3fb524-6e63-414e-9391-9816184aa571]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 18:01:46 user nova-compute[74980]: No targets found.
Nov 02 18:01:46 user nova-compute[74980]: iSNS:
Nov 02 18:01:46 user nova-compute[74980]: No targets found.
Nov 02 18:01:46 user nova-compute[74980]: STATIC:
Nov 02 18:01:46 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d
Nov 02 18:01:46 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 18:01:46 user nova-compute[74980]:                 Iface Name: default
Nov 02 18:01:46 user nova-compute[74980]: FIRMWARE:
Nov 02 18:01:46 user nova-compute[74980]: No targets found.
Nov 02 18:01:46 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 18:01:46 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 18:01:46 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4a68eb-21d0-4695-bc3d-5172065c413a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[988f53f5-7e6a-482b-bf43-88202631b487]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 18:01:46 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d (non-flash)
Nov 02 18:01:46 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5994771000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d'): ({'sdc'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Removing single pathed devices sdc {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1891249-d7ff-4086-81ff-b1342efb3346]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61bdbe2-8300-42e2-acdd-420da165d14d]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flushing IO for device /dev/sdc {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ea98fa-ca48-4f2b-b0b3-2422488b7716]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d72bb64-d7c0-4023-bf8a-bbd447ff1c19]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6779bf-405d-4012-9141-c67786b2b47d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e7f384-d803-4f88-b52e-78e9f0d7314b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d, portal: 172.16.0.220,3260]
Nov 02 18:01:46 user nova-compute[74980]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d, portal: 172.16.0.220,3260] successful.
Nov 02 18:01:46 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4e1993-6de1-41df-82ab-43b1b1ade12d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[439bd708-5987-4f22-9c64-adc45ed2402a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== disconnect_volume: return (332ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 18:01:46 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Deleting instance files /opt/stack/data/nova/instances/9d824cd1-a689-445c-a1a7-ee08c3dda81b_del
Nov 02 18:01:46 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Deletion of /opt/stack/data/nova/instances/9d824cd1-a689-445c-a1a7-ee08c3dda81b_del complete
Nov 02 18:01:46 user nova-compute[74980]: INFO nova.compute.manager [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 02 18:01:46 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 18:01:46 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 18:01:47 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:01:47 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Took 0.69 seconds to deallocate network for instance.
Nov 02 18:01:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-2e81cbd4-54a8-42de-9f08-25c6f98d827b req-06aab3b2-3447-469f-a157-ae47005ee022 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Received event network-vif-deleted-61ccb3b9-dca8-49af-a15e-719e21bacde5 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:01:47 user nova-compute[74980]: INFO nova.compute.manager [req-2e81cbd4-54a8-42de-9f08-25c6f98d827b req-06aab3b2-3447-469f-a157-ae47005ee022 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Neutron deleted interface 61ccb3b9-dca8-49af-a15e-719e21bacde5; detaching it from the instance and deleting it from the info cache
Nov 02 18:01:47 user nova-compute[74980]: DEBUG nova.network.neutron [req-2e81cbd4-54a8-42de-9f08-25c6f98d827b req-06aab3b2-3447-469f-a157-ae47005ee022 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:01:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-2e81cbd4-54a8-42de-9f08-25c6f98d827b req-06aab3b2-3447-469f-a157-ae47005ee022 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Detach interface failed, port_id=61ccb3b9-dca8-49af-a15e-719e21bacde5, reason: Instance 9d824cd1-a689-445c-a1a7-ee08c3dda81b could not be found. {{(pid=74980) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 02 18:01:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-e0661a06-f59e-4929-a1e2-1979c1881f75 req-ee4ff40c-c4d6-40de-9be2-39914df5cfc1 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Received event network-vif-plugged-61ccb3b9-dca8-49af-a15e-719e21bacde5 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:01:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e0661a06-f59e-4929-a1e2-1979c1881f75 req-ee4ff40c-c4d6-40de-9be2-39914df5cfc1 service nova] Acquiring lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:01:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e0661a06-f59e-4929-a1e2-1979c1881f75 req-ee4ff40c-c4d6-40de-9be2-39914df5cfc1 service nova] Lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:01:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e0661a06-f59e-4929-a1e2-1979c1881f75 req-ee4ff40c-c4d6-40de-9be2-39914df5cfc1 service nova] Lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:01:47 user nova-compute[74980]: DEBUG nova.compute.manager [req-e0661a06-f59e-4929-a1e2-1979c1881f75 req-ee4ff40c-c4d6-40de-9be2-39914df5cfc1 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] No waiting events found dispatching network-vif-plugged-61ccb3b9-dca8-49af-a15e-719e21bacde5 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:01:47 user nova-compute[74980]: WARNING nova.compute.manager [req-e0661a06-f59e-4929-a1e2-1979c1881f75 req-ee4ff40c-c4d6-40de-9be2-39914df5cfc1 service nova] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Received unexpected event network-vif-plugged-61ccb3b9-dca8-49af-a15e-719e21bacde5 for instance with vm_state active and task_state deleting.
Nov 02 18:01:48 user nova-compute[74980]: INFO nova.compute.manager [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Took 0.92 seconds to detach 1 volumes for instance.
Nov 02 18:01:48 user nova-compute[74980]: DEBUG nova.compute.manager [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 9d824cd1-a689-445c-a1a7-ee08c3dda81b] Deleting volume: db4e1993-6de1-41df-82ab-43b1b1ade12d {{(pid=74980) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 18:01:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:01:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:01:48 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:01:48 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:01:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:01:48 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Deleted allocations for instance 9d824cd1-a689-445c-a1a7-ee08c3dda81b
Nov 02 18:01:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-5e37e320-747b-448d-b1b1-ea03ffbce778 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "9d824cd1-a689-445c-a1a7-ee08c3dda81b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.236s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:01:49 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:01:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:01:51 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:01:52 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:01:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:01:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:01:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Didn't find any instances for network info cache update. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 18:01:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:02:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:02:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:02:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:02:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:02:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:02:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:02:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:02:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:02:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:02:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:02:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:02:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:02:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:02:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:02:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:02:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:02:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:02:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:02:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:02:37 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:02:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:02:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:02:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:02:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:02:37 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:02:37 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:02:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=9037MB free_disk=25.057186126708984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:02:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:02:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:02:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:02:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:02:38 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:02:38 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:02:38 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:02:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:02:40 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:02:40 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:02:40 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:02:40 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:02:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:02:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:02:46 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:02:46 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:02:47 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:02:50 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:02:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:02:53 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:02:53 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:02:53 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:02:53 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Didn't find any instances for network info cache update. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 18:02:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:02:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:02:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:02:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:02:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:02:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "904d5761-d1a7-4726-bfe9-13be9575f015" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:02:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "904d5761-d1a7-4726-bfe9-13be9575f015" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:02:57 user nova-compute[74980]: DEBUG nova.compute.manager [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 18:02:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:02:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:02:57 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 18:02:57 user nova-compute[74980]: INFO nova.compute.claims [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Claim successful on node user
Nov 02 18:02:57 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:02:57 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:02:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:02:57 user nova-compute[74980]: DEBUG nova.compute.manager [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 18:02:57 user nova-compute[74980]: DEBUG nova.compute.manager [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 18:02:57 user nova-compute[74980]: DEBUG nova.network.neutron [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 18:02:57 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 18:02:57 user nova-compute[74980]: DEBUG nova.compute.manager [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 18:02:57 user nova-compute[74980]: INFO nova.virt.block_device [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Booting with volume 4f3a63f3-95d1-4bfa-8452-dc85dde153ea at /dev/vda
Nov 02 18:02:58 user nova-compute[74980]: DEBUG nova.policy [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b309bc195c84c68a52e095927f874f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84de25c95ef24520aa7c06012991dd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG os_brick.utils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4c4df8-1bd5-461f-a480-767dea84aba4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6add2c87-51a5-47fe-9dd0-cdb6a494c932]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f65ce5-4773-435c-900a-b0e05900b2c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3c69f0-a860-4ba1-acab-581ceab3bfcd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:02:58 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 18:02:58 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bb6fff-0829-4f30-8f5c-93749678c142]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG os_brick.utils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Updating existing volume attachment record: 231364a3-3fac-41df-ac05-76d93e4604af {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:02:58 user nova-compute[74980]: DEBUG nova.network.neutron [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Successfully created port: cf2e9843-2231-40ad-a060-75e30f744045 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 18:02:59 user nova-compute[74980]: DEBUG nova.network.neutron [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Successfully updated port: cf2e9843-2231-40ad-a060-75e30f744045 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 18:02:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "refresh_cache-904d5761-d1a7-4726-bfe9-13be9575f015" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:02:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquired lock "refresh_cache-904d5761-d1a7-4726-bfe9-13be9575f015" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:02:59 user nova-compute[74980]: DEBUG nova.network.neutron [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 18:02:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-5195edf8-3c98-4b23-a715-adf61aa41ee1 req-5cc4c027-4e93-4891-8986-b79fba5c3cb0 service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Received event network-changed-cf2e9843-2231-40ad-a060-75e30f744045 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:02:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-5195edf8-3c98-4b23-a715-adf61aa41ee1 req-5cc4c027-4e93-4891-8986-b79fba5c3cb0 service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Refreshing instance network info cache due to event network-changed-cf2e9843-2231-40ad-a060-75e30f744045. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 18:02:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5195edf8-3c98-4b23-a715-adf61aa41ee1 req-5cc4c027-4e93-4891-8986-b79fba5c3cb0 service nova] Acquiring lock "refresh_cache-904d5761-d1a7-4726-bfe9-13be9575f015" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:02:59 user nova-compute[74980]: DEBUG nova.network.neutron [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 18:03:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Updating instance_info_cache with network_info: [{"id": "cf2e9843-2231-40ad-a060-75e30f744045", "address": "fa:16:3e:8a:b6:68", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2e9843-22", "ovs_interfaceid": "cf2e9843-2231-40ad-a060-75e30f744045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:03:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Releasing lock "refresh_cache-904d5761-d1a7-4726-bfe9-13be9575f015" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:03:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Instance network_info: |[{"id": "cf2e9843-2231-40ad-a060-75e30f744045", "address": "fa:16:3e:8a:b6:68", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2e9843-22", "ovs_interfaceid": "cf2e9843-2231-40ad-a060-75e30f744045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 18:03:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5195edf8-3c98-4b23-a715-adf61aa41ee1 req-5cc4c027-4e93-4891-8986-b79fba5c3cb0 service nova] Acquired lock "refresh_cache-904d5761-d1a7-4726-bfe9-13be9575f015" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:03:00 user nova-compute[74980]: DEBUG nova.network.neutron [req-5195edf8-3c98-4b23-a715-adf61aa41ee1 req-5cc4c027-4e93-4891-8986-b79fba5c3cb0 service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Refreshing network info cache for port cf2e9843-2231-40ad-a060-75e30f744045 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 18:03:00 user nova-compute[74980]: DEBUG nova.network.neutron [req-5195edf8-3c98-4b23-a715-adf61aa41ee1 req-5cc4c027-4e93-4891-8986-b79fba5c3cb0 service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Updated VIF entry in instance network info cache for port cf2e9843-2231-40ad-a060-75e30f744045. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 18:03:00 user nova-compute[74980]: DEBUG nova.network.neutron [req-5195edf8-3c98-4b23-a715-adf61aa41ee1 req-5cc4c027-4e93-4891-8986-b79fba5c3cb0 service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Updating instance_info_cache with network_info: [{"id": "cf2e9843-2231-40ad-a060-75e30f744045", "address": "fa:16:3e:8a:b6:68", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2e9843-22", "ovs_interfaceid": "cf2e9843-2231-40ad-a060-75e30f744045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:03:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5195edf8-3c98-4b23-a715-adf61aa41ee1 req-5cc4c027-4e93-4891-8986-b79fba5c3cb0 service nova] Releasing lock "refresh_cache-904d5761-d1a7-4726-bfe9-13be9575f015" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:03:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:03:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.compute.manager [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 18:03:17 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Creating image(s)
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Ensure instance console log exists: /opt/stack/data/nova/instances/904d5761-d1a7-4726-bfe9-13be9575f015/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Start _get_guest_xml network_info=[{"id": "cf2e9843-2231-40ad-a060-75e30f744045", "address": "fa:16:3e:8a:b6:68", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2e9843-22", "ovs_interfaceid": "cf2e9843-2231-40ad-a060-75e30f744045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkPuByci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '904d5761-d1a7-4726-bfe9-13be9575f015', 'attached_at': '', 'detached_at': '', 'volume_id': '4f3a63f3-95d1-4bfa-8452-dc85dde153ea', 'serial': '4f3a63f3-95d1-4bfa-8452-dc85dde153ea'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '231364a3-3fac-41df-ac05-76d93e4604af', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 18:03:17 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:03:17 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkPuByci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:03:17 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:03:17 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:03:17 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bc598d-378b-42a9-9512-5909ee68b0d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 18:03:17 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef9308b-3ee4-403d-9132-99042ab6896c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea] added
Nov 02 18:03:17 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbe5b5b-3d6e-4641-89fd-b91607386a15]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58b886b-625e-486c-b7cb-10967ed419ff]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkPuByci {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkPuByci" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd90ed45-810a-4e1e-9d19-4770496843a3]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IkPuByci'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3040d59c-aaec-4fa2-becc-e6603fe69663]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[909efce1-a36c-4c9c-a7b5-8143b0db03e0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 18:03:17 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 18:03:17 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:03:17 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 18:03:17 user nova-compute[74980]: 
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaa8198-741a-4d5b-abe8-638b87ef625e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260]
Nov 02 18:03:17 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260] successful.
Nov 02 18:03:17 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f54513d-b5e0-4ca0-a7ef-2cc7b0935447]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[72217ac7-c354-4b48-afba-815c22dd4bf9]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)
Nov 02 18:03:17 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)
Nov 02 18:03:17 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee278b8-efc3-48ed-84f2-9632decbc4f3]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:03:17 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkPuByci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26132616665396162', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132616665396162', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1467296203',display_name='tempest-TestVolumeBootPattern-server-1467296203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1467296203',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ0oxkl6Yy4y5r8YNJgKybtgxWIxjVxrqlTa2t1xJhobm+2dTaCIfDNVa3C22M3ZLYQl8pofX5FRFHgxZksNPoy7tF3GyC4L0dw3OHBi42iMrKQ2mv5uuAnCmx1b8J7EA==',key_name='tempest-TestVolumeBootPattern-1484550038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-eca8szyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T18:02:58Z,user_data=None,user_id='9b309bc195c84c68a52e095927f874f0',uuid=904d5761-d1a7-4726-bfe9-13be9575f015,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf2e9843-2231-40ad-a060-75e30f744045", "address": "fa:16:3e:8a:b6:68", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2e9843-22", "ovs_interfaceid": "cf2e9843-2231-40ad-a060-75e30f744045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "cf2e9843-2231-40ad-a060-75e30f744045", "address": "fa:16:3e:8a:b6:68", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2e9843-22", "ovs_interfaceid": "cf2e9843-2231-40ad-a060-75e30f744045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b6:68,bridge_name='br-int',has_traffic_filtering=True,id=cf2e9843-2231-40ad-a060-75e30f744045,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2e9843-22') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG nova.objects.instance [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lazy-loading 'pci_devices' on Instance uuid 904d5761-d1a7-4726-bfe9-13be9575f015 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] End _get_guest_xml xml=<domain type="kvm">
Nov 02 18:03:18 user nova-compute[74980]:   <uuid>904d5761-d1a7-4726-bfe9-13be9575f015</uuid>
Nov 02 18:03:18 user nova-compute[74980]:   <name>instance-0000002f</name>
Nov 02 18:03:18 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 18:03:18 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 18:03:18 user nova-compute[74980]:   <metadata>
Nov 02 18:03:18 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 18:03:18 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 18:03:18 user nova-compute[74980]:       <nova:name>tempest-TestVolumeBootPattern-server-1467296203</nova:name>
Nov 02 18:03:18 user nova-compute[74980]:       <nova:creationTime>2023-11-02 18:03:17</nova:creationTime>
Nov 02 18:03:18 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 18:03:18 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 18:03:18 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 18:03:18 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 18:03:18 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 18:03:18 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 18:03:18 user nova-compute[74980]:       </nova:flavor>
Nov 02 18:03:18 user nova-compute[74980]:       <nova:owner>
Nov 02 18:03:18 user nova-compute[74980]:         <nova:user uuid="9b309bc195c84c68a52e095927f874f0">tempest-TestVolumeBootPattern-352919040-project-member</nova:user>
Nov 02 18:03:18 user nova-compute[74980]:         <nova:project uuid="84de25c95ef24520aa7c06012991dd97">tempest-TestVolumeBootPattern-352919040</nova:project>
Nov 02 18:03:18 user nova-compute[74980]:       </nova:owner>
Nov 02 18:03:18 user nova-compute[74980]:       <nova:ports>
Nov 02 18:03:18 user nova-compute[74980]:         <nova:port uuid="cf2e9843-2231-40ad-a060-75e30f744045">
Nov 02 18:03:18 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 18:03:18 user nova-compute[74980]:         </nova:port>
Nov 02 18:03:18 user nova-compute[74980]:       </nova:ports>
Nov 02 18:03:18 user nova-compute[74980]:     </nova:instance>
Nov 02 18:03:18 user nova-compute[74980]:   </metadata>
Nov 02 18:03:18 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 18:03:18 user nova-compute[74980]:     <system>
Nov 02 18:03:18 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 18:03:18 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 18:03:18 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 18:03:18 user nova-compute[74980]:       <entry name="serial">904d5761-d1a7-4726-bfe9-13be9575f015</entry>
Nov 02 18:03:18 user nova-compute[74980]:       <entry name="uuid">904d5761-d1a7-4726-bfe9-13be9575f015</entry>
Nov 02 18:03:18 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 18:03:18 user nova-compute[74980]:     </system>
Nov 02 18:03:18 user nova-compute[74980]:   </sysinfo>
Nov 02 18:03:18 user nova-compute[74980]:   <os>
Nov 02 18:03:18 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 18:03:18 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 18:03:18 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 18:03:18 user nova-compute[74980]:   </os>
Nov 02 18:03:18 user nova-compute[74980]:   <features>
Nov 02 18:03:18 user nova-compute[74980]:     <acpi/>
Nov 02 18:03:18 user nova-compute[74980]:     <apic/>
Nov 02 18:03:18 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 18:03:18 user nova-compute[74980]:   </features>
Nov 02 18:03:18 user nova-compute[74980]:   <clock offset="utc">
Nov 02 18:03:18 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 18:03:18 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 18:03:18 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 18:03:18 user nova-compute[74980]:   </clock>
Nov 02 18:03:18 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 18:03:18 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 18:03:18 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 18:03:18 user nova-compute[74980]:   </cpu>
Nov 02 18:03:18 user nova-compute[74980]:   <devices>
Nov 02 18:03:18 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 18:03:18 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:03:18 user nova-compute[74980]:       <source dev="/dev/sdb"/>
Nov 02 18:03:18 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 18:03:18 user nova-compute[74980]:       <serial>4f3a63f3-95d1-4bfa-8452-dc85dde153ea</serial>
Nov 02 18:03:18 user nova-compute[74980]:     </disk>
Nov 02 18:03:18 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 18:03:18 user nova-compute[74980]:       <mac address="fa:16:3e:8a:b6:68"/>
Nov 02 18:03:18 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 18:03:18 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 18:03:18 user nova-compute[74980]:       <target dev="tapcf2e9843-22"/>
Nov 02 18:03:18 user nova-compute[74980]:     </interface>
Nov 02 18:03:18 user nova-compute[74980]:     <serial type="pty">
Nov 02 18:03:18 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/904d5761-d1a7-4726-bfe9-13be9575f015/console.log" append="off"/>
Nov 02 18:03:18 user nova-compute[74980]:     </serial>
Nov 02 18:03:18 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 18:03:18 user nova-compute[74980]:     <video>
Nov 02 18:03:18 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 18:03:18 user nova-compute[74980]:     </video>
Nov 02 18:03:18 user nova-compute[74980]:     <rng model="virtio">
Nov 02 18:03:18 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 18:03:18 user nova-compute[74980]:     </rng>
Nov 02 18:03:18 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 18:03:18 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 18:03:18 user nova-compute[74980]:       <stats period="10"/>
Nov 02 18:03:18 user nova-compute[74980]:     </memballoon>
Nov 02 18:03:18 user nova-compute[74980]:   </devices>
Nov 02 18:03:18 user nova-compute[74980]: </domain>
Nov 02 18:03:18 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1467296203',display_name='tempest-TestVolumeBootPattern-server-1467296203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1467296203',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ0oxkl6Yy4y5r8YNJgKybtgxWIxjVxrqlTa2t1xJhobm+2dTaCIfDNVa3C22M3ZLYQl8pofX5FRFHgxZksNPoy7tF3GyC4L0dw3OHBi42iMrKQ2mv5uuAnCmx1b8J7EA==',key_name='tempest-TestVolumeBootPattern-1484550038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-eca8szyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T18:02:58Z,user_data=None,user_id='9b309bc195c84c68a52e095927f874f0',uuid=904d5761-d1a7-4726-bfe9-13be9575f015,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf2e9843-2231-40ad-a060-75e30f744045", "address": "fa:16:3e:8a:b6:68", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2e9843-22", "ovs_interfaceid": "cf2e9843-2231-40ad-a060-75e30f744045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "cf2e9843-2231-40ad-a060-75e30f744045", "address": "fa:16:3e:8a:b6:68", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2e9843-22", "ovs_interfaceid": "cf2e9843-2231-40ad-a060-75e30f744045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b6:68,bridge_name='br-int',has_traffic_filtering=True,id=cf2e9843-2231-40ad-a060-75e30f744045,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2e9843-22') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG os_vif [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b6:68,bridge_name='br-int',has_traffic_filtering=True,id=cf2e9843-2231-40ad-a060-75e30f744045,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2e9843-22') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4b1fcc3-5986-5515-9eea-e52ee4fee385', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf2e9843-22, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf2e9843-22, col_values=(('qos', UUID('80e5d774-ddfc-4af5-83ea-61335f247c21')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf2e9843-22, col_values=(('external_ids', {'iface-id': 'cf2e9843-2231-40ad-a060-75e30f744045', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:b6:68', 'vm-uuid': '904d5761-d1a7-4726-bfe9-13be9575f015'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:03:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:18 user nova-compute[74980]: INFO os_vif [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b6:68,bridge_name='br-int',has_traffic_filtering=True,id=cf2e9843-2231-40ad-a060-75e30f744045,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2e9843-22')
Nov 02 18:03:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:03:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] No VIF found with MAC fa:16:3e:8a:b6:68, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 18:03:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:20 user nova-compute[74980]: DEBUG nova.compute.manager [req-2b43a4a8-a971-4287-be91-f0549b35c97f req-4bb3cf57-fddc-4e7b-928a-12cafc67b8a6 service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Received event network-vif-plugged-cf2e9843-2231-40ad-a060-75e30f744045 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:03:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2b43a4a8-a971-4287-be91-f0549b35c97f req-4bb3cf57-fddc-4e7b-928a-12cafc67b8a6 service nova] Acquiring lock "904d5761-d1a7-4726-bfe9-13be9575f015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:03:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2b43a4a8-a971-4287-be91-f0549b35c97f req-4bb3cf57-fddc-4e7b-928a-12cafc67b8a6 service nova] Lock "904d5761-d1a7-4726-bfe9-13be9575f015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:03:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2b43a4a8-a971-4287-be91-f0549b35c97f req-4bb3cf57-fddc-4e7b-928a-12cafc67b8a6 service nova] Lock "904d5761-d1a7-4726-bfe9-13be9575f015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:03:20 user nova-compute[74980]: DEBUG nova.compute.manager [req-2b43a4a8-a971-4287-be91-f0549b35c97f req-4bb3cf57-fddc-4e7b-928a-12cafc67b8a6 service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] No waiting events found dispatching network-vif-plugged-cf2e9843-2231-40ad-a060-75e30f744045 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:03:20 user nova-compute[74980]: WARNING nova.compute.manager [req-2b43a4a8-a971-4287-be91-f0549b35c97f req-4bb3cf57-fddc-4e7b-928a-12cafc67b8a6 service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Received unexpected event network-vif-plugged-cf2e9843-2231-40ad-a060-75e30f744045 for instance with vm_state building and task_state spawning.
Nov 02 18:03:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 18:03:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 18:03:22 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Instance spawned successfully.
Nov 02 18:03:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 18:03:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:03:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:03:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:03:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:03:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:03:22 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:03:22 user nova-compute[74980]: DEBUG nova.compute.manager [req-2b46824f-b1fd-4135-ab79-3538e54a4c54 req-a852db66-ff1c-4baf-9423-55458b028cd1 service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Received event network-vif-plugged-cf2e9843-2231-40ad-a060-75e30f744045 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:03:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2b46824f-b1fd-4135-ab79-3538e54a4c54 req-a852db66-ff1c-4baf-9423-55458b028cd1 service nova] Acquiring lock "904d5761-d1a7-4726-bfe9-13be9575f015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:03:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2b46824f-b1fd-4135-ab79-3538e54a4c54 req-a852db66-ff1c-4baf-9423-55458b028cd1 service nova] Lock "904d5761-d1a7-4726-bfe9-13be9575f015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:03:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2b46824f-b1fd-4135-ab79-3538e54a4c54 req-a852db66-ff1c-4baf-9423-55458b028cd1 service nova] Lock "904d5761-d1a7-4726-bfe9-13be9575f015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:03:22 user nova-compute[74980]: DEBUG nova.compute.manager [req-2b46824f-b1fd-4135-ab79-3538e54a4c54 req-a852db66-ff1c-4baf-9423-55458b028cd1 service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] No waiting events found dispatching network-vif-plugged-cf2e9843-2231-40ad-a060-75e30f744045 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:03:22 user nova-compute[74980]: WARNING nova.compute.manager [req-2b46824f-b1fd-4135-ab79-3538e54a4c54 req-a852db66-ff1c-4baf-9423-55458b028cd1 service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Received unexpected event network-vif-plugged-cf2e9843-2231-40ad-a060-75e30f744045 for instance with vm_state building and task_state spawning.
Nov 02 18:03:22 user nova-compute[74980]: INFO nova.compute.manager [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 02 18:03:22 user nova-compute[74980]: DEBUG nova.compute.manager [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 18:03:22 user nova-compute[74980]: INFO nova.compute.manager [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Took 25.23 seconds to build instance.
Nov 02 18:03:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-eed1839e-6132-4996-80c0-c0652821d22c tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "904d5761-d1a7-4726-bfe9-13be9575f015" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.332s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:03:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:37 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:03:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:03:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:03:37 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:03:37 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:03:37 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 18:03:38 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:03:38 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:03:38 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=25.05371856689453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:03:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:03:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:03:38 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 904d5761-d1a7-4726-bfe9-13be9575f015 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:03:38 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:03:38 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:03:38 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing inventories for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 18:03:38 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating ProviderTree inventory for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 18:03:38 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating inventory in ProviderTree for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 18:03:38 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing aggregate associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, aggregates: None {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 18:03:38 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing trait associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 18:03:38 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:03:38 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:03:38 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:03:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.603s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:03:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:03:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:41 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:03:41 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:03:41 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:03:42 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:03:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:48 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:03:48 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:03:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:49 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:03:50 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:03:50 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 18:03:50 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] There are 0 instances to clean {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 18:03:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:51 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:03:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:03:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:03:54 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:03:54 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:03:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-904d5761-d1a7-4726-bfe9-13be9575f015" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:03:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-904d5761-d1a7-4726-bfe9-13be9575f015" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:03:54 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:03:54 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 904d5761-d1a7-4726-bfe9-13be9575f015 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:03:55 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Updating instance_info_cache with network_info: [{"id": "cf2e9843-2231-40ad-a060-75e30f744045", "address": "fa:16:3e:8a:b6:68", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2e9843-22", "ovs_interfaceid": "cf2e9843-2231-40ad-a060-75e30f744045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:03:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-904d5761-d1a7-4726-bfe9-13be9575f015" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:03:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:03:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:03:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:01 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:04:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:04:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:04:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:04:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:04:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:04:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:04:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:04:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:04:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:04:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:04:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:04:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:04:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:04:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:04:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:04:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:04:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:04:20 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:04:20 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74980) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 18:04:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:04:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:04:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:04:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:04:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:04:29 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:04:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:04:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:04:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:04:34 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:38 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:04:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:04:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:04:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:04:38 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:04:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 18:04:39 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:04:39 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:04:39 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8928MB free_disk=25.043109893798828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:04:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:04:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:04:39 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:04:39 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 904d5761-d1a7-4726-bfe9-13be9575f015 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:04:39 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:04:39 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:04:39 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:04:39 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:04:39 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:04:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:04:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:41 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:04:42 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:04:42 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:04:42 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:04:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:48 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:04:48 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:04:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:49 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG nova.compute.manager [req-e0ccee17-e6ac-47f7-a0fa-6c30df7cbdea req-6e641fc9-dd95-4a8f-b423-140dcd8c5f9e service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Received event network-changed-cf2e9843-2231-40ad-a060-75e30f744045 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG nova.compute.manager [req-e0ccee17-e6ac-47f7-a0fa-6c30df7cbdea req-6e641fc9-dd95-4a8f-b423-140dcd8c5f9e service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Refreshing instance network info cache due to event network-changed-cf2e9843-2231-40ad-a060-75e30f744045. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e0ccee17-e6ac-47f7-a0fa-6c30df7cbdea req-6e641fc9-dd95-4a8f-b423-140dcd8c5f9e service nova] Acquiring lock "refresh_cache-904d5761-d1a7-4726-bfe9-13be9575f015" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e0ccee17-e6ac-47f7-a0fa-6c30df7cbdea req-6e641fc9-dd95-4a8f-b423-140dcd8c5f9e service nova] Acquired lock "refresh_cache-904d5761-d1a7-4726-bfe9-13be9575f015" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG nova.network.neutron [req-e0ccee17-e6ac-47f7-a0fa-6c30df7cbdea req-6e641fc9-dd95-4a8f-b423-140dcd8c5f9e service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Refreshing network info cache for port cf2e9843-2231-40ad-a060-75e30f744045 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "904d5761-d1a7-4726-bfe9-13be9575f015" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "904d5761-d1a7-4726-bfe9-13be9575f015" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "904d5761-d1a7-4726-bfe9-13be9575f015-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "904d5761-d1a7-4726-bfe9-13be9575f015-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "904d5761-d1a7-4726-bfe9-13be9575f015-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:04:50 user nova-compute[74980]: INFO nova.compute.manager [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Terminating instance
Nov 02 18:04:50 user nova-compute[74980]: DEBUG nova.compute.manager [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.network.neutron [req-e0ccee17-e6ac-47f7-a0fa-6c30df7cbdea req-6e641fc9-dd95-4a8f-b423-140dcd8c5f9e service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Updated VIF entry in instance network info cache for port cf2e9843-2231-40ad-a060-75e30f744045. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.network.neutron [req-e0ccee17-e6ac-47f7-a0fa-6c30df7cbdea req-6e641fc9-dd95-4a8f-b423-140dcd8c5f9e service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Updating instance_info_cache with network_info: [{"id": "cf2e9843-2231-40ad-a060-75e30f744045", "address": "fa:16:3e:8a:b6:68", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2e9843-22", "ovs_interfaceid": "cf2e9843-2231-40ad-a060-75e30f744045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e0ccee17-e6ac-47f7-a0fa-6c30df7cbdea req-6e641fc9-dd95-4a8f-b423-140dcd8c5f9e service nova] Releasing lock "refresh_cache-904d5761-d1a7-4726-bfe9-13be9575f015" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Acquiring lock "990d338c-d5fa-440b-a084-452296f6c24b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "990d338c-d5fa-440b-a084-452296f6c24b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-174d757e-c764-4ad4-9d4e-1d65b0367a37 req-2c2d31da-926c-47f1-9e38-51c4e5d49a3e service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Received event network-vif-unplugged-cf2e9843-2231-40ad-a060-75e30f744045 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-174d757e-c764-4ad4-9d4e-1d65b0367a37 req-2c2d31da-926c-47f1-9e38-51c4e5d49a3e service nova] Acquiring lock "904d5761-d1a7-4726-bfe9-13be9575f015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-174d757e-c764-4ad4-9d4e-1d65b0367a37 req-2c2d31da-926c-47f1-9e38-51c4e5d49a3e service nova] Lock "904d5761-d1a7-4726-bfe9-13be9575f015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-174d757e-c764-4ad4-9d4e-1d65b0367a37 req-2c2d31da-926c-47f1-9e38-51c4e5d49a3e service nova] Lock "904d5761-d1a7-4726-bfe9-13be9575f015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-174d757e-c764-4ad4-9d4e-1d65b0367a37 req-2c2d31da-926c-47f1-9e38-51c4e5d49a3e service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] No waiting events found dispatching network-vif-unplugged-cf2e9843-2231-40ad-a060-75e30f744045 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.compute.manager [req-174d757e-c764-4ad4-9d4e-1d65b0367a37 req-2c2d31da-926c-47f1-9e38-51c4e5d49a3e service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Received event network-vif-unplugged-cf2e9843-2231-40ad-a060-75e30f744045 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 18:04:51 user nova-compute[74980]: INFO nova.compute.claims [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Claim successful on node user
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:04:51 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Instance destroyed successfully.
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.objects.instance [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lazy-loading 'resources' on Instance uuid 904d5761-d1a7-4726-bfe9-13be9575f015 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1467296203',display_name='tempest-TestVolumeBootPattern-server-1467296203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1467296203',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ0oxkl6Yy4y5r8YNJgKybtgxWIxjVxrqlTa2t1xJhobm+2dTaCIfDNVa3C22M3ZLYQl8pofX5FRFHgxZksNPoy7tF3GyC4L0dw3OHBi42iMrKQ2mv5uuAnCmx1b8J7EA==',key_name='tempest-TestVolumeBootPattern-1484550038',keypairs=<?>,launch_index=0,launched_at=2023-11-02T18:03:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-eca8szyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T18:03:23Z,user_data=None,user_id='9b309bc195c84c68a52e095927f874f0',uuid=904d5761-d1a7-4726-bfe9-13be9575f015,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf2e9843-2231-40ad-a060-75e30f744045", "address": "fa:16:3e:8a:b6:68", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2e9843-22", "ovs_interfaceid": "cf2e9843-2231-40ad-a060-75e30f744045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "cf2e9843-2231-40ad-a060-75e30f744045", "address": "fa:16:3e:8a:b6:68", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf2e9843-22", "ovs_interfaceid": "cf2e9843-2231-40ad-a060-75e30f744045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:b6:68,bridge_name='br-int',has_traffic_filtering=True,id=cf2e9843-2231-40ad-a060-75e30f744045,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2e9843-22') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_vif [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:b6:68,bridge_name='br-int',has_traffic_filtering=True,id=cf2e9843-2231-40ad-a060-75e30f744045,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2e9843-22') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf2e9843-22, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80e5d774-ddfc-4af5-83ea-61335f247c21) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:51 user nova-compute[74980]: INFO os_vif [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:b6:68,bridge_name='br-int',has_traffic_filtering=True,id=cf2e9843-2231-40ad-a060-75e30f744045,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf2e9843-22')
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkPuByci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:04:51 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5159ceeb-afbb-4d94-9037-135d37cecf51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 18:04:51 user nova-compute[74980]: No targets found.
Nov 02 18:04:51 user nova-compute[74980]: iSNS:
Nov 02 18:04:51 user nova-compute[74980]: No targets found.
Nov 02 18:04:51 user nova-compute[74980]: STATIC:
Nov 02 18:04:51 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea
Nov 02 18:04:51 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 18:04:51 user nova-compute[74980]:                 Iface Name: default
Nov 02 18:04:51 user nova-compute[74980]: FIRMWARE:
Nov 02 18:04:51 user nova-compute[74980]: No targets found.
Nov 02 18:04:51 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 18:04:51 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 18:04:51 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.network.neutron [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:04:51 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a8f68c-7ce1-4058-9ca2-fff6a3be8722]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b03364f-4fa3-4593-a452-07486fc15e7e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)
Nov 02 18:04:51 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)
Nov 02 18:04:51 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5994771e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef666c1-0687-4c6a-9afc-582618348994]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.policy [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e7fa0b3cede4c639568633210d8ee3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18e1e4a698a46ecaf6f46cc16ab744a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[861c4ab0-944c-4d36-86d9-69bbad7d254a]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33654ab-ca9d-48cb-861d-aa29c53c2c6e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 18:04:51 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Creating image(s)
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Acquiring lock "/opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "/opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "/opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88c0897-93c7-4693-8967-d343a2828c5e]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0537ab-caa8-457c-accd-51d0ee70e171]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83cd90d-b5f0-4d29-b008-f2cea881b12f]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260]
Nov 02 18:04:51 user nova-compute[74980]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260] successful.
Nov 02 18:04:51 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e2e277-5061-43d7-8693-207297af2a55]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== disconnect_volume: return (358ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 18:04:51 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Deleting instance files /opt/stack/data/nova/instances/904d5761-d1a7-4726-bfe9-13be9575f015_del
Nov 02 18:04:51 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Deletion of /opt/stack/data/nova/instances/904d5761-d1a7-4726-bfe9-13be9575f015_del complete
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.193s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:04:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:04:52 user nova-compute[74980]: INFO nova.compute.manager [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 02 18:04:52 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.188s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG nova.network.neutron [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Successfully created port: 567623e2-fc73-4676-8a3d-9daf6c5d22c3 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk 1073741824" returned: 0 in 0.079s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Checking if we can resize image /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Cannot resize image /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Ensure instance console log exists: /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG nova.network.neutron [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Successfully updated port: 567623e2-fc73-4676-8a3d-9daf6c5d22c3 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Acquiring lock "refresh_cache-990d338c-d5fa-440b-a084-452296f6c24b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Acquired lock "refresh_cache-990d338c-d5fa-440b-a084-452296f6c24b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG nova.network.neutron [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:04:52 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Took 0.84 seconds to deallocate network for instance.
Nov 02 18:04:52 user nova-compute[74980]: DEBUG nova.compute.manager [req-7cb7da9f-b97e-4a60-9d9f-dcec266db17c req-43c86315-affc-4bbc-b432-1380f2271591 service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Received event network-vif-deleted-cf2e9843-2231-40ad-a060-75e30f744045 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:04:52 user nova-compute[74980]: DEBUG nova.network.neutron [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.network.neutron [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Updating instance_info_cache with network_info: [{"id": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "address": "fa:16:3e:7c:89:87", "network": {"id": "c5c719eb-d6db-45dc-8e56-1051dabe7cbc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1546046815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c18e1e4a698a46ecaf6f46cc16ab744a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567623e2-fc", "ovs_interfaceid": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Releasing lock "refresh_cache-990d338c-d5fa-440b-a084-452296f6c24b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Instance network_info: |[{"id": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "address": "fa:16:3e:7c:89:87", "network": {"id": "c5c719eb-d6db-45dc-8e56-1051dabe7cbc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1546046815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c18e1e4a698a46ecaf6f46cc16ab744a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567623e2-fc", "ovs_interfaceid": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Start _get_guest_xml network_info=[{"id": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "address": "fa:16:3e:7c:89:87", "network": {"id": "c5c719eb-d6db-45dc-8e56-1051dabe7cbc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1546046815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c18e1e4a698a46ecaf6f46cc16ab744a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567623e2-fc", "ovs_interfaceid": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 18:04:53 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:04:53 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:04:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-318266312',display_name='tempest-VolumesActionsTest-instance-318266312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-318266312',id=48,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c18e1e4a698a46ecaf6f46cc16ab744a',ramdisk_id='',reservation_id='r-mk1hueti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-293416740',owner_user_name='tempest-VolumesActionsTest-293416740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T18:04:52Z,user_data=None,user_id='8e7fa0b3cede4c639568633210d8ee3b',uuid=990d338c-d5fa-440b-a084-452296f6c24b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "address": "fa:16:3e:7c:89:87", "network": {"id": "c5c719eb-d6db-45dc-8e56-1051dabe7cbc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1546046815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c18e1e4a698a46ecaf6f46cc16ab744a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567623e2-fc", "ovs_interfaceid": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Converting VIF {"id": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "address": "fa:16:3e:7c:89:87", "network": {"id": "c5c719eb-d6db-45dc-8e56-1051dabe7cbc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1546046815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c18e1e4a698a46ecaf6f46cc16ab744a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567623e2-fc", "ovs_interfaceid": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:89:87,bridge_name='br-int',has_traffic_filtering=True,id=567623e2-fc73-4676-8a3d-9daf6c5d22c3,network=Network(c5c719eb-d6db-45dc-8e56-1051dabe7cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567623e2-fc') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.objects.instance [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lazy-loading 'pci_devices' on Instance uuid 990d338c-d5fa-440b-a084-452296f6c24b {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] End _get_guest_xml xml=<domain type="kvm">
Nov 02 18:04:53 user nova-compute[74980]:   <uuid>990d338c-d5fa-440b-a084-452296f6c24b</uuid>
Nov 02 18:04:53 user nova-compute[74980]:   <name>instance-00000030</name>
Nov 02 18:04:53 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 18:04:53 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 18:04:53 user nova-compute[74980]:   <metadata>
Nov 02 18:04:53 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 18:04:53 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 18:04:53 user nova-compute[74980]:       <nova:name>tempest-VolumesActionsTest-instance-318266312</nova:name>
Nov 02 18:04:53 user nova-compute[74980]:       <nova:creationTime>2023-11-02 18:04:53</nova:creationTime>
Nov 02 18:04:53 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 18:04:53 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 18:04:53 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 18:04:53 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 18:04:53 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 18:04:53 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 18:04:53 user nova-compute[74980]:       </nova:flavor>
Nov 02 18:04:53 user nova-compute[74980]:       <nova:owner>
Nov 02 18:04:53 user nova-compute[74980]:         <nova:user uuid="8e7fa0b3cede4c639568633210d8ee3b">tempest-VolumesActionsTest-293416740-project-member</nova:user>
Nov 02 18:04:53 user nova-compute[74980]:         <nova:project uuid="c18e1e4a698a46ecaf6f46cc16ab744a">tempest-VolumesActionsTest-293416740</nova:project>
Nov 02 18:04:53 user nova-compute[74980]:       </nova:owner>
Nov 02 18:04:53 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 18:04:53 user nova-compute[74980]:       <nova:ports>
Nov 02 18:04:53 user nova-compute[74980]:         <nova:port uuid="567623e2-fc73-4676-8a3d-9daf6c5d22c3">
Nov 02 18:04:53 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 18:04:53 user nova-compute[74980]:         </nova:port>
Nov 02 18:04:53 user nova-compute[74980]:       </nova:ports>
Nov 02 18:04:53 user nova-compute[74980]:     </nova:instance>
Nov 02 18:04:53 user nova-compute[74980]:   </metadata>
Nov 02 18:04:53 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 18:04:53 user nova-compute[74980]:     <system>
Nov 02 18:04:53 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 18:04:53 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 18:04:53 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 18:04:53 user nova-compute[74980]:       <entry name="serial">990d338c-d5fa-440b-a084-452296f6c24b</entry>
Nov 02 18:04:53 user nova-compute[74980]:       <entry name="uuid">990d338c-d5fa-440b-a084-452296f6c24b</entry>
Nov 02 18:04:53 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 18:04:53 user nova-compute[74980]:     </system>
Nov 02 18:04:53 user nova-compute[74980]:   </sysinfo>
Nov 02 18:04:53 user nova-compute[74980]:   <os>
Nov 02 18:04:53 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 18:04:53 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 18:04:53 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 18:04:53 user nova-compute[74980]:   </os>
Nov 02 18:04:53 user nova-compute[74980]:   <features>
Nov 02 18:04:53 user nova-compute[74980]:     <acpi/>
Nov 02 18:04:53 user nova-compute[74980]:     <apic/>
Nov 02 18:04:53 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 18:04:53 user nova-compute[74980]:   </features>
Nov 02 18:04:53 user nova-compute[74980]:   <clock offset="utc">
Nov 02 18:04:53 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 18:04:53 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 18:04:53 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 18:04:53 user nova-compute[74980]:   </clock>
Nov 02 18:04:53 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 18:04:53 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 18:04:53 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 18:04:53 user nova-compute[74980]:   </cpu>
Nov 02 18:04:53 user nova-compute[74980]:   <devices>
Nov 02 18:04:53 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 18:04:53 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 18:04:53 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk"/>
Nov 02 18:04:53 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 18:04:53 user nova-compute[74980]:     </disk>
Nov 02 18:04:53 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 18:04:53 user nova-compute[74980]:       <mac address="fa:16:3e:7c:89:87"/>
Nov 02 18:04:53 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 18:04:53 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 18:04:53 user nova-compute[74980]:       <target dev="tap567623e2-fc"/>
Nov 02 18:04:53 user nova-compute[74980]:     </interface>
Nov 02 18:04:53 user nova-compute[74980]:     <serial type="pty">
Nov 02 18:04:53 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/console.log" append="off"/>
Nov 02 18:04:53 user nova-compute[74980]:     </serial>
Nov 02 18:04:53 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 18:04:53 user nova-compute[74980]:     <video>
Nov 02 18:04:53 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 18:04:53 user nova-compute[74980]:     </video>
Nov 02 18:04:53 user nova-compute[74980]:     <rng model="virtio">
Nov 02 18:04:53 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 18:04:53 user nova-compute[74980]:     </rng>
Nov 02 18:04:53 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 18:04:53 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 18:04:53 user nova-compute[74980]:       <stats period="10"/>
Nov 02 18:04:53 user nova-compute[74980]:     </memballoon>
Nov 02 18:04:53 user nova-compute[74980]:   </devices>
Nov 02 18:04:53 user nova-compute[74980]: </domain>
Nov 02 18:04:53 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:04:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-318266312',display_name='tempest-VolumesActionsTest-instance-318266312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-318266312',id=48,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c18e1e4a698a46ecaf6f46cc16ab744a',ramdisk_id='',reservation_id='r-mk1hueti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-293416740',owner_user_name='tempest-VolumesActionsTest-293416740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T18:04:52Z,user_data=None,user_id='8e7fa0b3cede4c639568633210d8ee3b',uuid=990d338c-d5fa-440b-a084-452296f6c24b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "address": "fa:16:3e:7c:89:87", "network": {"id": "c5c719eb-d6db-45dc-8e56-1051dabe7cbc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1546046815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c18e1e4a698a46ecaf6f46cc16ab744a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567623e2-fc", "ovs_interfaceid": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Converting VIF {"id": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "address": "fa:16:3e:7c:89:87", "network": {"id": "c5c719eb-d6db-45dc-8e56-1051dabe7cbc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1546046815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c18e1e4a698a46ecaf6f46cc16ab744a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567623e2-fc", "ovs_interfaceid": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:89:87,bridge_name='br-int',has_traffic_filtering=True,id=567623e2-fc73-4676-8a3d-9daf6c5d22c3,network=Network(c5c719eb-d6db-45dc-8e56-1051dabe7cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567623e2-fc') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG os_vif [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:89:87,bridge_name='br-int',has_traffic_filtering=True,id=567623e2-fc73-4676-8a3d-9daf6c5d22c3,network=Network(c5c719eb-d6db-45dc-8e56-1051dabe7cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567623e2-fc') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d9d5dd2-dad2-534e-86a5-789f97f44cbc', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-67fe716c-f581-476d-b046-6fac13127646 req-fd9ef73f-e86b-4492-a191-b2edc0d4f30d service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Received event network-vif-plugged-cf2e9843-2231-40ad-a060-75e30f744045 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-67fe716c-f581-476d-b046-6fac13127646 req-fd9ef73f-e86b-4492-a191-b2edc0d4f30d service nova] Acquiring lock "904d5761-d1a7-4726-bfe9-13be9575f015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-67fe716c-f581-476d-b046-6fac13127646 req-fd9ef73f-e86b-4492-a191-b2edc0d4f30d service nova] Lock "904d5761-d1a7-4726-bfe9-13be9575f015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-67fe716c-f581-476d-b046-6fac13127646 req-fd9ef73f-e86b-4492-a191-b2edc0d4f30d service nova] Lock "904d5761-d1a7-4726-bfe9-13be9575f015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-67fe716c-f581-476d-b046-6fac13127646 req-fd9ef73f-e86b-4492-a191-b2edc0d4f30d service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] No waiting events found dispatching network-vif-plugged-cf2e9843-2231-40ad-a060-75e30f744045 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:04:53 user nova-compute[74980]: WARNING nova.compute.manager [req-67fe716c-f581-476d-b046-6fac13127646 req-fd9ef73f-e86b-4492-a191-b2edc0d4f30d service nova] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Received unexpected event network-vif-plugged-cf2e9843-2231-40ad-a060-75e30f744045 for instance with vm_state active and task_state deleting.
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-67fe716c-f581-476d-b046-6fac13127646 req-fd9ef73f-e86b-4492-a191-b2edc0d4f30d service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Received event network-changed-567623e2-fc73-4676-8a3d-9daf6c5d22c3 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-67fe716c-f581-476d-b046-6fac13127646 req-fd9ef73f-e86b-4492-a191-b2edc0d4f30d service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Refreshing instance network info cache due to event network-changed-567623e2-fc73-4676-8a3d-9daf6c5d22c3. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-67fe716c-f581-476d-b046-6fac13127646 req-fd9ef73f-e86b-4492-a191-b2edc0d4f30d service nova] Acquiring lock "refresh_cache-990d338c-d5fa-440b-a084-452296f6c24b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-67fe716c-f581-476d-b046-6fac13127646 req-fd9ef73f-e86b-4492-a191-b2edc0d4f30d service nova] Acquired lock "refresh_cache-990d338c-d5fa-440b-a084-452296f6c24b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.network.neutron [req-67fe716c-f581-476d-b046-6fac13127646 req-fd9ef73f-e86b-4492-a191-b2edc0d4f30d service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Refreshing network info cache for port 567623e2-fc73-4676-8a3d-9daf6c5d22c3 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap567623e2-fc, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap567623e2-fc, col_values=(('qos', UUID('1b16164d-f04c-4480-b933-0a6d12c04b52')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap567623e2-fc, col_values=(('external_ids', {'iface-id': '567623e2-fc73-4676-8a3d-9daf6c5d22c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:89:87', 'vm-uuid': '990d338c-d5fa-440b-a084-452296f6c24b'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:53 user nova-compute[74980]: INFO os_vif [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:89:87,bridge_name='br-int',has_traffic_filtering=True,id=567623e2-fc73-4676-8a3d-9daf6c5d22c3,network=Network(c5c719eb-d6db-45dc-8e56-1051dabe7cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567623e2-fc')
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] No VIF found with MAC fa:16:3e:7c:89:87, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.network.neutron [req-67fe716c-f581-476d-b046-6fac13127646 req-fd9ef73f-e86b-4492-a191-b2edc0d4f30d service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Updated VIF entry in instance network info cache for port 567623e2-fc73-4676-8a3d-9daf6c5d22c3. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.network.neutron [req-67fe716c-f581-476d-b046-6fac13127646 req-fd9ef73f-e86b-4492-a191-b2edc0d4f30d service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Updating instance_info_cache with network_info: [{"id": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "address": "fa:16:3e:7c:89:87", "network": {"id": "c5c719eb-d6db-45dc-8e56-1051dabe7cbc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1546046815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c18e1e4a698a46ecaf6f46cc16ab744a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567623e2-fc", "ovs_interfaceid": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-67fe716c-f581-476d-b046-6fac13127646 req-fd9ef73f-e86b-4492-a191-b2edc0d4f30d service nova] Releasing lock "refresh_cache-990d338c-d5fa-440b-a084-452296f6c24b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:04:53 user nova-compute[74980]: INFO nova.compute.manager [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 904d5761-d1a7-4726-bfe9-13be9575f015] Took 0.87 seconds to detach 1 volumes for instance.
Nov 02 18:04:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:04:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:04:54 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Deleted allocations for instance 904d5761-d1a7-4726-bfe9-13be9575f015
Nov 02 18:04:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-30010e05-0216-4433-ad38-f9bdea017635 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "904d5761-d1a7-4726-bfe9-13be9575f015" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.325s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:04:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-c16e0e6d-bc10-4d61-9af6-3fc010924115 req-33baa5a5-2675-4be9-83c5-f7a5ebc99442 service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Received event network-vif-plugged-567623e2-fc73-4676-8a3d-9daf6c5d22c3 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c16e0e6d-bc10-4d61-9af6-3fc010924115 req-33baa5a5-2675-4be9-83c5-f7a5ebc99442 service nova] Acquiring lock "990d338c-d5fa-440b-a084-452296f6c24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c16e0e6d-bc10-4d61-9af6-3fc010924115 req-33baa5a5-2675-4be9-83c5-f7a5ebc99442 service nova] Lock "990d338c-d5fa-440b-a084-452296f6c24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c16e0e6d-bc10-4d61-9af6-3fc010924115 req-33baa5a5-2675-4be9-83c5-f7a5ebc99442 service nova] Lock "990d338c-d5fa-440b-a084-452296f6c24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-c16e0e6d-bc10-4d61-9af6-3fc010924115 req-33baa5a5-2675-4be9-83c5-f7a5ebc99442 service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] No waiting events found dispatching network-vif-plugged-567623e2-fc73-4676-8a3d-9daf6c5d22c3 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:04:55 user nova-compute[74980]: WARNING nova.compute.manager [req-c16e0e6d-bc10-4d61-9af6-3fc010924115 req-33baa5a5-2675-4be9-83c5-f7a5ebc99442 service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Received unexpected event network-vif-plugged-567623e2-fc73-4676-8a3d-9daf6c5d22c3 for instance with vm_state building and task_state spawning.
Nov 02 18:04:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-c16e0e6d-bc10-4d61-9af6-3fc010924115 req-33baa5a5-2675-4be9-83c5-f7a5ebc99442 service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Received event network-vif-plugged-567623e2-fc73-4676-8a3d-9daf6c5d22c3 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c16e0e6d-bc10-4d61-9af6-3fc010924115 req-33baa5a5-2675-4be9-83c5-f7a5ebc99442 service nova] Acquiring lock "990d338c-d5fa-440b-a084-452296f6c24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c16e0e6d-bc10-4d61-9af6-3fc010924115 req-33baa5a5-2675-4be9-83c5-f7a5ebc99442 service nova] Lock "990d338c-d5fa-440b-a084-452296f6c24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-c16e0e6d-bc10-4d61-9af6-3fc010924115 req-33baa5a5-2675-4be9-83c5-f7a5ebc99442 service nova] Lock "990d338c-d5fa-440b-a084-452296f6c24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-c16e0e6d-bc10-4d61-9af6-3fc010924115 req-33baa5a5-2675-4be9-83c5-f7a5ebc99442 service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] No waiting events found dispatching network-vif-plugged-567623e2-fc73-4676-8a3d-9daf6c5d22c3 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:04:55 user nova-compute[74980]: WARNING nova.compute.manager [req-c16e0e6d-bc10-4d61-9af6-3fc010924115 req-33baa5a5-2675-4be9-83c5-f7a5ebc99442 service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Received unexpected event network-vif-plugged-567623e2-fc73-4676-8a3d-9daf6c5d22c3 for instance with vm_state building and task_state spawning.
Nov 02 18:04:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Skipping network cache update for instance because it is Building. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Didn't find any instances for network info cache update. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 18:04:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:04:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 18:04:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 18:04:56 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Instance spawned successfully.
Nov 02 18:04:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 18:04:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:04:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:04:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:04:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:04:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:04:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:04:56 user nova-compute[74980]: INFO nova.compute.manager [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 02 18:04:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 18:04:56 user nova-compute[74980]: INFO nova.compute.manager [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Took 5.69 seconds to build instance.
Nov 02 18:04:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6bb11577-0e1c-40c6-a16d-d67cf092761d tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "990d338c-d5fa-440b-a084-452296f6c24b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.813s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:04:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:17 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:05:17 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid 990d338c-d5fa-440b-a084-452296f6c24b {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 18:05:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "990d338c-d5fa-440b-a084-452296f6c24b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:05:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "990d338c-d5fa-440b-a084-452296f6c24b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:05:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "990d338c-d5fa-440b-a084-452296f6c24b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:05:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:05:39 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:05:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:05:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:05:39 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:05:39 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:05:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:05:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:05:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:05:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:05:40 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:05:40 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:05:40 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8864MB free_disk=25.0126953125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:05:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:05:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:05:40 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 990d338c-d5fa-440b-a084-452296f6c24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:05:40 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:05:40 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:05:40 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:05:40 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:05:40 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:05:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:05:41 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:05:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "fcab1589-31be-4a96-9aff-5ef9970c54a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:05:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "fcab1589-31be-4a96-9aff-5ef9970c54a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:05:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 18:05:42 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:05:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:05:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:05:42 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 18:05:42 user nova-compute[74980]: INFO nova.compute.claims [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Claim successful on node user
Nov 02 18:05:42 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:05:42 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:05:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:05:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 18:05:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 18:05:42 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 18:05:42 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 18:05:42 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 18:05:42 user nova-compute[74980]: INFO nova.virt.block_device [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Booting with volume 4f3a63f3-95d1-4bfa-8452-dc85dde153ea at /dev/vda
Nov 02 18:05:42 user nova-compute[74980]: DEBUG nova.policy [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b309bc195c84c68a52e095927f874f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84de25c95ef24520aa7c06012991dd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG os_brick.utils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd685264-f45d-415d-979f-21ae73885e97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d8de80-35b4-4347-95c9-73343cebb933]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a37e4d3-ecd5-457c-9168-d5c5540128dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55efa5a-3d2d-4ba8-928d-07a3863e2699]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:05:43 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e3d6ac-1110-4dfe-afd6-c42bb0a29b0c]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG os_brick.utils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Updating existing volume attachment record: b35cf1ad-f297-40a8-a81a-13b03e3933bb {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:43 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Successfully created port: ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 18:05:44 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Successfully updated port: ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 18:05:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:05:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquired lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:05:44 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 18:05:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-01300ff1-85cd-4507-89be-72a5aacd4e52 req-ce08701f-283d-42cb-9308-8dd49c85243c service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Received event network-changed-ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:05:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-01300ff1-85cd-4507-89be-72a5aacd4e52 req-ce08701f-283d-42cb-9308-8dd49c85243c service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Refreshing instance network info cache due to event network-changed-ea05fe87-3b85-4564-a4e9-e65ab71d4205. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 18:05:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-01300ff1-85cd-4507-89be-72a5aacd4e52 req-ce08701f-283d-42cb-9308-8dd49c85243c service nova] Acquiring lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:05:44 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 18:05:44 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:05:44 user nova-compute[74980]: DEBUG nova.network.neutron [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Updating instance_info_cache with network_info: [{"id": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "address": "fa:16:3e:d2:c9:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea05fe87-3b", "ovs_interfaceid": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:05:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Releasing lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:05:44 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Instance network_info: |[{"id": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "address": "fa:16:3e:d2:c9:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea05fe87-3b", "ovs_interfaceid": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 18:05:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-01300ff1-85cd-4507-89be-72a5aacd4e52 req-ce08701f-283d-42cb-9308-8dd49c85243c service nova] Acquired lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:05:44 user nova-compute[74980]: DEBUG nova.network.neutron [req-01300ff1-85cd-4507-89be-72a5aacd4e52 req-ce08701f-283d-42cb-9308-8dd49c85243c service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Refreshing network info cache for port ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 18:05:45 user nova-compute[74980]: DEBUG nova.network.neutron [req-01300ff1-85cd-4507-89be-72a5aacd4e52 req-ce08701f-283d-42cb-9308-8dd49c85243c service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Updated VIF entry in instance network info cache for port ea05fe87-3b85-4564-a4e9-e65ab71d4205. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 18:05:45 user nova-compute[74980]: DEBUG nova.network.neutron [req-01300ff1-85cd-4507-89be-72a5aacd4e52 req-ce08701f-283d-42cb-9308-8dd49c85243c service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Updating instance_info_cache with network_info: [{"id": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "address": "fa:16:3e:d2:c9:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea05fe87-3b", "ovs_interfaceid": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:05:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-01300ff1-85cd-4507-89be-72a5aacd4e52 req-ce08701f-283d-42cb-9308-8dd49c85243c service nova] Releasing lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:05:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:50 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:05:50 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:05:51 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:05:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:05:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:05:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:05:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:05:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:05:53 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:05:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:05:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:05:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:05:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Skipping network cache update for instance because it is Building. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 02 18:05:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-990d338c-d5fa-440b-a084-452296f6c24b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:05:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-990d338c-d5fa-440b-a084-452296f6c24b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:05:55 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:05:55 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 990d338c-d5fa-440b-a084-452296f6c24b {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:05:55 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Updating instance_info_cache with network_info: [{"id": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "address": "fa:16:3e:7c:89:87", "network": {"id": "c5c719eb-d6db-45dc-8e56-1051dabe7cbc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1546046815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c18e1e4a698a46ecaf6f46cc16ab744a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567623e2-fc", "ovs_interfaceid": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:05:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-990d338c-d5fa-440b-a084-452296f6c24b" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:05:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:05:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:05:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 18:06:01 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Creating image(s)
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Ensure instance console log exists: /opt/stack/data/nova/instances/fcab1589-31be-4a96-9aff-5ef9970c54a5/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Start _get_guest_xml network_info=[{"id": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "address": "fa:16:3e:d2:c9:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea05fe87-3b", "ovs_interfaceid": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkPuByci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fcab1589-31be-4a96-9aff-5ef9970c54a5', 'attached_at': '', 'detached_at': '', 'volume_id': '4f3a63f3-95d1-4bfa-8452-dc85dde153ea', 'serial': '4f3a63f3-95d1-4bfa-8452-dc85dde153ea'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'b35cf1ad-f297-40a8-a81a-13b03e3933bb', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 18:06:01 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:06:01 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkPuByci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:06:01 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:06:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:06:01 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:06:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:06:01 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4057d89a-3050-4571-88f7-62e781635b33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 18:06:01 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c15cd9-39ec-4317-9c40-bbe587a6f3e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea] added
Nov 02 18:06:01 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8177cf-b825-4aa9-af00-e35693500ab8]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.066s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef26edbb-9921-493d-947d-103f421b01a4]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkPuByci {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkPuByci" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff55855-655a-43da-8760-3cbb48d45efa]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IkPuByci'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd283837-4f72-41c5-89d5-e1a1b20fd5a7]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8f34a1-0f94-4395-a2ed-7325cc3a05f5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 18:06:01 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 18:06:01 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:06:01 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 18:06:01 user nova-compute[74980]: 
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b823b9d8-db28-4a2f-8621-14137a9d69e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260]
Nov 02 18:06:01 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260] successful.
Nov 02 18:06:01 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1106ffc6-ffd9-456b-8627-322d53be6760]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:06:01 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:06:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:06:02 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec76b31-ca98-4438-9df6-fa20c638b982]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:06:02 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)
Nov 02 18:06:02 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:06:02 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)
Nov 02 18:06:02 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:06:02 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:06:02 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 18:06:02 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 18:06:02 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 18:06:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:06:02 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:06:02 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a23e0f5-a3f6-4392-8572-7208b5ac8203]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:06:02 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkPuByci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26132616665396162', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132616665396162', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-459602381',display_name='tempest-TestVolumeBootPattern-server-459602381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-459602381',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ0oxkl6Yy4y5r8YNJgKybtgxWIxjVxrqlTa2t1xJhobm+2dTaCIfDNVa3C22M3ZLYQl8pofX5FRFHgxZksNPoy7tF3GyC4L0dw3OHBi42iMrKQ2mv5uuAnCmx1b8J7EA==',key_name='tempest-TestVolumeBootPattern-1484550038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-nhl3uzkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T18:05:43Z,user_data=None,user_id='9b309bc195c84c68a52e095927f874f0',uuid=fcab1589-31be-4a96-9aff-5ef9970c54a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "address": "fa:16:3e:d2:c9:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea05fe87-3b", "ovs_interfaceid": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "address": "fa:16:3e:d2:c9:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea05fe87-3b", "ovs_interfaceid": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c9:41,bridge_name='br-int',has_traffic_filtering=True,id=ea05fe87-3b85-4564-a4e9-e65ab71d4205,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea05fe87-3b') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG nova.objects.instance [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lazy-loading 'pci_devices' on Instance uuid fcab1589-31be-4a96-9aff-5ef9970c54a5 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] End _get_guest_xml xml=<domain type="kvm">
Nov 02 18:06:03 user nova-compute[74980]:   <uuid>fcab1589-31be-4a96-9aff-5ef9970c54a5</uuid>
Nov 02 18:06:03 user nova-compute[74980]:   <name>instance-00000031</name>
Nov 02 18:06:03 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 18:06:03 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 18:06:03 user nova-compute[74980]:   <metadata>
Nov 02 18:06:03 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 18:06:03 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 18:06:03 user nova-compute[74980]:       <nova:name>tempest-TestVolumeBootPattern-server-459602381</nova:name>
Nov 02 18:06:03 user nova-compute[74980]:       <nova:creationTime>2023-11-02 18:06:01</nova:creationTime>
Nov 02 18:06:03 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 18:06:03 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 18:06:03 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 18:06:03 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 18:06:03 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 18:06:03 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 18:06:03 user nova-compute[74980]:       </nova:flavor>
Nov 02 18:06:03 user nova-compute[74980]:       <nova:owner>
Nov 02 18:06:03 user nova-compute[74980]:         <nova:user uuid="9b309bc195c84c68a52e095927f874f0">tempest-TestVolumeBootPattern-352919040-project-member</nova:user>
Nov 02 18:06:03 user nova-compute[74980]:         <nova:project uuid="84de25c95ef24520aa7c06012991dd97">tempest-TestVolumeBootPattern-352919040</nova:project>
Nov 02 18:06:03 user nova-compute[74980]:       </nova:owner>
Nov 02 18:06:03 user nova-compute[74980]:       <nova:ports>
Nov 02 18:06:03 user nova-compute[74980]:         <nova:port uuid="ea05fe87-3b85-4564-a4e9-e65ab71d4205">
Nov 02 18:06:03 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 18:06:03 user nova-compute[74980]:         </nova:port>
Nov 02 18:06:03 user nova-compute[74980]:       </nova:ports>
Nov 02 18:06:03 user nova-compute[74980]:     </nova:instance>
Nov 02 18:06:03 user nova-compute[74980]:   </metadata>
Nov 02 18:06:03 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 18:06:03 user nova-compute[74980]:     <system>
Nov 02 18:06:03 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 18:06:03 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 18:06:03 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 18:06:03 user nova-compute[74980]:       <entry name="serial">fcab1589-31be-4a96-9aff-5ef9970c54a5</entry>
Nov 02 18:06:03 user nova-compute[74980]:       <entry name="uuid">fcab1589-31be-4a96-9aff-5ef9970c54a5</entry>
Nov 02 18:06:03 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 18:06:03 user nova-compute[74980]:     </system>
Nov 02 18:06:03 user nova-compute[74980]:   </sysinfo>
Nov 02 18:06:03 user nova-compute[74980]:   <os>
Nov 02 18:06:03 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 18:06:03 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 18:06:03 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 18:06:03 user nova-compute[74980]:   </os>
Nov 02 18:06:03 user nova-compute[74980]:   <features>
Nov 02 18:06:03 user nova-compute[74980]:     <acpi/>
Nov 02 18:06:03 user nova-compute[74980]:     <apic/>
Nov 02 18:06:03 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 18:06:03 user nova-compute[74980]:   </features>
Nov 02 18:06:03 user nova-compute[74980]:   <clock offset="utc">
Nov 02 18:06:03 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 18:06:03 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 18:06:03 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 18:06:03 user nova-compute[74980]:   </clock>
Nov 02 18:06:03 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 18:06:03 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 18:06:03 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 18:06:03 user nova-compute[74980]:   </cpu>
Nov 02 18:06:03 user nova-compute[74980]:   <devices>
Nov 02 18:06:03 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 18:06:03 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:06:03 user nova-compute[74980]:       <source dev="/dev/sdb"/>
Nov 02 18:06:03 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 18:06:03 user nova-compute[74980]:       <serial>4f3a63f3-95d1-4bfa-8452-dc85dde153ea</serial>
Nov 02 18:06:03 user nova-compute[74980]:     </disk>
Nov 02 18:06:03 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 18:06:03 user nova-compute[74980]:       <mac address="fa:16:3e:d2:c9:41"/>
Nov 02 18:06:03 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 18:06:03 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 18:06:03 user nova-compute[74980]:       <target dev="tapea05fe87-3b"/>
Nov 02 18:06:03 user nova-compute[74980]:     </interface>
Nov 02 18:06:03 user nova-compute[74980]:     <serial type="pty">
Nov 02 18:06:03 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/fcab1589-31be-4a96-9aff-5ef9970c54a5/console.log" append="off"/>
Nov 02 18:06:03 user nova-compute[74980]:     </serial>
Nov 02 18:06:03 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 18:06:03 user nova-compute[74980]:     <video>
Nov 02 18:06:03 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 18:06:03 user nova-compute[74980]:     </video>
Nov 02 18:06:03 user nova-compute[74980]:     <rng model="virtio">
Nov 02 18:06:03 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 18:06:03 user nova-compute[74980]:     </rng>
Nov 02 18:06:03 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 18:06:03 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 18:06:03 user nova-compute[74980]:       <stats period="10"/>
Nov 02 18:06:03 user nova-compute[74980]:     </memballoon>
Nov 02 18:06:03 user nova-compute[74980]:   </devices>
Nov 02 18:06:03 user nova-compute[74980]: </domain>
Nov 02 18:06:03 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-459602381',display_name='tempest-TestVolumeBootPattern-server-459602381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-459602381',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ0oxkl6Yy4y5r8YNJgKybtgxWIxjVxrqlTa2t1xJhobm+2dTaCIfDNVa3C22M3ZLYQl8pofX5FRFHgxZksNPoy7tF3GyC4L0dw3OHBi42iMrKQ2mv5uuAnCmx1b8J7EA==',key_name='tempest-TestVolumeBootPattern-1484550038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-nhl3uzkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T18:05:43Z,user_data=None,user_id='9b309bc195c84c68a52e095927f874f0',uuid=fcab1589-31be-4a96-9aff-5ef9970c54a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "address": "fa:16:3e:d2:c9:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea05fe87-3b", "ovs_interfaceid": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "address": "fa:16:3e:d2:c9:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea05fe87-3b", "ovs_interfaceid": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c9:41,bridge_name='br-int',has_traffic_filtering=True,id=ea05fe87-3b85-4564-a4e9-e65ab71d4205,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea05fe87-3b') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG os_vif [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c9:41,bridge_name='br-int',has_traffic_filtering=True,id=ea05fe87-3b85-4564-a4e9-e65ab71d4205,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea05fe87-3b') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3bbdefae-964b-52ae-9b00-6121db6e48ca', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea05fe87-3b, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea05fe87-3b, col_values=(('qos', UUID('3f6af4a5-7a77-426c-98f7-150947889465')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea05fe87-3b, col_values=(('external_ids', {'iface-id': 'ea05fe87-3b85-4564-a4e9-e65ab71d4205', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:c9:41', 'vm-uuid': 'fcab1589-31be-4a96-9aff-5ef9970c54a5'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:03 user nova-compute[74980]: INFO os_vif [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:c9:41,bridge_name='br-int',has_traffic_filtering=True,id=ea05fe87-3b85-4564-a4e9-e65ab71d4205,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea05fe87-3b')
Nov 02 18:06:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:06:03 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] No VIF found with MAC fa:16:3e:d2:c9:41, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 18:06:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-8689354a-0f66-4b21-929d-1079a14ce8bf req-e5d336e4-7df9-461a-ac0a-4f2073add67a service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Received event network-vif-plugged-ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:06:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8689354a-0f66-4b21-929d-1079a14ce8bf req-e5d336e4-7df9-461a-ac0a-4f2073add67a service nova] Acquiring lock "fcab1589-31be-4a96-9aff-5ef9970c54a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:06:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8689354a-0f66-4b21-929d-1079a14ce8bf req-e5d336e4-7df9-461a-ac0a-4f2073add67a service nova] Lock "fcab1589-31be-4a96-9aff-5ef9970c54a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:06:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8689354a-0f66-4b21-929d-1079a14ce8bf req-e5d336e4-7df9-461a-ac0a-4f2073add67a service nova] Lock "fcab1589-31be-4a96-9aff-5ef9970c54a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:06:04 user nova-compute[74980]: DEBUG nova.compute.manager [req-8689354a-0f66-4b21-929d-1079a14ce8bf req-e5d336e4-7df9-461a-ac0a-4f2073add67a service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] No waiting events found dispatching network-vif-plugged-ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:06:04 user nova-compute[74980]: WARNING nova.compute.manager [req-8689354a-0f66-4b21-929d-1079a14ce8bf req-e5d336e4-7df9-461a-ac0a-4f2073add67a service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Received unexpected event network-vif-plugged-ea05fe87-3b85-4564-a4e9-e65ab71d4205 for instance with vm_state building and task_state spawning.
Nov 02 18:06:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 18:06:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 18:06:06 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Instance spawned successfully.
Nov 02 18:06:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 18:06:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:06:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:06:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:06:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:06:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:06:06 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:06:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-f2115762-2e5b-4d76-9d25-05ac47e67e36 req-3dd56ad9-fcbd-484a-bf74-460d6d83fd7b service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Received event network-vif-plugged-ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:06:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f2115762-2e5b-4d76-9d25-05ac47e67e36 req-3dd56ad9-fcbd-484a-bf74-460d6d83fd7b service nova] Acquiring lock "fcab1589-31be-4a96-9aff-5ef9970c54a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:06:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f2115762-2e5b-4d76-9d25-05ac47e67e36 req-3dd56ad9-fcbd-484a-bf74-460d6d83fd7b service nova] Lock "fcab1589-31be-4a96-9aff-5ef9970c54a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:06:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-f2115762-2e5b-4d76-9d25-05ac47e67e36 req-3dd56ad9-fcbd-484a-bf74-460d6d83fd7b service nova] Lock "fcab1589-31be-4a96-9aff-5ef9970c54a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:06:06 user nova-compute[74980]: DEBUG nova.compute.manager [req-f2115762-2e5b-4d76-9d25-05ac47e67e36 req-3dd56ad9-fcbd-484a-bf74-460d6d83fd7b service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] No waiting events found dispatching network-vif-plugged-ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:06:06 user nova-compute[74980]: WARNING nova.compute.manager [req-f2115762-2e5b-4d76-9d25-05ac47e67e36 req-3dd56ad9-fcbd-484a-bf74-460d6d83fd7b service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Received unexpected event network-vif-plugged-ea05fe87-3b85-4564-a4e9-e65ab71d4205 for instance with vm_state building and task_state spawning.
Nov 02 18:06:06 user nova-compute[74980]: INFO nova.compute.manager [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 02 18:06:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 18:06:06 user nova-compute[74980]: INFO nova.compute.manager [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Took 24.23 seconds to build instance.
Nov 02 18:06:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-ce68a93a-7c78-4dc1-ab3a-9d7c354ead29 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "fcab1589-31be-4a96-9aff-5ef9970c54a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.317s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:06:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:06:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:40 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:06:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:06:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:06:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:06:40 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:06:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:06:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:06:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:06:40 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:06:40 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 18:06:41 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:06:41 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:06:41 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8717MB free_disk=25.010913848876953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:06:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:06:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:06:41 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 990d338c-d5fa-440b-a084-452296f6c24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:06:41 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance fcab1589-31be-4a96-9aff-5ef9970c54a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:06:41 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:06:41 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:06:41 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:06:41 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:06:41 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:06:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:06:42 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:06:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:06:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:06:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:06:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:06:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:43 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:06:43 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:06:44 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:06:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:51 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:06:52 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:06:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:06:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:06:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Skipping network cache update for instance because it is being deleted. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Acquiring lock "990d338c-d5fa-440b-a084-452296f6c24b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "990d338c-d5fa-440b-a084-452296f6c24b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Acquiring lock "990d338c-d5fa-440b-a084-452296f6c24b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "990d338c-d5fa-440b-a084-452296f6c24b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "990d338c-d5fa-440b-a084-452296f6c24b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:06:57 user nova-compute[74980]: INFO nova.compute.manager [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Terminating instance
Nov 02 18:06:57 user nova-compute[74980]: DEBUG nova.compute.manager [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid fcab1589-31be-4a96-9aff-5ef9970c54a5 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-5a15359e-ea0e-40da-8960-942b7b256162 req-407e4832-9006-4df1-8000-465705abed0e service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Received event network-vif-unplugged-567623e2-fc73-4676-8a3d-9daf6c5d22c3 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5a15359e-ea0e-40da-8960-942b7b256162 req-407e4832-9006-4df1-8000-465705abed0e service nova] Acquiring lock "990d338c-d5fa-440b-a084-452296f6c24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5a15359e-ea0e-40da-8960-942b7b256162 req-407e4832-9006-4df1-8000-465705abed0e service nova] Lock "990d338c-d5fa-440b-a084-452296f6c24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5a15359e-ea0e-40da-8960-942b7b256162 req-407e4832-9006-4df1-8000-465705abed0e service nova] Lock "990d338c-d5fa-440b-a084-452296f6c24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-5a15359e-ea0e-40da-8960-942b7b256162 req-407e4832-9006-4df1-8000-465705abed0e service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] No waiting events found dispatching network-vif-unplugged-567623e2-fc73-4676-8a3d-9daf6c5d22c3 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:06:57 user nova-compute[74980]: DEBUG nova.compute.manager [req-5a15359e-ea0e-40da-8960-942b7b256162 req-407e4832-9006-4df1-8000-465705abed0e service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Received event network-vif-unplugged-567623e2-fc73-4676-8a3d-9daf6c5d22c3 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:58 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Instance destroyed successfully.
Nov 02 18:06:58 user nova-compute[74980]: DEBUG nova.objects.instance [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lazy-loading 'resources' on Instance uuid 990d338c-d5fa-440b-a084-452296f6c24b {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:04:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-318266312',display_name='tempest-VolumesActionsTest-instance-318266312',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-318266312',id=48,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T18:04:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c18e1e4a698a46ecaf6f46cc16ab744a',ramdisk_id='',reservation_id='r-mk1hueti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-293416740',owner_user_name='tempest-VolumesActionsTest-293416740-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T18:04:57Z,user_data=None,user_id='8e7fa0b3cede4c639568633210d8ee3b',uuid=990d338c-d5fa-440b-a084-452296f6c24b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "address": "fa:16:3e:7c:89:87", "network": {"id": "c5c719eb-d6db-45dc-8e56-1051dabe7cbc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1546046815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c18e1e4a698a46ecaf6f46cc16ab744a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567623e2-fc", "ovs_interfaceid": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Converting VIF {"id": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "address": "fa:16:3e:7c:89:87", "network": {"id": "c5c719eb-d6db-45dc-8e56-1051dabe7cbc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1546046815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c18e1e4a698a46ecaf6f46cc16ab744a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567623e2-fc", "ovs_interfaceid": "567623e2-fc73-4676-8a3d-9daf6c5d22c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:89:87,bridge_name='br-int',has_traffic_filtering=True,id=567623e2-fc73-4676-8a3d-9daf6c5d22c3,network=Network(c5c719eb-d6db-45dc-8e56-1051dabe7cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567623e2-fc') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG os_vif [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:89:87,bridge_name='br-int',has_traffic_filtering=True,id=567623e2-fc73-4676-8a3d-9daf6c5d22c3,network=Network(c5c719eb-d6db-45dc-8e56-1051dabe7cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567623e2-fc') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap567623e2-fc, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b16164d-f04c-4480-b933-0a6d12c04b52) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:06:58 user nova-compute[74980]: INFO os_vif [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:89:87,bridge_name='br-int',has_traffic_filtering=True,id=567623e2-fc73-4676-8a3d-9daf6c5d22c3,network=Network(c5c719eb-d6db-45dc-8e56-1051dabe7cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567623e2-fc')
Nov 02 18:06:58 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Deleting instance files /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b_del
Nov 02 18:06:58 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Deletion of /opt/stack/data/nova/instances/990d338c-d5fa-440b-a084-452296f6c24b_del complete
Nov 02 18:06:58 user nova-compute[74980]: INFO nova.compute.manager [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 02 18:06:58 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Updating instance_info_cache with network_info: [{"id": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "address": "fa:16:3e:d2:c9:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea05fe87-3b", "ovs_interfaceid": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:06:58 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Took 0.44 seconds to deallocate network for instance.
Nov 02 18:06:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:06:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:06:58 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Deleted allocations for instance 990d338c-d5fa-440b-a084-452296f6c24b
Nov 02 18:06:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e16fe87a-552c-49c3-9689-de1939e3dac3 tempest-VolumesActionsTest-293416740 tempest-VolumesActionsTest-293416740-project-member] Lock "990d338c-d5fa-440b-a084-452296f6c24b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.485s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:06:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-19701f80-93d6-41f8-a110-468f9b8641b1 req-0271d8f2-2f01-4116-a6fc-39ee2e787955 service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Received event network-vif-plugged-567623e2-fc73-4676-8a3d-9daf6c5d22c3 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:06:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-19701f80-93d6-41f8-a110-468f9b8641b1 req-0271d8f2-2f01-4116-a6fc-39ee2e787955 service nova] Acquiring lock "990d338c-d5fa-440b-a084-452296f6c24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:06:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-19701f80-93d6-41f8-a110-468f9b8641b1 req-0271d8f2-2f01-4116-a6fc-39ee2e787955 service nova] Lock "990d338c-d5fa-440b-a084-452296f6c24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:06:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-19701f80-93d6-41f8-a110-468f9b8641b1 req-0271d8f2-2f01-4116-a6fc-39ee2e787955 service nova] Lock "990d338c-d5fa-440b-a084-452296f6c24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:06:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-19701f80-93d6-41f8-a110-468f9b8641b1 req-0271d8f2-2f01-4116-a6fc-39ee2e787955 service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] No waiting events found dispatching network-vif-plugged-567623e2-fc73-4676-8a3d-9daf6c5d22c3 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:06:59 user nova-compute[74980]: WARNING nova.compute.manager [req-19701f80-93d6-41f8-a110-468f9b8641b1 req-0271d8f2-2f01-4116-a6fc-39ee2e787955 service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Received unexpected event network-vif-plugged-567623e2-fc73-4676-8a3d-9daf6c5d22c3 for instance with vm_state deleted and task_state None.
Nov 02 18:06:59 user nova-compute[74980]: DEBUG nova.compute.manager [req-19701f80-93d6-41f8-a110-468f9b8641b1 req-0271d8f2-2f01-4116-a6fc-39ee2e787955 service nova] [instance: 990d338c-d5fa-440b-a084-452296f6c24b] Received event network-vif-deleted-567623e2-fc73-4676-8a3d-9daf6c5d22c3 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:07:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:07:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:07:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:07:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:07:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:07:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:07:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:07:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:07:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:07:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:07:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:07:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:07:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:07:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:07:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:07:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:07:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:07:34 user nova-compute[74980]: DEBUG nova.compute.manager [req-e890d634-c736-4ad6-afc6-d09ddfb99514 req-4da75406-a00e-41ea-8e8d-515be21d395a service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Received event network-changed-ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:07:34 user nova-compute[74980]: DEBUG nova.compute.manager [req-e890d634-c736-4ad6-afc6-d09ddfb99514 req-4da75406-a00e-41ea-8e8d-515be21d395a service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Refreshing instance network info cache due to event network-changed-ea05fe87-3b85-4564-a4e9-e65ab71d4205. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 18:07:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e890d634-c736-4ad6-afc6-d09ddfb99514 req-4da75406-a00e-41ea-8e8d-515be21d395a service nova] Acquiring lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:07:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e890d634-c736-4ad6-afc6-d09ddfb99514 req-4da75406-a00e-41ea-8e8d-515be21d395a service nova] Acquired lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:07:34 user nova-compute[74980]: DEBUG nova.network.neutron [req-e890d634-c736-4ad6-afc6-d09ddfb99514 req-4da75406-a00e-41ea-8e8d-515be21d395a service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Refreshing network info cache for port ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 18:07:34 user nova-compute[74980]: DEBUG nova.network.neutron [req-e890d634-c736-4ad6-afc6-d09ddfb99514 req-4da75406-a00e-41ea-8e8d-515be21d395a service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Updated VIF entry in instance network info cache for port ea05fe87-3b85-4564-a4e9-e65ab71d4205. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 18:07:34 user nova-compute[74980]: DEBUG nova.network.neutron [req-e890d634-c736-4ad6-afc6-d09ddfb99514 req-4da75406-a00e-41ea-8e8d-515be21d395a service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Updating instance_info_cache with network_info: [{"id": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "address": "fa:16:3e:d2:c9:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea05fe87-3b", "ovs_interfaceid": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:07:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-e890d634-c736-4ad6-afc6-d09ddfb99514 req-4da75406-a00e-41ea-8e8d-515be21d395a service nova] Releasing lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:07:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:07:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:07:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:07:41 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:07:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:07:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:07:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:07:41 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:07:41 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 18:07:41 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:07:41 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:07:41 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8924MB free_disk=25.037670135498047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:07:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:07:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:07:42 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance fcab1589-31be-4a96-9aff-5ef9970c54a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:07:42 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:07:42 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:07:42 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:07:42 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:07:42 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:07:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:07:43 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:07:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:07:43 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:07:44 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:07:44 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:07:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:07:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:07:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:07:51 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:07:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "98ec4b93-277b-4378-9728-5f4e6080ffcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:07:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "98ec4b93-277b-4378-9728-5f4e6080ffcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:07:51 user nova-compute[74980]: DEBUG nova.compute.manager [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 18:07:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:07:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 18:07:52 user nova-compute[74980]: INFO nova.compute.claims [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Claim successful on node user
Nov 02 18:07:52 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG nova.network.neutron [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 18:07:52 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 18:07:52 user nova-compute[74980]: DEBUG nova.compute.manager [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG nova.policy [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b309bc195c84c68a52e095927f874f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84de25c95ef24520aa7c06012991dd97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 18:07:52 user nova-compute[74980]: INFO nova.virt.block_device [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Booting with volume 917c630d-0e28-4ef9-bff3-a149ef26f106 at /dev/vda
Nov 02 18:07:52 user nova-compute[74980]: DEBUG os_brick.utils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0850abb5-97a4-4d95-9680-bb1e33fcc521]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c36491-b7d5-4310-a99d-ebf780301917]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff542bcb-d8e5-4eda-a641-88481053cc16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbd4132-d343-472b-a502-c9a191c712c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:07:52 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 18:07:52 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[55898949-22a8-477c-9ccf-fca42be9f2d8]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG os_brick.utils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:07:52 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Updating existing volume attachment record: 73347ae9-06c0-4129-a24b-ef7133d4bc55 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 18:07:53 user nova-compute[74980]: DEBUG nova.network.neutron [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Successfully created port: 52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 18:07:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:07:53 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:07:53 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:07:53 user nova-compute[74980]: DEBUG nova.network.neutron [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Successfully updated port: 52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 18:07:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "refresh_cache-98ec4b93-277b-4378-9728-5f4e6080ffcc" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:07:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquired lock "refresh_cache-98ec4b93-277b-4378-9728-5f4e6080ffcc" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:07:53 user nova-compute[74980]: DEBUG nova.network.neutron [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 18:07:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-d5f10ab2-bad4-429b-9b28-050d068a701b req-f8d1fc79-e72e-45a3-8a93-bc63a8928a59 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Received event network-changed-52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:07:53 user nova-compute[74980]: DEBUG nova.compute.manager [req-d5f10ab2-bad4-429b-9b28-050d068a701b req-f8d1fc79-e72e-45a3-8a93-bc63a8928a59 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Refreshing instance network info cache due to event network-changed-52c2ab41-608c-4714-aef5-415ba2a51c88. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 18:07:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d5f10ab2-bad4-429b-9b28-050d068a701b req-f8d1fc79-e72e-45a3-8a93-bc63a8928a59 service nova] Acquiring lock "refresh_cache-98ec4b93-277b-4378-9728-5f4e6080ffcc" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:07:53 user nova-compute[74980]: DEBUG nova.network.neutron [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 18:07:54 user nova-compute[74980]: DEBUG nova.network.neutron [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Updating instance_info_cache with network_info: [{"id": "52c2ab41-608c-4714-aef5-415ba2a51c88", "address": "fa:16:3e:62:04:c2", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c2ab41-60", "ovs_interfaceid": "52c2ab41-608c-4714-aef5-415ba2a51c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:07:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Releasing lock "refresh_cache-98ec4b93-277b-4378-9728-5f4e6080ffcc" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:07:54 user nova-compute[74980]: DEBUG nova.compute.manager [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Instance network_info: |[{"id": "52c2ab41-608c-4714-aef5-415ba2a51c88", "address": "fa:16:3e:62:04:c2", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c2ab41-60", "ovs_interfaceid": "52c2ab41-608c-4714-aef5-415ba2a51c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 18:07:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d5f10ab2-bad4-429b-9b28-050d068a701b req-f8d1fc79-e72e-45a3-8a93-bc63a8928a59 service nova] Acquired lock "refresh_cache-98ec4b93-277b-4378-9728-5f4e6080ffcc" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:07:54 user nova-compute[74980]: DEBUG nova.network.neutron [req-d5f10ab2-bad4-429b-9b28-050d068a701b req-f8d1fc79-e72e-45a3-8a93-bc63a8928a59 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Refreshing network info cache for port 52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 18:07:54 user nova-compute[74980]: DEBUG nova.network.neutron [req-d5f10ab2-bad4-429b-9b28-050d068a701b req-f8d1fc79-e72e-45a3-8a93-bc63a8928a59 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Updated VIF entry in instance network info cache for port 52c2ab41-608c-4714-aef5-415ba2a51c88. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 18:07:54 user nova-compute[74980]: DEBUG nova.network.neutron [req-d5f10ab2-bad4-429b-9b28-050d068a701b req-f8d1fc79-e72e-45a3-8a93-bc63a8928a59 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Updating instance_info_cache with network_info: [{"id": "52c2ab41-608c-4714-aef5-415ba2a51c88", "address": "fa:16:3e:62:04:c2", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c2ab41-60", "ovs_interfaceid": "52c2ab41-608c-4714-aef5-415ba2a51c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:07:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-d5f10ab2-bad4-429b-9b28-050d068a701b req-f8d1fc79-e72e-45a3-8a93-bc63a8928a59 service nova] Releasing lock "refresh_cache-98ec4b93-277b-4378-9728-5f4e6080ffcc" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:07:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:07:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:07:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:07:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:07:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:07:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:07:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:07:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:07:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:07:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:07:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Skipping network cache update for instance because it is Building. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 02 18:07:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:07:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:07:58 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:07:58 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid fcab1589-31be-4a96-9aff-5ef9970c54a5 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:07:59 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Updating instance_info_cache with network_info: [{"id": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "address": "fa:16:3e:d2:c9:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea05fe87-3b", "ovs_interfaceid": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:07:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:07:59 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:08:01 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:08:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:08:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 18:08:11 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Creating image(s)
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Did not create local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Ensure instance console log exists: /opt/stack/data/nova/instances/98ec4b93-277b-4378-9728-5f4e6080ffcc/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Start _get_guest_xml network_info=[{"id": "52c2ab41-608c-4714-aef5-415ba2a51c88", "address": "fa:16:3e:62:04:c2", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c2ab41-60", "ovs_interfaceid": "52c2ab41-608c-4714-aef5-415ba2a51c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZtQyPqS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '98ec4b93-277b-4378-9728-5f4e6080ffcc', 'attached_at': '', 'detached_at': '', 'volume_id': '917c630d-0e28-4ef9-bff3-a149ef26f106', 'serial': '917c630d-0e28-4ef9-bff3-a149ef26f106'}, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '73347ae9-06c0-4129-a24b-ef7133d4bc55', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 18:08:11 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:08:11 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZtQyPqS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:08:11 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:08:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:08:11 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:08:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:08:11 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d20e5d8-d2d2-4132-9357-ba68a07b1a4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 18:08:11 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b29706-7a95-42ed-8378-df79c4a32b0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106] added
Nov 02 18:08:11 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[05566627-2ffc-4f09-b130-1b77cd79ff5a]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[93732b0e-3361-403c-bcda-31550a9f676d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RZtQyPqS {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RZtQyPqS" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[42651e04-15a4-4461-952e-1c8dbae41b55]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RZtQyPqS'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e8bf70-e9e4-4f8a-a179-5ced0f9bb2b5]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd76210f-4762-4647-b311-2c90edec1424]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)
Nov 02 18:08:11 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)
Nov 02 18:08:11 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:08:11 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[187c6709-f4c2-4bd7-998d-bd93cbfd407d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106, portal: 172.16.0.220,3260]
Nov 02 18:08:12 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106, portal: 172.16.0.220,3260] successful.
Nov 02 18:08:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b752eb8-a9f2-4645-ad74-e25e11a57bb3]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba62c646-e11b-41ba-8319-918e5718a1fb]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)
Nov 02 18:08:12 user nova-compute[74980]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 (non-flash)
Nov 02 18:08:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)
Nov 02 18:08:12 user nova-compute[74980]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 (non-flash)
Nov 02 18:08:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e627c8-935b-4c76-9de9-a1da83cc6012]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:08:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZtQyPqS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26665616638343137', 'path': '/dev/sdc'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665616638343137', 'path': '/dev/sdc'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-870765703',display_name='tempest-TestVolumeBootPattern-server-870765703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-870765703',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ0oxkl6Yy4y5r8YNJgKybtgxWIxjVxrqlTa2t1xJhobm+2dTaCIfDNVa3C22M3ZLYQl8pofX5FRFHgxZksNPoy7tF3GyC4L0dw3OHBi42iMrKQ2mv5uuAnCmx1b8J7EA==',key_name='tempest-TestVolumeBootPattern-1484550038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-65mo9o0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T18:07:52Z,user_data=None,user_id='9b309bc195c84c68a52e095927f874f0',uuid=98ec4b93-277b-4378-9728-5f4e6080ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52c2ab41-608c-4714-aef5-415ba2a51c88", "address": "fa:16:3e:62:04:c2", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c2ab41-60", "ovs_interfaceid": "52c2ab41-608c-4714-aef5-415ba2a51c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "52c2ab41-608c-4714-aef5-415ba2a51c88", "address": "fa:16:3e:62:04:c2", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c2ab41-60", "ovs_interfaceid": "52c2ab41-608c-4714-aef5-415ba2a51c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:04:c2,bridge_name='br-int',has_traffic_filtering=True,id=52c2ab41-608c-4714-aef5-415ba2a51c88,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52c2ab41-60') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG nova.objects.instance [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lazy-loading 'pci_devices' on Instance uuid 98ec4b93-277b-4378-9728-5f4e6080ffcc {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] End _get_guest_xml xml=<domain type="kvm">
Nov 02 18:08:13 user nova-compute[74980]:   <uuid>98ec4b93-277b-4378-9728-5f4e6080ffcc</uuid>
Nov 02 18:08:13 user nova-compute[74980]:   <name>instance-00000032</name>
Nov 02 18:08:13 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 18:08:13 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 18:08:13 user nova-compute[74980]:   <metadata>
Nov 02 18:08:13 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 18:08:13 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 18:08:13 user nova-compute[74980]:       <nova:name>tempest-TestVolumeBootPattern-server-870765703</nova:name>
Nov 02 18:08:13 user nova-compute[74980]:       <nova:creationTime>2023-11-02 18:08:11</nova:creationTime>
Nov 02 18:08:13 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 18:08:13 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 18:08:13 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 18:08:13 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 18:08:13 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 18:08:13 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 18:08:13 user nova-compute[74980]:       </nova:flavor>
Nov 02 18:08:13 user nova-compute[74980]:       <nova:owner>
Nov 02 18:08:13 user nova-compute[74980]:         <nova:user uuid="9b309bc195c84c68a52e095927f874f0">tempest-TestVolumeBootPattern-352919040-project-member</nova:user>
Nov 02 18:08:13 user nova-compute[74980]:         <nova:project uuid="84de25c95ef24520aa7c06012991dd97">tempest-TestVolumeBootPattern-352919040</nova:project>
Nov 02 18:08:13 user nova-compute[74980]:       </nova:owner>
Nov 02 18:08:13 user nova-compute[74980]:       <nova:ports>
Nov 02 18:08:13 user nova-compute[74980]:         <nova:port uuid="52c2ab41-608c-4714-aef5-415ba2a51c88">
Nov 02 18:08:13 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 18:08:13 user nova-compute[74980]:         </nova:port>
Nov 02 18:08:13 user nova-compute[74980]:       </nova:ports>
Nov 02 18:08:13 user nova-compute[74980]:     </nova:instance>
Nov 02 18:08:13 user nova-compute[74980]:   </metadata>
Nov 02 18:08:13 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 18:08:13 user nova-compute[74980]:     <system>
Nov 02 18:08:13 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 18:08:13 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 18:08:13 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 18:08:13 user nova-compute[74980]:       <entry name="serial">98ec4b93-277b-4378-9728-5f4e6080ffcc</entry>
Nov 02 18:08:13 user nova-compute[74980]:       <entry name="uuid">98ec4b93-277b-4378-9728-5f4e6080ffcc</entry>
Nov 02 18:08:13 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 18:08:13 user nova-compute[74980]:     </system>
Nov 02 18:08:13 user nova-compute[74980]:   </sysinfo>
Nov 02 18:08:13 user nova-compute[74980]:   <os>
Nov 02 18:08:13 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 18:08:13 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 18:08:13 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 18:08:13 user nova-compute[74980]:   </os>
Nov 02 18:08:13 user nova-compute[74980]:   <features>
Nov 02 18:08:13 user nova-compute[74980]:     <acpi/>
Nov 02 18:08:13 user nova-compute[74980]:     <apic/>
Nov 02 18:08:13 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 18:08:13 user nova-compute[74980]:   </features>
Nov 02 18:08:13 user nova-compute[74980]:   <clock offset="utc">
Nov 02 18:08:13 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 18:08:13 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 18:08:13 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 18:08:13 user nova-compute[74980]:   </clock>
Nov 02 18:08:13 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 18:08:13 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 18:08:13 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 18:08:13 user nova-compute[74980]:   </cpu>
Nov 02 18:08:13 user nova-compute[74980]:   <devices>
Nov 02 18:08:13 user nova-compute[74980]:     <disk type="block" device="disk">
Nov 02 18:08:13 user nova-compute[74980]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:08:13 user nova-compute[74980]:       <source dev="/dev/sdc"/>
Nov 02 18:08:13 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 18:08:13 user nova-compute[74980]:       <serial>917c630d-0e28-4ef9-bff3-a149ef26f106</serial>
Nov 02 18:08:13 user nova-compute[74980]:     </disk>
Nov 02 18:08:13 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 18:08:13 user nova-compute[74980]:       <mac address="fa:16:3e:62:04:c2"/>
Nov 02 18:08:13 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 18:08:13 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 18:08:13 user nova-compute[74980]:       <target dev="tap52c2ab41-60"/>
Nov 02 18:08:13 user nova-compute[74980]:     </interface>
Nov 02 18:08:13 user nova-compute[74980]:     <serial type="pty">
Nov 02 18:08:13 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/98ec4b93-277b-4378-9728-5f4e6080ffcc/console.log" append="off"/>
Nov 02 18:08:13 user nova-compute[74980]:     </serial>
Nov 02 18:08:13 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 18:08:13 user nova-compute[74980]:     <video>
Nov 02 18:08:13 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 18:08:13 user nova-compute[74980]:     </video>
Nov 02 18:08:13 user nova-compute[74980]:     <rng model="virtio">
Nov 02 18:08:13 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 18:08:13 user nova-compute[74980]:     </rng>
Nov 02 18:08:13 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 18:08:13 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 18:08:13 user nova-compute[74980]:       <stats period="10"/>
Nov 02 18:08:13 user nova-compute[74980]:     </memballoon>
Nov 02 18:08:13 user nova-compute[74980]:   </devices>
Nov 02 18:08:13 user nova-compute[74980]: </domain>
Nov 02 18:08:13 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-870765703',display_name='tempest-TestVolumeBootPattern-server-870765703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-870765703',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ0oxkl6Yy4y5r8YNJgKybtgxWIxjVxrqlTa2t1xJhobm+2dTaCIfDNVa3C22M3ZLYQl8pofX5FRFHgxZksNPoy7tF3GyC4L0dw3OHBi42iMrKQ2mv5uuAnCmx1b8J7EA==',key_name='tempest-TestVolumeBootPattern-1484550038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-65mo9o0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T18:07:52Z,user_data=None,user_id='9b309bc195c84c68a52e095927f874f0',uuid=98ec4b93-277b-4378-9728-5f4e6080ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52c2ab41-608c-4714-aef5-415ba2a51c88", "address": "fa:16:3e:62:04:c2", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c2ab41-60", "ovs_interfaceid": "52c2ab41-608c-4714-aef5-415ba2a51c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "52c2ab41-608c-4714-aef5-415ba2a51c88", "address": "fa:16:3e:62:04:c2", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c2ab41-60", "ovs_interfaceid": "52c2ab41-608c-4714-aef5-415ba2a51c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:04:c2,bridge_name='br-int',has_traffic_filtering=True,id=52c2ab41-608c-4714-aef5-415ba2a51c88,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52c2ab41-60') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG os_vif [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:04:c2,bridge_name='br-int',has_traffic_filtering=True,id=52c2ab41-608c-4714-aef5-415ba2a51c88,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52c2ab41-60') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5107cdb4-998f-5f95-a931-d33557246c40', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52c2ab41-60, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52c2ab41-60, col_values=(('qos', UUID('6b48cd43-6638-43ca-bc0d-d521b3583a5e')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52c2ab41-60, col_values=(('external_ids', {'iface-id': '52c2ab41-608c-4714-aef5-415ba2a51c88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:04:c2', 'vm-uuid': '98ec4b93-277b-4378-9728-5f4e6080ffcc'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:13 user nova-compute[74980]: INFO os_vif [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:04:c2,bridge_name='br-int',has_traffic_filtering=True,id=52c2ab41-608c-4714-aef5-415ba2a51c88,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52c2ab41-60')
Nov 02 18:08:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:08:13 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] No VIF found with MAC fa:16:3e:62:04:c2, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 18:08:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-af6e2fa3-c6ed-484d-8ed3-2fe7ce6b8119 req-a5518b6f-1347-45e8-9ebc-c8fbc4e44368 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Received event network-vif-plugged-52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:08:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-af6e2fa3-c6ed-484d-8ed3-2fe7ce6b8119 req-a5518b6f-1347-45e8-9ebc-c8fbc4e44368 service nova] Acquiring lock "98ec4b93-277b-4378-9728-5f4e6080ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:08:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-af6e2fa3-c6ed-484d-8ed3-2fe7ce6b8119 req-a5518b6f-1347-45e8-9ebc-c8fbc4e44368 service nova] Lock "98ec4b93-277b-4378-9728-5f4e6080ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:08:14 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-af6e2fa3-c6ed-484d-8ed3-2fe7ce6b8119 req-a5518b6f-1347-45e8-9ebc-c8fbc4e44368 service nova] Lock "98ec4b93-277b-4378-9728-5f4e6080ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:08:14 user nova-compute[74980]: DEBUG nova.compute.manager [req-af6e2fa3-c6ed-484d-8ed3-2fe7ce6b8119 req-a5518b6f-1347-45e8-9ebc-c8fbc4e44368 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] No waiting events found dispatching network-vif-plugged-52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:08:14 user nova-compute[74980]: WARNING nova.compute.manager [req-af6e2fa3-c6ed-484d-8ed3-2fe7ce6b8119 req-a5518b6f-1347-45e8-9ebc-c8fbc4e44368 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Received unexpected event network-vif-plugged-52c2ab41-608c-4714-aef5-415ba2a51c88 for instance with vm_state building and task_state spawning.
Nov 02 18:08:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:16 user nova-compute[74980]: DEBUG nova.compute.manager [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 18:08:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 18:08:16 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Instance spawned successfully.
Nov 02 18:08:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 18:08:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:08:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:08:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:08:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:08:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:08:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:08:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-5c2bea41-9b4c-4955-8275-75432050df08 req-1e140485-fbd7-437d-bdb9-9c2fdb8a361d service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Received event network-vif-plugged-52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:08:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5c2bea41-9b4c-4955-8275-75432050df08 req-1e140485-fbd7-437d-bdb9-9c2fdb8a361d service nova] Acquiring lock "98ec4b93-277b-4378-9728-5f4e6080ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:08:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5c2bea41-9b4c-4955-8275-75432050df08 req-1e140485-fbd7-437d-bdb9-9c2fdb8a361d service nova] Lock "98ec4b93-277b-4378-9728-5f4e6080ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:08:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5c2bea41-9b4c-4955-8275-75432050df08 req-1e140485-fbd7-437d-bdb9-9c2fdb8a361d service nova] Lock "98ec4b93-277b-4378-9728-5f4e6080ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:08:16 user nova-compute[74980]: DEBUG nova.compute.manager [req-5c2bea41-9b4c-4955-8275-75432050df08 req-1e140485-fbd7-437d-bdb9-9c2fdb8a361d service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] No waiting events found dispatching network-vif-plugged-52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:08:16 user nova-compute[74980]: WARNING nova.compute.manager [req-5c2bea41-9b4c-4955-8275-75432050df08 req-1e140485-fbd7-437d-bdb9-9c2fdb8a361d service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Received unexpected event network-vif-plugged-52c2ab41-608c-4714-aef5-415ba2a51c88 for instance with vm_state building and task_state spawning.
Nov 02 18:08:16 user nova-compute[74980]: INFO nova.compute.manager [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 02 18:08:16 user nova-compute[74980]: DEBUG nova.compute.manager [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 18:08:16 user nova-compute[74980]: INFO nova.compute.manager [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Took 24.84 seconds to build instance.
Nov 02 18:08:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-9d6396ab-89c5-4e2a-bacd-e07ae7d770bc tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "98ec4b93-277b-4378-9728-5f4e6080ffcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.958s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:08:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:08:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:38 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:41 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:08:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:08:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:08:41 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:08:41 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:08:41 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 18:08:41 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 18:08:42 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:08:42 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:08:42 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8810MB free_disk=25.02731704711914GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:08:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:08:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:08:42 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance fcab1589-31be-4a96-9aff-5ef9970c54a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:08:42 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 98ec4b93-277b-4378-9728-5f4e6080ffcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:08:42 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:08:42 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:08:42 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing inventories for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 18:08:42 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating ProviderTree inventory for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 18:08:42 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating inventory in ProviderTree for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 18:08:42 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing aggregate associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, aggregates: None {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 18:08:42 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing trait associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 18:08:42 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:08:42 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:08:42 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:08:42 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:08:43 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:44 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:08:44 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:08:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:46 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:08:46 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:08:48 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:51 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:08:51 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 18:08:51 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] There are 0 instances to clean {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 18:08:53 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:53 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:08:53 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:08:53 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:08:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:08:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:08:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:08:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:08:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:08:58 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:08:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:08:59 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:08:59 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:08:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:08:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:08:59 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:08:59 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid fcab1589-31be-4a96-9aff-5ef9970c54a5 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:09:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Updating instance_info_cache with network_info: [{"id": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "address": "fa:16:3e:d2:c9:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea05fe87-3b", "ovs_interfaceid": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:09:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:09:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:09:02 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:09:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:09:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:09:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:09:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:09:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:08 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:23 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:24 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:26 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:09:26 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74980) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 18:09:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:28 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquiring lock "6eed0831-d502-4ebe-84e3-5e83f0de5981" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:09:32 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:09:32 user nova-compute[74980]: DEBUG nova.compute.manager [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 18:09:33 user nova-compute[74980]: INFO nova.compute.claims [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Claim successful on node user
Nov 02 18:09:33 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG nova.network.neutron [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 18:09:33 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 18:09:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG nova.policy [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90c6d0315d834ac591f7b045bbd28bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0416d8eb4e674d638bbcdcc9dec8622a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 18:09:33 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Creating image(s)
Nov 02 18:09:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquiring lock "/opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "/opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "/opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:33 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk 1073741824" returned: 0 in 0.053s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG nova.network.neutron [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Successfully created port: 876aeeb8-a5c5-4ff4-b061-618b62b34566 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Cannot resize image /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Ensure instance console log exists: /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG nova.network.neutron [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Successfully updated port: 876aeeb8-a5c5-4ff4-b061-618b62b34566 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquiring lock "refresh_cache-6eed0831-d502-4ebe-84e3-5e83f0de5981" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquired lock "refresh_cache-6eed0831-d502-4ebe-84e3-5e83f0de5981" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG nova.network.neutron [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG nova.compute.manager [req-a108605a-c218-48db-b515-963864d579e7 req-68183f78-d098-4340-9838-d2d4fb2bd65a service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Received event network-changed-876aeeb8-a5c5-4ff4-b061-618b62b34566 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG nova.compute.manager [req-a108605a-c218-48db-b515-963864d579e7 req-68183f78-d098-4340-9838-d2d4fb2bd65a service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Refreshing instance network info cache due to event network-changed-876aeeb8-a5c5-4ff4-b061-618b62b34566. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a108605a-c218-48db-b515-963864d579e7 req-68183f78-d098-4340-9838-d2d4fb2bd65a service nova] Acquiring lock "refresh_cache-6eed0831-d502-4ebe-84e3-5e83f0de5981" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:09:34 user nova-compute[74980]: DEBUG nova.network.neutron [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.network.neutron [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Updating instance_info_cache with network_info: [{"id": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "address": "fa:16:3e:81:23:65", "network": {"id": "2ebc9fb0-7f27-45e5-8272-71d871472c46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2127449843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0416d8eb4e674d638bbcdcc9dec8622a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876aeeb8-a5", "ovs_interfaceid": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Releasing lock "refresh_cache-6eed0831-d502-4ebe-84e3-5e83f0de5981" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.compute.manager [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Instance network_info: |[{"id": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "address": "fa:16:3e:81:23:65", "network": {"id": "2ebc9fb0-7f27-45e5-8272-71d871472c46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2127449843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0416d8eb4e674d638bbcdcc9dec8622a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876aeeb8-a5", "ovs_interfaceid": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a108605a-c218-48db-b515-963864d579e7 req-68183f78-d098-4340-9838-d2d4fb2bd65a service nova] Acquired lock "refresh_cache-6eed0831-d502-4ebe-84e3-5e83f0de5981" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.network.neutron [req-a108605a-c218-48db-b515-963864d579e7 req-68183f78-d098-4340-9838-d2d4fb2bd65a service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Refreshing network info cache for port 876aeeb8-a5c5-4ff4-b061-618b62b34566 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Start _get_guest_xml network_info=[{"id": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "address": "fa:16:3e:81:23:65", "network": {"id": "2ebc9fb0-7f27-45e5-8272-71d871472c46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2127449843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0416d8eb4e674d638bbcdcc9dec8622a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876aeeb8-a5", "ovs_interfaceid": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 18:09:35 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:09:35 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:09:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-94801820',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-94801820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9480182',id=51,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIVmTBnzEAT8Cg6iAt3l00EpSB5pNZ9g7KRy09BBEFJWZ4pw0R6uNdaZiNDkrD1CjTTBe4anhaM/6GqKu4OZ5zSqbx+JEWs8qtGppdUBvIZmTn94Ur6FfFJzbnVeSFq+g==',key_name='tempest-keypair-475341387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0416d8eb4e674d638bbcdcc9dec8622a',ramdisk_id='',reservation_id='r-aoaso9f9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1493310358',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T18:09:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90c6d0315d834ac591f7b045bbd28bb2',uuid=6eed0831-d502-4ebe-84e3-5e83f0de5981,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "address": "fa:16:3e:81:23:65", "network": {"id": "2ebc9fb0-7f27-45e5-8272-71d871472c46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2127449843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0416d8eb4e674d638bbcdcc9dec8622a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876aeeb8-a5", "ovs_interfaceid": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Converting VIF {"id": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "address": "fa:16:3e:81:23:65", "network": {"id": "2ebc9fb0-7f27-45e5-8272-71d871472c46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2127449843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0416d8eb4e674d638bbcdcc9dec8622a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876aeeb8-a5", "ovs_interfaceid": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:23:65,bridge_name='br-int',has_traffic_filtering=True,id=876aeeb8-a5c5-4ff4-b061-618b62b34566,network=Network(2ebc9fb0-7f27-45e5-8272-71d871472c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap876aeeb8-a5') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.objects.instance [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lazy-loading 'pci_devices' on Instance uuid 6eed0831-d502-4ebe-84e3-5e83f0de5981 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] End _get_guest_xml xml=<domain type="kvm">
Nov 02 18:09:35 user nova-compute[74980]:   <uuid>6eed0831-d502-4ebe-84e3-5e83f0de5981</uuid>
Nov 02 18:09:35 user nova-compute[74980]:   <name>instance-00000033</name>
Nov 02 18:09:35 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 18:09:35 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 18:09:35 user nova-compute[74980]:   <metadata>
Nov 02 18:09:35 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 18:09:35 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 18:09:35 user nova-compute[74980]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-94801820</nova:name>
Nov 02 18:09:35 user nova-compute[74980]:       <nova:creationTime>2023-11-02 18:09:35</nova:creationTime>
Nov 02 18:09:35 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 18:09:35 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 18:09:35 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 18:09:35 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 18:09:35 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 18:09:35 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 18:09:35 user nova-compute[74980]:       </nova:flavor>
Nov 02 18:09:35 user nova-compute[74980]:       <nova:owner>
Nov 02 18:09:35 user nova-compute[74980]:         <nova:user uuid="90c6d0315d834ac591f7b045bbd28bb2">tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member</nova:user>
Nov 02 18:09:35 user nova-compute[74980]:         <nova:project uuid="0416d8eb4e674d638bbcdcc9dec8622a">tempest-TestServerVolumeAttachScenarioOldVersion-1493310358</nova:project>
Nov 02 18:09:35 user nova-compute[74980]:       </nova:owner>
Nov 02 18:09:35 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 18:09:35 user nova-compute[74980]:       <nova:ports>
Nov 02 18:09:35 user nova-compute[74980]:         <nova:port uuid="876aeeb8-a5c5-4ff4-b061-618b62b34566">
Nov 02 18:09:35 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 18:09:35 user nova-compute[74980]:         </nova:port>
Nov 02 18:09:35 user nova-compute[74980]:       </nova:ports>
Nov 02 18:09:35 user nova-compute[74980]:     </nova:instance>
Nov 02 18:09:35 user nova-compute[74980]:   </metadata>
Nov 02 18:09:35 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 18:09:35 user nova-compute[74980]:     <system>
Nov 02 18:09:35 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 18:09:35 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 18:09:35 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 18:09:35 user nova-compute[74980]:       <entry name="serial">6eed0831-d502-4ebe-84e3-5e83f0de5981</entry>
Nov 02 18:09:35 user nova-compute[74980]:       <entry name="uuid">6eed0831-d502-4ebe-84e3-5e83f0de5981</entry>
Nov 02 18:09:35 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 18:09:35 user nova-compute[74980]:     </system>
Nov 02 18:09:35 user nova-compute[74980]:   </sysinfo>
Nov 02 18:09:35 user nova-compute[74980]:   <os>
Nov 02 18:09:35 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 18:09:35 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 18:09:35 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 18:09:35 user nova-compute[74980]:   </os>
Nov 02 18:09:35 user nova-compute[74980]:   <features>
Nov 02 18:09:35 user nova-compute[74980]:     <acpi/>
Nov 02 18:09:35 user nova-compute[74980]:     <apic/>
Nov 02 18:09:35 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 18:09:35 user nova-compute[74980]:   </features>
Nov 02 18:09:35 user nova-compute[74980]:   <clock offset="utc">
Nov 02 18:09:35 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 18:09:35 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 18:09:35 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 18:09:35 user nova-compute[74980]:   </clock>
Nov 02 18:09:35 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 18:09:35 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 18:09:35 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 18:09:35 user nova-compute[74980]:   </cpu>
Nov 02 18:09:35 user nova-compute[74980]:   <devices>
Nov 02 18:09:35 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 18:09:35 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 18:09:35 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk"/>
Nov 02 18:09:35 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 18:09:35 user nova-compute[74980]:     </disk>
Nov 02 18:09:35 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 18:09:35 user nova-compute[74980]:       <mac address="fa:16:3e:81:23:65"/>
Nov 02 18:09:35 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 18:09:35 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 18:09:35 user nova-compute[74980]:       <target dev="tap876aeeb8-a5"/>
Nov 02 18:09:35 user nova-compute[74980]:     </interface>
Nov 02 18:09:35 user nova-compute[74980]:     <serial type="pty">
Nov 02 18:09:35 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/console.log" append="off"/>
Nov 02 18:09:35 user nova-compute[74980]:     </serial>
Nov 02 18:09:35 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 18:09:35 user nova-compute[74980]:     <video>
Nov 02 18:09:35 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 18:09:35 user nova-compute[74980]:     </video>
Nov 02 18:09:35 user nova-compute[74980]:     <rng model="virtio">
Nov 02 18:09:35 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 18:09:35 user nova-compute[74980]:     </rng>
Nov 02 18:09:35 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 18:09:35 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 18:09:35 user nova-compute[74980]:       <stats period="10"/>
Nov 02 18:09:35 user nova-compute[74980]:     </memballoon>
Nov 02 18:09:35 user nova-compute[74980]:   </devices>
Nov 02 18:09:35 user nova-compute[74980]: </domain>
Nov 02 18:09:35 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:09:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-94801820',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-94801820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9480182',id=51,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIVmTBnzEAT8Cg6iAt3l00EpSB5pNZ9g7KRy09BBEFJWZ4pw0R6uNdaZiNDkrD1CjTTBe4anhaM/6GqKu4OZ5zSqbx+JEWs8qtGppdUBvIZmTn94Ur6FfFJzbnVeSFq+g==',key_name='tempest-keypair-475341387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0416d8eb4e674d638bbcdcc9dec8622a',ramdisk_id='',reservation_id='r-aoaso9f9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1493310358',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T18:09:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90c6d0315d834ac591f7b045bbd28bb2',uuid=6eed0831-d502-4ebe-84e3-5e83f0de5981,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "address": "fa:16:3e:81:23:65", "network": {"id": "2ebc9fb0-7f27-45e5-8272-71d871472c46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2127449843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0416d8eb4e674d638bbcdcc9dec8622a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876aeeb8-a5", "ovs_interfaceid": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Converting VIF {"id": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "address": "fa:16:3e:81:23:65", "network": {"id": "2ebc9fb0-7f27-45e5-8272-71d871472c46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2127449843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0416d8eb4e674d638bbcdcc9dec8622a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876aeeb8-a5", "ovs_interfaceid": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:23:65,bridge_name='br-int',has_traffic_filtering=True,id=876aeeb8-a5c5-4ff4-b061-618b62b34566,network=Network(2ebc9fb0-7f27-45e5-8272-71d871472c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap876aeeb8-a5') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG os_vif [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:23:65,bridge_name='br-int',has_traffic_filtering=True,id=876aeeb8-a5c5-4ff4-b061-618b62b34566,network=Network(2ebc9fb0-7f27-45e5-8272-71d871472c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap876aeeb8-a5') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '989a1c4c-9ae6-5897-99c4-37ac8af021a3', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap876aeeb8-a5, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap876aeeb8-a5, col_values=(('qos', UUID('bcb1ba25-8141-46fa-ba7e-364e2c9429c9')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap876aeeb8-a5, col_values=(('external_ids', {'iface-id': '876aeeb8-a5c5-4ff4-b061-618b62b34566', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:23:65', 'vm-uuid': '6eed0831-d502-4ebe-84e3-5e83f0de5981'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:35 user nova-compute[74980]: INFO os_vif [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:23:65,bridge_name='br-int',has_traffic_filtering=True,id=876aeeb8-a5c5-4ff4-b061-618b62b34566,network=Network(2ebc9fb0-7f27-45e5-8272-71d871472c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap876aeeb8-a5')
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] No VIF found with MAC fa:16:3e:81:23:65, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.network.neutron [req-a108605a-c218-48db-b515-963864d579e7 req-68183f78-d098-4340-9838-d2d4fb2bd65a service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Updated VIF entry in instance network info cache for port 876aeeb8-a5c5-4ff4-b061-618b62b34566. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG nova.network.neutron [req-a108605a-c218-48db-b515-963864d579e7 req-68183f78-d098-4340-9838-d2d4fb2bd65a service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Updating instance_info_cache with network_info: [{"id": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "address": "fa:16:3e:81:23:65", "network": {"id": "2ebc9fb0-7f27-45e5-8272-71d871472c46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2127449843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0416d8eb4e674d638bbcdcc9dec8622a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876aeeb8-a5", "ovs_interfaceid": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-a108605a-c218-48db-b515-963864d579e7 req-68183f78-d098-4340-9838-d2d4fb2bd65a service nova] Releasing lock "refresh_cache-6eed0831-d502-4ebe-84e3-5e83f0de5981" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:09:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-2e6b8b2f-a0f9-4b24-8261-5f943d03f9ff req-88c39a09-48c8-4d43-ba31-58393988f13e service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Received event network-vif-plugged-876aeeb8-a5c5-4ff4-b061-618b62b34566 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:09:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2e6b8b2f-a0f9-4b24-8261-5f943d03f9ff req-88c39a09-48c8-4d43-ba31-58393988f13e service nova] Acquiring lock "6eed0831-d502-4ebe-84e3-5e83f0de5981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:09:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2e6b8b2f-a0f9-4b24-8261-5f943d03f9ff req-88c39a09-48c8-4d43-ba31-58393988f13e service nova] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:09:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-2e6b8b2f-a0f9-4b24-8261-5f943d03f9ff req-88c39a09-48c8-4d43-ba31-58393988f13e service nova] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:09:36 user nova-compute[74980]: DEBUG nova.compute.manager [req-2e6b8b2f-a0f9-4b24-8261-5f943d03f9ff req-88c39a09-48c8-4d43-ba31-58393988f13e service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] No waiting events found dispatching network-vif-plugged-876aeeb8-a5c5-4ff4-b061-618b62b34566 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:09:36 user nova-compute[74980]: WARNING nova.compute.manager [req-2e6b8b2f-a0f9-4b24-8261-5f943d03f9ff req-88c39a09-48c8-4d43-ba31-58393988f13e service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Received unexpected event network-vif-plugged-876aeeb8-a5c5-4ff4-b061-618b62b34566 for instance with vm_state building and task_state spawning.
Nov 02 18:09:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:37 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:38 user nova-compute[74980]: DEBUG nova.compute.manager [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 18:09:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 18:09:38 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Instance spawned successfully.
Nov 02 18:09:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 18:09:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:09:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:09:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:09:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:09:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:09:38 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:09:38 user nova-compute[74980]: DEBUG nova.compute.manager [req-59e697d6-a5f7-4ddd-89fe-a6dc1c1c2844 req-778de5d0-9bc3-4627-8414-d123a22a2590 service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Received event network-vif-plugged-876aeeb8-a5c5-4ff4-b061-618b62b34566 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:09:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-59e697d6-a5f7-4ddd-89fe-a6dc1c1c2844 req-778de5d0-9bc3-4627-8414-d123a22a2590 service nova] Acquiring lock "6eed0831-d502-4ebe-84e3-5e83f0de5981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:09:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-59e697d6-a5f7-4ddd-89fe-a6dc1c1c2844 req-778de5d0-9bc3-4627-8414-d123a22a2590 service nova] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:09:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-59e697d6-a5f7-4ddd-89fe-a6dc1c1c2844 req-778de5d0-9bc3-4627-8414-d123a22a2590 service nova] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:09:38 user nova-compute[74980]: DEBUG nova.compute.manager [req-59e697d6-a5f7-4ddd-89fe-a6dc1c1c2844 req-778de5d0-9bc3-4627-8414-d123a22a2590 service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] No waiting events found dispatching network-vif-plugged-876aeeb8-a5c5-4ff4-b061-618b62b34566 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:09:38 user nova-compute[74980]: WARNING nova.compute.manager [req-59e697d6-a5f7-4ddd-89fe-a6dc1c1c2844 req-778de5d0-9bc3-4627-8414-d123a22a2590 service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Received unexpected event network-vif-plugged-876aeeb8-a5c5-4ff4-b061-618b62b34566 for instance with vm_state building and task_state spawning.
Nov 02 18:09:38 user nova-compute[74980]: INFO nova.compute.manager [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 02 18:09:38 user nova-compute[74980]: DEBUG nova.compute.manager [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 18:09:38 user nova-compute[74980]: INFO nova.compute.manager [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Took 5.85 seconds to build instance.
Nov 02 18:09:38 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-af68b4e5-77d7-4ddf-9035-0cc94263df34 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.938s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:09:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:43 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:09:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:09:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:09:43 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:09:43 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:09:43 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 18:09:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:43 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-7fbe5a08-f0d5-4c5a-af60-34e36d80e2a4 req-c6ce5a51-3c6d-47a2-8634-e0184dd667c9 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Received event network-changed-52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-7fbe5a08-f0d5-4c5a-af60-34e36d80e2a4 req-c6ce5a51-3c6d-47a2-8634-e0184dd667c9 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Refreshing instance network info cache due to event network-changed-52c2ab41-608c-4714-aef5-415ba2a51c88. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7fbe5a08-f0d5-4c5a-af60-34e36d80e2a4 req-c6ce5a51-3c6d-47a2-8634-e0184dd667c9 service nova] Acquiring lock "refresh_cache-98ec4b93-277b-4378-9728-5f4e6080ffcc" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7fbe5a08-f0d5-4c5a-af60-34e36d80e2a4 req-c6ce5a51-3c6d-47a2-8634-e0184dd667c9 service nova] Acquired lock "refresh_cache-98ec4b93-277b-4378-9728-5f4e6080ffcc" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.network.neutron [req-7fbe5a08-f0d5-4c5a-af60-34e36d80e2a4 req-c6ce5a51-3c6d-47a2-8634-e0184dd667c9 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Refreshing network info cache for port 52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 18:09:44 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:09:44 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8744MB free_disk=25.02381134033203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance fcab1589-31be-4a96-9aff-5ef9970c54a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 98ec4b93-277b-4378-9728-5f4e6080ffcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6eed0831-d502-4ebe-84e3-5e83f0de5981 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-8b775a28-3b9c-4ebe-8e6e-ae4e6e345de3 req-69cffe6d-34a5-4ba5-901c-cf8da82524f4 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Received event network-changed-52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.compute.manager [req-8b775a28-3b9c-4ebe-8e6e-ae4e6e345de3 req-69cffe6d-34a5-4ba5-901c-cf8da82524f4 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Refreshing instance network info cache due to event network-changed-52c2ab41-608c-4714-aef5-415ba2a51c88. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8b775a28-3b9c-4ebe-8e6e-ae4e6e345de3 req-69cffe6d-34a5-4ba5-901c-cf8da82524f4 service nova] Acquiring lock "refresh_cache-98ec4b93-277b-4378-9728-5f4e6080ffcc" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.network.neutron [req-7fbe5a08-f0d5-4c5a-af60-34e36d80e2a4 req-c6ce5a51-3c6d-47a2-8634-e0184dd667c9 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Updated VIF entry in instance network info cache for port 52c2ab41-608c-4714-aef5-415ba2a51c88. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.network.neutron [req-7fbe5a08-f0d5-4c5a-af60-34e36d80e2a4 req-c6ce5a51-3c6d-47a2-8634-e0184dd667c9 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Updating instance_info_cache with network_info: [{"id": "52c2ab41-608c-4714-aef5-415ba2a51c88", "address": "fa:16:3e:62:04:c2", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c2ab41-60", "ovs_interfaceid": "52c2ab41-608c-4714-aef5-415ba2a51c88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-7fbe5a08-f0d5-4c5a-af60-34e36d80e2a4 req-c6ce5a51-3c6d-47a2-8634-e0184dd667c9 service nova] Releasing lock "refresh_cache-98ec4b93-277b-4378-9728-5f4e6080ffcc" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8b775a28-3b9c-4ebe-8e6e-ae4e6e345de3 req-69cffe6d-34a5-4ba5-901c-cf8da82524f4 service nova] Acquired lock "refresh_cache-98ec4b93-277b-4378-9728-5f4e6080ffcc" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.network.neutron [req-8b775a28-3b9c-4ebe-8e6e-ae4e6e345de3 req-69cffe6d-34a5-4ba5-901c-cf8da82524f4 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Refreshing network info cache for port 52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "98ec4b93-277b-4378-9728-5f4e6080ffcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "98ec4b93-277b-4378-9728-5f4e6080ffcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "98ec4b93-277b-4378-9728-5f4e6080ffcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "98ec4b93-277b-4378-9728-5f4e6080ffcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "98ec4b93-277b-4378-9728-5f4e6080ffcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:09:44 user nova-compute[74980]: INFO nova.compute.manager [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Terminating instance
Nov 02 18:09:44 user nova-compute[74980]: DEBUG nova.compute.manager [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 18:09:44 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG nova.network.neutron [req-8b775a28-3b9c-4ebe-8e6e-ae4e6e345de3 req-69cffe6d-34a5-4ba5-901c-cf8da82524f4 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Updated VIF entry in instance network info cache for port 52c2ab41-608c-4714-aef5-415ba2a51c88. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG nova.network.neutron [req-8b775a28-3b9c-4ebe-8e6e-ae4e6e345de3 req-69cffe6d-34a5-4ba5-901c-cf8da82524f4 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Updating instance_info_cache with network_info: [{"id": "52c2ab41-608c-4714-aef5-415ba2a51c88", "address": "fa:16:3e:62:04:c2", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c2ab41-60", "ovs_interfaceid": "52c2ab41-608c-4714-aef5-415ba2a51c88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8b775a28-3b9c-4ebe-8e6e-ae4e6e345de3 req-69cffe6d-34a5-4ba5-901c-cf8da82524f4 service nova] Releasing lock "refresh_cache-98ec4b93-277b-4378-9728-5f4e6080ffcc" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:09:45 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Instance destroyed successfully.
Nov 02 18:09:45 user nova-compute[74980]: DEBUG nova.objects.instance [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lazy-loading 'resources' on Instance uuid 98ec4b93-277b-4378-9728-5f4e6080ffcc {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-870765703',display_name='tempest-TestVolumeBootPattern-server-870765703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-870765703',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ0oxkl6Yy4y5r8YNJgKybtgxWIxjVxrqlTa2t1xJhobm+2dTaCIfDNVa3C22M3ZLYQl8pofX5FRFHgxZksNPoy7tF3GyC4L0dw3OHBi42iMrKQ2mv5uuAnCmx1b8J7EA==',key_name='tempest-TestVolumeBootPattern-1484550038',keypairs=<?>,launch_index=0,launched_at=2023-11-02T18:08:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-65mo9o0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T18:08:17Z,user_data=None,user_id='9b309bc195c84c68a52e095927f874f0',uuid=98ec4b93-277b-4378-9728-5f4e6080ffcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52c2ab41-608c-4714-aef5-415ba2a51c88", "address": "fa:16:3e:62:04:c2", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c2ab41-60", "ovs_interfaceid": "52c2ab41-608c-4714-aef5-415ba2a51c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "52c2ab41-608c-4714-aef5-415ba2a51c88", "address": "fa:16:3e:62:04:c2", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52c2ab41-60", "ovs_interfaceid": "52c2ab41-608c-4714-aef5-415ba2a51c88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:04:c2,bridge_name='br-int',has_traffic_filtering=True,id=52c2ab41-608c-4714-aef5-415ba2a51c88,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52c2ab41-60') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_vif [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:04:c2,bridge_name='br-int',has_traffic_filtering=True,id=52c2ab41-608c-4714-aef5-415ba2a51c88,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52c2ab41-60') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52c2ab41-60, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b48cd43-6638-43ca-bc0d-d521b3583a5e) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:09:45 user nova-compute[74980]: INFO os_vif [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:04:c2,bridge_name='br-int',has_traffic_filtering=True,id=52c2ab41-608c-4714-aef5-415ba2a51c88,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52c2ab41-60')
Nov 02 18:09:45 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RZtQyPqS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:09:45 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[623e98bc-60ce-4533-9705-b317efc2abfe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 18:09:45 user nova-compute[74980]: No targets found.
Nov 02 18:09:45 user nova-compute[74980]: iSNS:
Nov 02 18:09:45 user nova-compute[74980]: No targets found.
Nov 02 18:09:45 user nova-compute[74980]: STATIC:
Nov 02 18:09:45 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea
Nov 02 18:09:45 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 18:09:45 user nova-compute[74980]:                 Iface Name: default
Nov 02 18:09:45 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106
Nov 02 18:09:45 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 18:09:45 user nova-compute[74980]:                 Iface Name: default
Nov 02 18:09:45 user nova-compute[74980]: FIRMWARE:
Nov 02 18:09:45 user nova-compute[74980]: No targets found.
Nov 02 18:09:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 18:09:45 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 18:09:45 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d4c78c-105e-46a3-beee-a2488a960b68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28fbaf5-f6f0-45cb-a578-7aeb4f55f4d9]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)
Nov 02 18:09:45 user nova-compute[74980]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 (non-flash)
Nov 02 18:09:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)
Nov 02 18:09:45 user nova-compute[74980]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 (non-flash)
Nov 02 18:09:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5994771120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106'): ({'sdc'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Removing single pathed devices sdc {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcf470f-d176-4cc4-a071-e2c968566278]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe8211e-79b8-4828-9c2a-3c86202aff19]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flushing IO for device /dev/sdc {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a30d6a-423f-40d2-9038-8e2a6d12f192]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dac697e-b3a7-4a3e-9496-e070b2f6febb]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] SCSI volumes sdc have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_88c033e8', '/dev/disk/by-id/scsi-1SCST_BIO88c033e8-feaf8417877ba7fd', '/dev/disk/by-id/scsi-26665616638343137') {{(pid=86001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcafd78-88cc-447c-ab7f-41646a18ec9c]: (4, None) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c46629-deb6-434f-a5da-0a6426fe5741]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5e2b53-8de0-493f-829c-a7ac95873ae5]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106, portal: 172.16.0.220,3260]
Nov 02 18:09:45 user nova-compute[74980]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106, portal: 172.16.0.220,3260] successful.
Nov 02 18:09:45 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c630d-0e28-4ef9-bff3-a149ef26f106 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc64e595-5741-402c-bdc9-f4d16f156344]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== disconnect_volume: return (306ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:09:45 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 18:09:45 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Deleting instance files /opt/stack/data/nova/instances/98ec4b93-277b-4378-9728-5f4e6080ffcc_del
Nov 02 18:09:45 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Deletion of /opt/stack/data/nova/instances/98ec4b93-277b-4378-9728-5f4e6080ffcc_del complete
Nov 02 18:09:46 user nova-compute[74980]: INFO nova.compute.manager [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 02 18:09:46 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:09:46 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Took 0.45 seconds to deallocate network for instance.
Nov 02 18:09:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-7fd6c657-6666-4f7d-8090-d33ee831bb7d req-a2f61f7e-d3d6-4149-abd0-5d2e964a918a service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Received event network-vif-deleted-52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-626e7e67-57eb-4b4a-bcb3-40cb109b1fb2 req-f4e7aa6c-1aff-410c-a56a-12e9685102a8 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Received event network-vif-unplugged-52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-626e7e67-57eb-4b4a-bcb3-40cb109b1fb2 req-f4e7aa6c-1aff-410c-a56a-12e9685102a8 service nova] Acquiring lock "98ec4b93-277b-4378-9728-5f4e6080ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-626e7e67-57eb-4b4a-bcb3-40cb109b1fb2 req-f4e7aa6c-1aff-410c-a56a-12e9685102a8 service nova] Lock "98ec4b93-277b-4378-9728-5f4e6080ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-626e7e67-57eb-4b4a-bcb3-40cb109b1fb2 req-f4e7aa6c-1aff-410c-a56a-12e9685102a8 service nova] Lock "98ec4b93-277b-4378-9728-5f4e6080ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-626e7e67-57eb-4b4a-bcb3-40cb109b1fb2 req-f4e7aa6c-1aff-410c-a56a-12e9685102a8 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] No waiting events found dispatching network-vif-unplugged-52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-626e7e67-57eb-4b4a-bcb3-40cb109b1fb2 req-f4e7aa6c-1aff-410c-a56a-12e9685102a8 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Received event network-vif-unplugged-52c2ab41-608c-4714-aef5-415ba2a51c88 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-626e7e67-57eb-4b4a-bcb3-40cb109b1fb2 req-f4e7aa6c-1aff-410c-a56a-12e9685102a8 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Received event network-vif-plugged-52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-626e7e67-57eb-4b4a-bcb3-40cb109b1fb2 req-f4e7aa6c-1aff-410c-a56a-12e9685102a8 service nova] Acquiring lock "98ec4b93-277b-4378-9728-5f4e6080ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-626e7e67-57eb-4b4a-bcb3-40cb109b1fb2 req-f4e7aa6c-1aff-410c-a56a-12e9685102a8 service nova] Lock "98ec4b93-277b-4378-9728-5f4e6080ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-626e7e67-57eb-4b4a-bcb3-40cb109b1fb2 req-f4e7aa6c-1aff-410c-a56a-12e9685102a8 service nova] Lock "98ec4b93-277b-4378-9728-5f4e6080ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:09:46 user nova-compute[74980]: DEBUG nova.compute.manager [req-626e7e67-57eb-4b4a-bcb3-40cb109b1fb2 req-f4e7aa6c-1aff-410c-a56a-12e9685102a8 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] No waiting events found dispatching network-vif-plugged-52c2ab41-608c-4714-aef5-415ba2a51c88 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:09:46 user nova-compute[74980]: WARNING nova.compute.manager [req-626e7e67-57eb-4b4a-bcb3-40cb109b1fb2 req-f4e7aa6c-1aff-410c-a56a-12e9685102a8 service nova] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Received unexpected event network-vif-plugged-52c2ab41-608c-4714-aef5-415ba2a51c88 for instance with vm_state active and task_state deleting.
Nov 02 18:09:47 user nova-compute[74980]: INFO nova.compute.manager [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: 98ec4b93-277b-4378-9728-5f4e6080ffcc] Took 0.85 seconds to detach 1 volumes for instance.
Nov 02 18:09:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:09:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:09:47 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:09:47 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:09:47 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:09:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:09:47 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Deleted allocations for instance 98ec4b93-277b-4378-9728-5f4e6080ffcc
Nov 02 18:09:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-110cc2d3-caaa-45f5-8caf-573dfcf7a0e1 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "98ec4b93-277b-4378-9728-5f4e6080ffcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.753s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:09:48 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:09:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:53 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:09:53 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:09:53 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:09:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:09:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:09:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:10:00 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:10:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:10:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Didn't find any instances for network info cache update. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 18:10:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:05 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:10:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:10:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:10:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:10:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:10:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:10:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:10:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:10:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:10:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:45 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:10:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:10:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:10:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:10:45 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:10:45 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 18:10:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:10:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:10:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:10:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:10:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:10:46 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:10:46 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:10:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8824MB free_disk=24.99500274658203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:10:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:10:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:10:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance fcab1589-31be-4a96-9aff-5ef9970c54a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:10:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6eed0831-d502-4ebe-84e3-5e83f0de5981 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:10:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:10:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:10:46 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:10:46 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:10:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:10:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:10:47 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:10:47 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:10:47 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:10:49 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:10:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:53 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:10:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:10:54 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:10:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:10:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-af2b0a25-abbb-411e-aa8c-0bb7b1e0a570 req-4fdff521-4335-4433-960f-b98dd1d4f19d service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Received event network-changed-ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:10:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-af2b0a25-abbb-411e-aa8c-0bb7b1e0a570 req-4fdff521-4335-4433-960f-b98dd1d4f19d service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Refreshing instance network info cache due to event network-changed-ea05fe87-3b85-4564-a4e9-e65ab71d4205. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 18:10:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-af2b0a25-abbb-411e-aa8c-0bb7b1e0a570 req-4fdff521-4335-4433-960f-b98dd1d4f19d service nova] Acquiring lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:10:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-af2b0a25-abbb-411e-aa8c-0bb7b1e0a570 req-4fdff521-4335-4433-960f-b98dd1d4f19d service nova] Acquired lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:10:55 user nova-compute[74980]: DEBUG nova.network.neutron [req-af2b0a25-abbb-411e-aa8c-0bb7b1e0a570 req-4fdff521-4335-4433-960f-b98dd1d4f19d service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Refreshing network info cache for port ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "fcab1589-31be-4a96-9aff-5ef9970c54a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "fcab1589-31be-4a96-9aff-5ef9970c54a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "fcab1589-31be-4a96-9aff-5ef9970c54a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "fcab1589-31be-4a96-9aff-5ef9970c54a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "fcab1589-31be-4a96-9aff-5ef9970c54a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:10:56 user nova-compute[74980]: INFO nova.compute.manager [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Terminating instance
Nov 02 18:10:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-5778ac95-250c-4fb0-9a6c-f32d3bcdb820 req-15c70ae0-99d7-43ab-9b36-520ed4b41739 service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Received event network-vif-unplugged-ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5778ac95-250c-4fb0-9a6c-f32d3bcdb820 req-15c70ae0-99d7-43ab-9b36-520ed4b41739 service nova] Acquiring lock "fcab1589-31be-4a96-9aff-5ef9970c54a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5778ac95-250c-4fb0-9a6c-f32d3bcdb820 req-15c70ae0-99d7-43ab-9b36-520ed4b41739 service nova] Lock "fcab1589-31be-4a96-9aff-5ef9970c54a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5778ac95-250c-4fb0-9a6c-f32d3bcdb820 req-15c70ae0-99d7-43ab-9b36-520ed4b41739 service nova] Lock "fcab1589-31be-4a96-9aff-5ef9970c54a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-5778ac95-250c-4fb0-9a6c-f32d3bcdb820 req-15c70ae0-99d7-43ab-9b36-520ed4b41739 service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] No waiting events found dispatching network-vif-unplugged-ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-5778ac95-250c-4fb0-9a6c-f32d3bcdb820 req-15c70ae0-99d7-43ab-9b36-520ed4b41739 service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Received event network-vif-unplugged-ea05fe87-3b85-4564-a4e9-e65ab71d4205 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG nova.network.neutron [req-af2b0a25-abbb-411e-aa8c-0bb7b1e0a570 req-4fdff521-4335-4433-960f-b98dd1d4f19d service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Updated VIF entry in instance network info cache for port ea05fe87-3b85-4564-a4e9-e65ab71d4205. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG nova.network.neutron [req-af2b0a25-abbb-411e-aa8c-0bb7b1e0a570 req-4fdff521-4335-4433-960f-b98dd1d4f19d service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Updating instance_info_cache with network_info: [{"id": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "address": "fa:16:3e:d2:c9:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea05fe87-3b", "ovs_interfaceid": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-af2b0a25-abbb-411e-aa8c-0bb7b1e0a570 req-4fdff521-4335-4433-960f-b98dd1d4f19d service nova] Releasing lock "refresh_cache-fcab1589-31be-4a96-9aff-5ef9970c54a5" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:10:56 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Instance destroyed successfully.
Nov 02 18:10:56 user nova-compute[74980]: DEBUG nova.objects.instance [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lazy-loading 'resources' on Instance uuid fcab1589-31be-4a96-9aff-5ef9970c54a5 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-459602381',display_name='tempest-TestVolumeBootPattern-server-459602381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-459602381',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ0oxkl6Yy4y5r8YNJgKybtgxWIxjVxrqlTa2t1xJhobm+2dTaCIfDNVa3C22M3ZLYQl8pofX5FRFHgxZksNPoy7tF3GyC4L0dw3OHBi42iMrKQ2mv5uuAnCmx1b8J7EA==',key_name='tempest-TestVolumeBootPattern-1484550038',keypairs=<?>,launch_index=0,launched_at=2023-11-02T18:06:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84de25c95ef24520aa7c06012991dd97',ramdisk_id='',reservation_id='r-nhl3uzkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-352919040',owner_user_name='tempest-TestVolumeBootPattern-352919040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T18:06:07Z,user_data=None,user_id='9b309bc195c84c68a52e095927f874f0',uuid=fcab1589-31be-4a96-9aff-5ef9970c54a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "address": "fa:16:3e:d2:c9:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea05fe87-3b", "ovs_interfaceid": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converting VIF {"id": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "address": "fa:16:3e:d2:c9:41", "network": {"id": "f72afc3d-efc1-493c-a53a-4c50305907c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-641878436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84de25c95ef24520aa7c06012991dd97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea05fe87-3b", "ovs_interfaceid": "ea05fe87-3b85-4564-a4e9-e65ab71d4205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:c9:41,bridge_name='br-int',has_traffic_filtering=True,id=ea05fe87-3b85-4564-a4e9-e65ab71d4205,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea05fe87-3b') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG os_vif [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:c9:41,bridge_name='br-int',has_traffic_filtering=True,id=ea05fe87-3b85-4564-a4e9-e65ab71d4205,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea05fe87-3b') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea05fe87-3b, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f6af4a5-7a77-426c-98f7-150947889465) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:10:56 user nova-compute[74980]: INFO os_vif [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:c9:41,bridge_name='br-int',has_traffic_filtering=True,id=ea05fe87-3b85-4564-a4e9-e65ab71d4205,network=Network(f72afc3d-efc1-493c-a53a-4c50305907c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea05fe87-3b')
Nov 02 18:10:56 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkPuByci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:10:56 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:10:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b0ebe2-54fd-4d82-9714-04377920d0ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 18:10:56 user nova-compute[74980]: No targets found.
Nov 02 18:10:56 user nova-compute[74980]: iSNS:
Nov 02 18:10:56 user nova-compute[74980]: No targets found.
Nov 02 18:10:56 user nova-compute[74980]: STATIC:
Nov 02 18:10:56 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea
Nov 02 18:10:56 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 18:10:56 user nova-compute[74980]:                 Iface Name: default
Nov 02 18:10:56 user nova-compute[74980]: FIRMWARE:
Nov 02 18:10:56 user nova-compute[74980]: No targets found.
Nov 02 18:10:56 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 18:10:56 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 18:10:56 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb657424-0d03-432c-ae7f-c83476f803e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[14af9cd5-3ff5-4594-a18b-d39142577f74]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)
Nov 02 18:10:56 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea (non-flash)
Nov 02 18:10:56 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5994759360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c81d98-ed2c-4cb2-af2e-fd9bf3ec3338]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca2428d-a79c-463a-b098-41ea4ec2453a]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a05f28-e365-4a9b-a18f-c757a006c37d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 18:10:56 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[434e7971-109d-444a-bd0f-19d388ce63c2]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26132616665396162', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_43cbba70', '/dev/disk/by-id/scsi-1SCST_BIO43cbba70-a2afe9ab38cfc5bd') {{(pid=86001) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[27695a23-e534-4503-9d98-abb919b743e9]: (4, None) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c82a8b-b7b1-43a0-9e96-899a9b2cb65e]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d57cb08-d7a4-44cf-88df-5d17b43134e1]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260]
Nov 02 18:10:57 user nova-compute[74980]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea, portal: 172.16.0.220,3260] successful.
Nov 02 18:10:57 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f3a63f3-95d1-4bfa-8452-dc85dde153ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[07905a4c-7495-43f0-ab86-5d4b7f1f460d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] <== disconnect_volume: return (296ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 18:10:57 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Deleting instance files /opt/stack/data/nova/instances/fcab1589-31be-4a96-9aff-5ef9970c54a5_del
Nov 02 18:10:57 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Deletion of /opt/stack/data/nova/instances/fcab1589-31be-4a96-9aff-5ef9970c54a5_del complete
Nov 02 18:10:57 user nova-compute[74980]: INFO nova.compute.manager [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 02 18:10:57 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 18:10:57 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:10:58 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Took 0.83 seconds to deallocate network for instance.
Nov 02 18:10:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-095af998-d150-44ac-8b1a-c2e950cd3986 req-434cf9b3-34bb-4496-987d-82a8486ddd0f service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Received event network-vif-deleted-ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:10:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:10:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-5cc0e354-d5bd-4d18-895f-94ebeafaf71b req-c294617c-0197-4779-b3be-ce07a34f2701 service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Received event network-vif-plugged-ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:10:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5cc0e354-d5bd-4d18-895f-94ebeafaf71b req-c294617c-0197-4779-b3be-ce07a34f2701 service nova] Acquiring lock "fcab1589-31be-4a96-9aff-5ef9970c54a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:10:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5cc0e354-d5bd-4d18-895f-94ebeafaf71b req-c294617c-0197-4779-b3be-ce07a34f2701 service nova] Lock "fcab1589-31be-4a96-9aff-5ef9970c54a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:10:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5cc0e354-d5bd-4d18-895f-94ebeafaf71b req-c294617c-0197-4779-b3be-ce07a34f2701 service nova] Lock "fcab1589-31be-4a96-9aff-5ef9970c54a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:10:58 user nova-compute[74980]: DEBUG nova.compute.manager [req-5cc0e354-d5bd-4d18-895f-94ebeafaf71b req-c294617c-0197-4779-b3be-ce07a34f2701 service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] No waiting events found dispatching network-vif-plugged-ea05fe87-3b85-4564-a4e9-e65ab71d4205 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:10:58 user nova-compute[74980]: WARNING nova.compute.manager [req-5cc0e354-d5bd-4d18-895f-94ebeafaf71b req-c294617c-0197-4779-b3be-ce07a34f2701 service nova] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Received unexpected event network-vif-plugged-ea05fe87-3b85-4564-a4e9-e65ab71d4205 for instance with vm_state active and task_state deleting.
Nov 02 18:10:58 user nova-compute[74980]: INFO nova.compute.manager [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] [instance: fcab1589-31be-4a96-9aff-5ef9970c54a5] Took 0.87 seconds to detach 1 volumes for instance.
Nov 02 18:10:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:10:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:10:59 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:10:59 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:10:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:10:59 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Deleted allocations for instance fcab1589-31be-4a96-9aff-5ef9970c54a5
Nov 02 18:10:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-994720c9-9766-4699-8554-173ec0e48ef9 tempest-TestVolumeBootPattern-352919040 tempest-TestVolumeBootPattern-352919040-project-member] Lock "fcab1589-31be-4a96-9aff-5ef9970c54a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.350s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:11:00 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:11:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:11:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:11:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-6eed0831-d502-4ebe-84e3-5e83f0de5981" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:11:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-6eed0831-d502-4ebe-84e3-5e83f0de5981" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:11:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:11:00 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 6eed0831-d502-4ebe-84e3-5e83f0de5981 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:11:00 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Updating instance_info_cache with network_info: [{"id": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "address": "fa:16:3e:81:23:65", "network": {"id": "2ebc9fb0-7f27-45e5-8272-71d871472c46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2127449843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0416d8eb4e674d638bbcdcc9dec8622a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876aeeb8-a5", "ovs_interfaceid": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:11:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-6eed0831-d502-4ebe-84e3-5e83f0de5981" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:11:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:11:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:11:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:11:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:11:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:11:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:11:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:11:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:11:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:11:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:11:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:11:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:11:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:11:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:11:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-df9b0790-0fff-4964-bf59-71ecf7b64830 req-20c7a257-51fe-4f36-9720-61eea7e64242 service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Received event network-changed-876aeeb8-a5c5-4ff4-b061-618b62b34566 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:11:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-df9b0790-0fff-4964-bf59-71ecf7b64830 req-20c7a257-51fe-4f36-9720-61eea7e64242 service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Refreshing instance network info cache due to event network-changed-876aeeb8-a5c5-4ff4-b061-618b62b34566. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 18:11:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-df9b0790-0fff-4964-bf59-71ecf7b64830 req-20c7a257-51fe-4f36-9720-61eea7e64242 service nova] Acquiring lock "refresh_cache-6eed0831-d502-4ebe-84e3-5e83f0de5981" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:11:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-df9b0790-0fff-4964-bf59-71ecf7b64830 req-20c7a257-51fe-4f36-9720-61eea7e64242 service nova] Acquired lock "refresh_cache-6eed0831-d502-4ebe-84e3-5e83f0de5981" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:11:24 user nova-compute[74980]: DEBUG nova.network.neutron [req-df9b0790-0fff-4964-bf59-71ecf7b64830 req-20c7a257-51fe-4f36-9720-61eea7e64242 service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Refreshing network info cache for port 876aeeb8-a5c5-4ff4-b061-618b62b34566 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 18:11:24 user nova-compute[74980]: DEBUG nova.network.neutron [req-df9b0790-0fff-4964-bf59-71ecf7b64830 req-20c7a257-51fe-4f36-9720-61eea7e64242 service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Updated VIF entry in instance network info cache for port 876aeeb8-a5c5-4ff4-b061-618b62b34566. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 18:11:24 user nova-compute[74980]: DEBUG nova.network.neutron [req-df9b0790-0fff-4964-bf59-71ecf7b64830 req-20c7a257-51fe-4f36-9720-61eea7e64242 service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Updating instance_info_cache with network_info: [{"id": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "address": "fa:16:3e:81:23:65", "network": {"id": "2ebc9fb0-7f27-45e5-8272-71d871472c46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2127449843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0416d8eb4e674d638bbcdcc9dec8622a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876aeeb8-a5", "ovs_interfaceid": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:11:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-df9b0790-0fff-4964-bf59-71ecf7b64830 req-20c7a257-51fe-4f36-9720-61eea7e64242 service nova] Releasing lock "refresh_cache-6eed0831-d502-4ebe-84e3-5e83f0de5981" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:11:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquiring lock "6eed0831-d502-4ebe-84e3-5e83f0de5981" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG nova.objects.instance [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lazy-loading 'flavor' on Instance uuid 6eed0831-d502-4ebe-84e3-5e83f0de5981 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquiring lock "6eed0831-d502-4ebe-84e3-5e83f0de5981" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:11:30 user nova-compute[74980]: INFO nova.compute.manager [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Attaching volume 5f4db16c-feac-4c29-b576-0e8d6de7fd50 to /dev/vdb
Nov 02 18:11:30 user nova-compute[74980]: DEBUG os_brick.utils [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1db706-d213-4fba-8e97-2b6578c310ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6453920a-4540-4011-b961-1b0e1ad3a8e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedc467b-86fb-4ace-bf7d-508d2c99fea4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[95200ef1-59cc-4745-82ca-eb39d7c1e7c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:11:30 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 18:11:30 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[70597aec-d427-40dd-b166-b261ed9c22fc]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG os_brick.utils [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:11:30 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Updating existing volume attachment record: 92b0a169-7f65-4f3f-9403-755f1be20108 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 18:11:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:45 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:11:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:11:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:11:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:11:45 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:11:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:46 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:11:46 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:11:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8895MB free_disk=24.99380111694336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:11:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:11:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:11:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6eed0831-d502-4ebe-84e3-5e83f0de5981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:11:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:11:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:11:46 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:11:46 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:11:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:11:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:11:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:11:47 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:11:47 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:11:47 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoKtVSFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:11:48 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:11:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:11:48 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:11:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:11:48 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2478fad2-c234-496f-ac89-baeb87ec7a99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 18:11:48 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e7bead-2950-4bf7-8b55-e96a149f63a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50] added
Nov 02 18:11:48 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[15974a07-6494-45bc-8bc6-b2a40333633c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c354fe-3c6e-4c59-87e8-7a13a2df8637]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WoKtVSFk {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WoKtVSFk" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dd16ec-7db7-4bf1-9f13-fd9f9deb792d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WoKtVSFk'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d308293-097e-42fd-a58c-83575f71ffb3]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:11:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c4714f-1324-495d-a912-0217c76ca09b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 18:11:49 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 18:11:49 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:11:49 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 18:11:49 user nova-compute[74980]: 
Nov 02 18:11:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[df02a7f5-d120-459f-b22e-30ef610fe9d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50, portal: 172.16.0.220,3260]
Nov 02 18:11:49 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50, portal: 172.16.0.220,3260] successful.
Nov 02 18:11:49 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff97ac9b-05ad-4b5c-b46c-0fd6f0cf82f5]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb18fe4a-6aa2-43b6-a223-7c8e4a693b85]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 (non-flash)
Nov 02 18:11:49 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 (non-flash)
Nov 02 18:11:49 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6ecb0d-a070-45d4-8c2e-708b2aae2f8f]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoKtVSFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 18:11:49 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:11:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:11:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23234623233643366', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:11:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234623233643366', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 18:11:50 user nova-compute[74980]: DEBUG nova.objects.instance [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lazy-loading 'flavor' on Instance uuid 6eed0831-d502-4ebe-84e3-5e83f0de5981 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:11:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 18:11:50 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:11:50 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 18:11:50 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 18:11:50 user nova-compute[74980]:   <serial>5f4db16c-feac-4c29-b576-0e8d6de7fd50</serial>
Nov 02 18:11:50 user nova-compute[74980]: </disk>
Nov 02 18:11:50 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 18:11:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:11:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:11:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] No VIF found with MAC fa:16:3e:81:23:65, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 18:11:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-a85a6815-ce88-4b35-bc4f-325d89e806f9 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.974s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:11:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquiring lock "6eed0831-d502-4ebe-84e3-5e83f0de5981" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:11:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:11:51 user nova-compute[74980]: INFO nova.compute.manager [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Detaching volume 5f4db16c-feac-4c29-b576-0e8d6de7fd50
Nov 02 18:11:51 user nova-compute[74980]: INFO nova.virt.block_device [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Attempting to driver detach volume 5f4db16c-feac-4c29-b576-0e8d6de7fd50 from mountpoint /dev/vdb
Nov 02 18:11:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Attempting to detach device vdb from instance 6eed0831-d502-4ebe-84e3-5e83f0de5981 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 18:11:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 18:11:51 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:11:51 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 18:11:51 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 18:11:51 user nova-compute[74980]:   <serial>5f4db16c-feac-4c29-b576-0e8d6de7fd50</serial>
Nov 02 18:11:51 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 18:11:51 user nova-compute[74980]: </disk>
Nov 02 18:11:51 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 18:11:51 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Successfully detached device vdb from instance 6eed0831-d502-4ebe-84e3-5e83f0de5981 from the persistent domain config.
Nov 02 18:11:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6eed0831-d502-4ebe-84e3-5e83f0de5981 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 18:11:51 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 18:11:51 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:11:51 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 18:11:51 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 18:11:51 user nova-compute[74980]:   <serial>5f4db16c-feac-4c29-b576-0e8d6de7fd50</serial>
Nov 02 18:11:51 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 18:11:51 user nova-compute[74980]: </disk>
Nov 02 18:11:51 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 18:11:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:52 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6eed0831-d502-4ebe-84e3-5e83f0de5981 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 18:11:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:11:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:11:55 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:11:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:11:57 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:00 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:12:01 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:12:01 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:12:01 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:12:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-6eed0831-d502-4ebe-84e3-5e83f0de5981" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:12:01 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-6eed0831-d502-4ebe-84e3-5e83f0de5981" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:12:01 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:12:01 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 6eed0831-d502-4ebe-84e3-5e83f0de5981 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:12:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:02 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Updating instance_info_cache with network_info: [{"id": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "address": "fa:16:3e:81:23:65", "network": {"id": "2ebc9fb0-7f27-45e5-8272-71d871472c46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2127449843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0416d8eb4e674d638bbcdcc9dec8622a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876aeeb8-a5", "ovs_interfaceid": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:12:02 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-6eed0831-d502-4ebe-84e3-5e83f0de5981" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:12:02 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:12:03 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:08 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:12:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:12 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6eed0831-d502-4ebe-84e3-5e83f0de5981 is timed out.
Nov 02 18:12:12 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Successfully detached device vdb from instance 6eed0831-d502-4ebe-84e3-5e83f0de5981 from the live domain config.
Nov 02 18:12:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoKtVSFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:12:12 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c158e65-2c8c-45a7-bd11-ed7bbbdf859f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 18:12:12 user nova-compute[74980]: No targets found.
Nov 02 18:12:12 user nova-compute[74980]: iSNS:
Nov 02 18:12:12 user nova-compute[74980]: No targets found.
Nov 02 18:12:12 user nova-compute[74980]: STATIC:
Nov 02 18:12:12 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50
Nov 02 18:12:12 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 18:12:12 user nova-compute[74980]:                 Iface Name: default
Nov 02 18:12:12 user nova-compute[74980]: FIRMWARE:
Nov 02 18:12:12 user nova-compute[74980]: No targets found.
Nov 02 18:12:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 18:12:12 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 18:12:12 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a1d4e8-92d0-489e-8f3a-353a43397ccd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c899e197-3ea1-4d19-a81b-7e99ae05f54c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 (non-flash)
Nov 02 18:12:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 (non-flash)
Nov 02 18:12:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59c43dbe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[974b5f2e-304b-40f0-97bc-33b46f0d8dc1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffc1ec5-3e23-4082-b78c-5b80907db62d]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[063201bd-e9c6-4a3e-bdd9-33806fb5f49c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbaa108-9f2d-4b7c-ae74-a12eff808dea]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8abd731-3837-4934-b437-99ad7db2f254]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c945db5-63df-4eea-83dc-d0ea1d0198dc]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50, portal: 172.16.0.220,3260]
Nov 02 18:12:12 user nova-compute[74980]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50, portal: 172.16.0.220,3260] successful.
Nov 02 18:12:12 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f4db16c-feac-4c29-b576-0e8d6de7fd50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c269008-380b-4622-93b2-986772ac71cb]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] <== disconnect_volume: return (286ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:12:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 18:12:13 user nova-compute[74980]: DEBUG nova.objects.instance [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lazy-loading 'flavor' on Instance uuid 6eed0831-d502-4ebe-84e3-5e83f0de5981 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:12:13 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-2e9b115f-6a29-473e-8629-02610135c5b8 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.862s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:12:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:12:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:12:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:12:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:12:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:12:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:12:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:12:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:12:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:12:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:12:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:45 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:12:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:12:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:12:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:12:45 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:12:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:12:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:12:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:12:45 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:12:46 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:12:46 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:12:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8894MB free_disk=24.991607666015625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:12:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:12:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:12:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 6eed0831-d502-4ebe-84e3-5e83f0de5981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:12:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:12:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:12:46 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:12:46 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:12:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:12:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:12:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:47 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:12:47 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:12:47 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:12:51 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:12:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:12:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:12:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:12:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:12:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquiring lock "6eed0831-d502-4ebe-84e3-5e83f0de5981" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquiring lock "6eed0831-d502-4ebe-84e3-5e83f0de5981-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:12:54 user nova-compute[74980]: INFO nova.compute.manager [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Terminating instance
Nov 02 18:12:54 user nova-compute[74980]: DEBUG nova.compute.manager [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-1fdffbd3-018b-48b0-a742-27ba46a55685 req-020c6abb-9bfd-46b2-929f-019d931ab9bc service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Received event network-vif-unplugged-876aeeb8-a5c5-4ff4-b061-618b62b34566 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1fdffbd3-018b-48b0-a742-27ba46a55685 req-020c6abb-9bfd-46b2-929f-019d931ab9bc service nova] Acquiring lock "6eed0831-d502-4ebe-84e3-5e83f0de5981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1fdffbd3-018b-48b0-a742-27ba46a55685 req-020c6abb-9bfd-46b2-929f-019d931ab9bc service nova] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-1fdffbd3-018b-48b0-a742-27ba46a55685 req-020c6abb-9bfd-46b2-929f-019d931ab9bc service nova] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-1fdffbd3-018b-48b0-a742-27ba46a55685 req-020c6abb-9bfd-46b2-929f-019d931ab9bc service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] No waiting events found dispatching network-vif-unplugged-876aeeb8-a5c5-4ff4-b061-618b62b34566 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG nova.compute.manager [req-1fdffbd3-018b-48b0-a742-27ba46a55685 req-020c6abb-9bfd-46b2-929f-019d931ab9bc service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Received event network-vif-unplugged-876aeeb8-a5c5-4ff4-b061-618b62b34566 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:12:54 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Instance destroyed successfully.
Nov 02 18:12:54 user nova-compute[74980]: DEBUG nova.objects.instance [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lazy-loading 'resources' on Instance uuid 6eed0831-d502-4ebe-84e3-5e83f0de5981 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:09:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-94801820',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-94801820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9480182',id=51,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIVmTBnzEAT8Cg6iAt3l00EpSB5pNZ9g7KRy09BBEFJWZ4pw0R6uNdaZiNDkrD1CjTTBe4anhaM/6GqKu4OZ5zSqbx+JEWs8qtGppdUBvIZmTn94Ur6FfFJzbnVeSFq+g==',key_name='tempest-keypair-475341387',keypairs=<?>,launch_index=0,launched_at=2023-11-02T18:09:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0416d8eb4e674d638bbcdcc9dec8622a',ramdisk_id='',reservation_id='r-aoaso9f9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1493310358',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T18:09:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90c6d0315d834ac591f7b045bbd28bb2',uuid=6eed0831-d502-4ebe-84e3-5e83f0de5981,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "address": "fa:16:3e:81:23:65", "network": {"id": "2ebc9fb0-7f27-45e5-8272-71d871472c46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2127449843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0416d8eb4e674d638bbcdcc9dec8622a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876aeeb8-a5", "ovs_interfaceid": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Converting VIF {"id": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "address": "fa:16:3e:81:23:65", "network": {"id": "2ebc9fb0-7f27-45e5-8272-71d871472c46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2127449843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0416d8eb4e674d638bbcdcc9dec8622a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876aeeb8-a5", "ovs_interfaceid": "876aeeb8-a5c5-4ff4-b061-618b62b34566", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:23:65,bridge_name='br-int',has_traffic_filtering=True,id=876aeeb8-a5c5-4ff4-b061-618b62b34566,network=Network(2ebc9fb0-7f27-45e5-8272-71d871472c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap876aeeb8-a5') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG os_vif [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:23:65,bridge_name='br-int',has_traffic_filtering=True,id=876aeeb8-a5c5-4ff4-b061-618b62b34566,network=Network(2ebc9fb0-7f27-45e5-8272-71d871472c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap876aeeb8-a5') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap876aeeb8-a5, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bcb1ba25-8141-46fa-ba7e-364e2c9429c9) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:12:54 user nova-compute[74980]: INFO os_vif [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:23:65,bridge_name='br-int',has_traffic_filtering=True,id=876aeeb8-a5c5-4ff4-b061-618b62b34566,network=Network(2ebc9fb0-7f27-45e5-8272-71d871472c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap876aeeb8-a5')
Nov 02 18:12:54 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Deleting instance files /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981_del
Nov 02 18:12:54 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Deletion of /opt/stack/data/nova/instances/6eed0831-d502-4ebe-84e3-5e83f0de5981_del complete
Nov 02 18:12:54 user nova-compute[74980]: INFO nova.compute.manager [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 02 18:12:54 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 18:12:54 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 18:12:55 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:12:55 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Took 0.78 seconds to deallocate network for instance.
Nov 02 18:12:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:12:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:12:55 user nova-compute[74980]: DEBUG nova.compute.manager [req-eb1a9fe3-ace0-4f1d-9888-1bb583ca200e req-cde8ddf5-9e5c-425e-beb5-3ac28018f7a3 service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Received event network-vif-deleted-876aeeb8-a5c5-4ff4-b061-618b62b34566 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:12:55 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:12:55 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:12:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:12:55 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Deleted allocations for instance 6eed0831-d502-4ebe-84e3-5e83f0de5981
Nov 02 18:12:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-e1cfbf2b-c7a7-4d78-96e8-0b2d7896ea0a tempest-TestServerVolumeAttachScenarioOldVersion-1493310358 tempest-TestServerVolumeAttachScenarioOldVersion-1493310358-project-member] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.958s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:12:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:12:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:12:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-3f87747b-6c20-4cc5-bff0-fce4a0ebff30 req-21d4c240-d37b-4083-9789-7af59f7b7bbb service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Received event network-vif-plugged-876aeeb8-a5c5-4ff4-b061-618b62b34566 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:12:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3f87747b-6c20-4cc5-bff0-fce4a0ebff30 req-21d4c240-d37b-4083-9789-7af59f7b7bbb service nova] Acquiring lock "6eed0831-d502-4ebe-84e3-5e83f0de5981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:12:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3f87747b-6c20-4cc5-bff0-fce4a0ebff30 req-21d4c240-d37b-4083-9789-7af59f7b7bbb service nova] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:12:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3f87747b-6c20-4cc5-bff0-fce4a0ebff30 req-21d4c240-d37b-4083-9789-7af59f7b7bbb service nova] Lock "6eed0831-d502-4ebe-84e3-5e83f0de5981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:12:56 user nova-compute[74980]: DEBUG nova.compute.manager [req-3f87747b-6c20-4cc5-bff0-fce4a0ebff30 req-21d4c240-d37b-4083-9789-7af59f7b7bbb service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] No waiting events found dispatching network-vif-plugged-876aeeb8-a5c5-4ff4-b061-618b62b34566 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:12:56 user nova-compute[74980]: WARNING nova.compute.manager [req-3f87747b-6c20-4cc5-bff0-fce4a0ebff30 req-21d4c240-d37b-4083-9789-7af59f7b7bbb service nova] [instance: 6eed0831-d502-4ebe-84e3-5e83f0de5981] Received unexpected event network-vif-plugged-876aeeb8-a5c5-4ff4-b061-618b62b34566 for instance with vm_state deleted and task_state None.
Nov 02 18:12:59 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:01 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:13:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:13:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:13:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:13:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Didn't find any instances for network info cache update. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 18:13:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:04 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:09 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:13 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:14 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:13:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:13:17 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Starting instance... {{(pid=74980) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 18:13:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:13:17 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:13:17 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74980) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 18:13:17 user nova-compute[74980]: INFO nova.compute.claims [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Claim successful on node user
Nov 02 18:13:18 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.196s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Start building networks asynchronously for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Allocating IP information in the background. {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] allocate_for_instance() {{(pid=74980) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 18:13:18 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 18:13:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Start building block device mappings for instance. {{(pid=74980) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Start spawning the instance on the hypervisor. {{(pid=74980) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Creating instance directory {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 18:13:18 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Creating image(s)
Nov 02 18:13:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "/opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "/opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.168s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG nova.policy [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbd858fb198c42e2bb3c0e68620995db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7458959e4b414eb3a4e3ca771b6b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74980) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "80316776c27fc820c31d305dae09f2877f7a7666" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk 1073741824 {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666,backing_fmt=raw /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk 1073741824" returned: 0 in 0.051s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "80316776c27fc820c31d305dae09f2877f7a7666" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:13:18 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80316776c27fc820c31d305dae09f2877f7a7666 --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk. size=1073741824 {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Successfully created port: 88eef59e-6d3b-4e18-bc57-869cfe96ccd0 {{(pid=74980) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG nova.virt.disk.api [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Cannot resize image /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk to a smaller size. {{(pid=74980) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Created local disks {{(pid=74980) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Ensure instance console log exists: /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/console.log {{(pid=74980) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Successfully updated port: 88eef59e-6d3b-4e18-bc57-869cfe96ccd0 {{(pid=74980) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquired lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Building network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-15ee1820-e935-4dce-a24e-fde0a48e9330 req-28e6fd1d-fe91-446f-8bd0-cb6b30a088da service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Received event network-changed-88eef59e-6d3b-4e18-bc57-869cfe96ccd0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG nova.compute.manager [req-15ee1820-e935-4dce-a24e-fde0a48e9330 req-28e6fd1d-fe91-446f-8bd0-cb6b30a088da service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Refreshing instance network info cache due to event network-changed-88eef59e-6d3b-4e18-bc57-869cfe96ccd0. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 18:13:19 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-15ee1820-e935-4dce-a24e-fde0a48e9330 req-28e6fd1d-fe91-446f-8bd0-cb6b30a088da service nova] Acquiring lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Instance cache missing network info. {{(pid=74980) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating instance_info_cache with network_info: [{"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Releasing lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Instance network_info: |[{"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74980) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-15ee1820-e935-4dce-a24e-fde0a48e9330 req-28e6fd1d-fe91-446f-8bd0-cb6b30a088da service nova] Acquired lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.network.neutron [req-15ee1820-e935-4dce-a24e-fde0a48e9330 req-28e6fd1d-fe91-446f-8bd0-cb6b30a088da service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Refreshing network info cache for port 88eef59e-6d3b-4e18-bc57-869cfe96ccd0 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Start _get_guest_xml network_info=[{"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '36a97702-8b81-46fe-8b9c-8c3e2e69141f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 18:13:20 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:13:20 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] CPU controller missing on host. {{(pid=74980) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.host [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] CPU controller found on host. {{(pid=74980) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74980) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T17:13:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T17:13:23Z,direct_url=<?>,disk_format='qcow2',id=36a97702-8b81-46fe-8b9c-8c3e2e69141f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0506163bacd94766bee5ce28755ea623',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T17:13:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Flavor limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Image limits 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Flavor pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Image pref 0:0:0 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Got 1 possible topologies {{(pid=74980) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.hardware [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74980) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1548367667',display_name='tempest-SnapshotDataIntegrityTests-server-1548367667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1548367667',id=52,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSIr/6DHcmDgpVgLe0kWFEULVfCWjfSk3N4J/GITG37I1ZHBU6L+OGLTIkgdXvSZAMOXHd4bCzqPK+3QNR16izbhxdeaYh0ec0XJ2J8y9/94c3p9vcuWwPb03pwNlFdPg==',key_name='tempest-keypair-313247149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd7458959e4b414eb3a4e3ca771b6b19',ramdisk_id='',reservation_id='r-dry7mfp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1934669581',owner_user_name='tempest-SnapshotDataIntegrityTests-1934669581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T18:13:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbd858fb198c42e2bb3c0e68620995db',uuid=5f62bd0c-f1c1-453c-b457-549268f07c66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74980) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Converting VIF {"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:20:b3,bridge_name='br-int',has_traffic_filtering=True,id=88eef59e-6d3b-4e18-bc57-869cfe96ccd0,network=Network(7d519358-da34-4482-b807-e99e6a8b2d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88eef59e-6d') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] End _get_guest_xml xml=<domain type="kvm">
Nov 02 18:13:20 user nova-compute[74980]:   <uuid>5f62bd0c-f1c1-453c-b457-549268f07c66</uuid>
Nov 02 18:13:20 user nova-compute[74980]:   <name>instance-00000034</name>
Nov 02 18:13:20 user nova-compute[74980]:   <memory>524288</memory>
Nov 02 18:13:20 user nova-compute[74980]:   <vcpu>1</vcpu>
Nov 02 18:13:20 user nova-compute[74980]:   <metadata>
Nov 02 18:13:20 user nova-compute[74980]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 18:13:20 user nova-compute[74980]:       <nova:package version="0.0.0"/>
Nov 02 18:13:20 user nova-compute[74980]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1548367667</nova:name>
Nov 02 18:13:20 user nova-compute[74980]:       <nova:creationTime>2023-11-02 18:13:20</nova:creationTime>
Nov 02 18:13:20 user nova-compute[74980]:       <nova:flavor name="m1.tiny">
Nov 02 18:13:20 user nova-compute[74980]:         <nova:memory>512</nova:memory>
Nov 02 18:13:20 user nova-compute[74980]:         <nova:disk>1</nova:disk>
Nov 02 18:13:20 user nova-compute[74980]:         <nova:swap>0</nova:swap>
Nov 02 18:13:20 user nova-compute[74980]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 18:13:20 user nova-compute[74980]:         <nova:vcpus>1</nova:vcpus>
Nov 02 18:13:20 user nova-compute[74980]:       </nova:flavor>
Nov 02 18:13:20 user nova-compute[74980]:       <nova:owner>
Nov 02 18:13:20 user nova-compute[74980]:         <nova:user uuid="fbd858fb198c42e2bb3c0e68620995db">tempest-SnapshotDataIntegrityTests-1934669581-project-member</nova:user>
Nov 02 18:13:20 user nova-compute[74980]:         <nova:project uuid="cd7458959e4b414eb3a4e3ca771b6b19">tempest-SnapshotDataIntegrityTests-1934669581</nova:project>
Nov 02 18:13:20 user nova-compute[74980]:       </nova:owner>
Nov 02 18:13:20 user nova-compute[74980]:       <nova:root type="image" uuid="36a97702-8b81-46fe-8b9c-8c3e2e69141f"/>
Nov 02 18:13:20 user nova-compute[74980]:       <nova:ports>
Nov 02 18:13:20 user nova-compute[74980]:         <nova:port uuid="88eef59e-6d3b-4e18-bc57-869cfe96ccd0">
Nov 02 18:13:20 user nova-compute[74980]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 18:13:20 user nova-compute[74980]:         </nova:port>
Nov 02 18:13:20 user nova-compute[74980]:       </nova:ports>
Nov 02 18:13:20 user nova-compute[74980]:     </nova:instance>
Nov 02 18:13:20 user nova-compute[74980]:   </metadata>
Nov 02 18:13:20 user nova-compute[74980]:   <sysinfo type="smbios">
Nov 02 18:13:20 user nova-compute[74980]:     <system>
Nov 02 18:13:20 user nova-compute[74980]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 18:13:20 user nova-compute[74980]:       <entry name="product">OpenStack Nova</entry>
Nov 02 18:13:20 user nova-compute[74980]:       <entry name="version">0.0.0</entry>
Nov 02 18:13:20 user nova-compute[74980]:       <entry name="serial">5f62bd0c-f1c1-453c-b457-549268f07c66</entry>
Nov 02 18:13:20 user nova-compute[74980]:       <entry name="uuid">5f62bd0c-f1c1-453c-b457-549268f07c66</entry>
Nov 02 18:13:20 user nova-compute[74980]:       <entry name="family">Virtual Machine</entry>
Nov 02 18:13:20 user nova-compute[74980]:     </system>
Nov 02 18:13:20 user nova-compute[74980]:   </sysinfo>
Nov 02 18:13:20 user nova-compute[74980]:   <os>
Nov 02 18:13:20 user nova-compute[74980]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 18:13:20 user nova-compute[74980]:     <boot dev="hd"/>
Nov 02 18:13:20 user nova-compute[74980]:     <smbios mode="sysinfo"/>
Nov 02 18:13:20 user nova-compute[74980]:   </os>
Nov 02 18:13:20 user nova-compute[74980]:   <features>
Nov 02 18:13:20 user nova-compute[74980]:     <acpi/>
Nov 02 18:13:20 user nova-compute[74980]:     <apic/>
Nov 02 18:13:20 user nova-compute[74980]:     <vmcoreinfo/>
Nov 02 18:13:20 user nova-compute[74980]:   </features>
Nov 02 18:13:20 user nova-compute[74980]:   <clock offset="utc">
Nov 02 18:13:20 user nova-compute[74980]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 18:13:20 user nova-compute[74980]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 18:13:20 user nova-compute[74980]:     <timer name="hpet" present="no"/>
Nov 02 18:13:20 user nova-compute[74980]:   </clock>
Nov 02 18:13:20 user nova-compute[74980]:   <cpu mode="custom" match="exact">
Nov 02 18:13:20 user nova-compute[74980]:     <model>Nehalem</model>
Nov 02 18:13:20 user nova-compute[74980]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 18:13:20 user nova-compute[74980]:   </cpu>
Nov 02 18:13:20 user nova-compute[74980]:   <devices>
Nov 02 18:13:20 user nova-compute[74980]:     <disk type="file" device="disk">
Nov 02 18:13:20 user nova-compute[74980]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 18:13:20 user nova-compute[74980]:       <source file="/opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk"/>
Nov 02 18:13:20 user nova-compute[74980]:       <target dev="vda" bus="virtio"/>
Nov 02 18:13:20 user nova-compute[74980]:     </disk>
Nov 02 18:13:20 user nova-compute[74980]:     <interface type="ethernet">
Nov 02 18:13:20 user nova-compute[74980]:       <mac address="fa:16:3e:6c:20:b3"/>
Nov 02 18:13:20 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 18:13:20 user nova-compute[74980]:       <mtu size="1442"/>
Nov 02 18:13:20 user nova-compute[74980]:       <target dev="tap88eef59e-6d"/>
Nov 02 18:13:20 user nova-compute[74980]:     </interface>
Nov 02 18:13:20 user nova-compute[74980]:     <serial type="pty">
Nov 02 18:13:20 user nova-compute[74980]:       <log file="/opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/console.log" append="off"/>
Nov 02 18:13:20 user nova-compute[74980]:     </serial>
Nov 02 18:13:20 user nova-compute[74980]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 18:13:20 user nova-compute[74980]:     <video>
Nov 02 18:13:20 user nova-compute[74980]:       <model type="virtio"/>
Nov 02 18:13:20 user nova-compute[74980]:     </video>
Nov 02 18:13:20 user nova-compute[74980]:     <rng model="virtio">
Nov 02 18:13:20 user nova-compute[74980]:       <backend model="random">/dev/urandom</backend>
Nov 02 18:13:20 user nova-compute[74980]:     </rng>
Nov 02 18:13:20 user nova-compute[74980]:     <controller type="usb" index="0" model="none"/>
Nov 02 18:13:20 user nova-compute[74980]:     <memballoon model="virtio">
Nov 02 18:13:20 user nova-compute[74980]:       <stats period="10"/>
Nov 02 18:13:20 user nova-compute[74980]:     </memballoon>
Nov 02 18:13:20 user nova-compute[74980]:   </devices>
Nov 02 18:13:20 user nova-compute[74980]: </domain>
Nov 02 18:13:20 user nova-compute[74980]:  {{(pid=74980) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1548367667',display_name='tempest-SnapshotDataIntegrityTests-server-1548367667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1548367667',id=52,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSIr/6DHcmDgpVgLe0kWFEULVfCWjfSk3N4J/GITG37I1ZHBU6L+OGLTIkgdXvSZAMOXHd4bCzqPK+3QNR16izbhxdeaYh0ec0XJ2J8y9/94c3p9vcuWwPb03pwNlFdPg==',key_name='tempest-keypair-313247149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd7458959e4b414eb3a4e3ca771b6b19',ramdisk_id='',reservation_id='r-dry7mfp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1934669581',owner_user_name='tempest-SnapshotDataIntegrityTests-1934669581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T18:13:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbd858fb198c42e2bb3c0e68620995db',uuid=5f62bd0c-f1c1-453c-b457-549268f07c66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Converting VIF {"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:20:b3,bridge_name='br-int',has_traffic_filtering=True,id=88eef59e-6d3b-4e18-bc57-869cfe96ccd0,network=Network(7d519358-da34-4482-b807-e99e6a8b2d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88eef59e-6d') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG os_vif [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:20:b3,bridge_name='br-int',has_traffic_filtering=True,id=88eef59e-6d3b-4e18-bc57-869cfe96ccd0,network=Network(7d519358-da34-4482-b807-e99e6a8b2d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88eef59e-6d') {{(pid=74980) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57907210-1eb5-5d09-9d95-c813827fc040', '_type': 'linux-noop'}}, row=False) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88eef59e-6d, may_exist=True, interface_attrs={}) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88eef59e-6d, col_values=(('qos', UUID('67e2b6a2-c11f-4fc9-bbb6-650f3d2ace1e')),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88eef59e-6d, col_values=(('external_ids', {'iface-id': '88eef59e-6d3b-4e18-bc57-869cfe96ccd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:20:b3', 'vm-uuid': '5f62bd0c-f1c1-453c-b457-549268f07c66'}),), if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:20 user nova-compute[74980]: INFO os_vif [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:20:b3,bridge_name='br-int',has_traffic_filtering=True,id=88eef59e-6d3b-4e18-bc57-869cfe96ccd0,network=Network(7d519358-da34-4482-b807-e99e6a8b2d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88eef59e-6d')
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] No VIF found with MAC fa:16:3e:6c:20:b3, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.network.neutron [req-15ee1820-e935-4dce-a24e-fde0a48e9330 req-28e6fd1d-fe91-446f-8bd0-cb6b30a088da service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updated VIF entry in instance network info cache for port 88eef59e-6d3b-4e18-bc57-869cfe96ccd0. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG nova.network.neutron [req-15ee1820-e935-4dce-a24e-fde0a48e9330 req-28e6fd1d-fe91-446f-8bd0-cb6b30a088da service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating instance_info_cache with network_info: [{"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:13:20 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-15ee1820-e935-4dce-a24e-fde0a48e9330 req-28e6fd1d-fe91-446f-8bd0-cb6b30a088da service nova] Releasing lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:13:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:22 user nova-compute[74980]: DEBUG nova.compute.manager [req-3fa9d5b2-c9ba-44c7-be6d-1ff0780616dd req-1425b04d-f6c6-45b9-8ad9-fc48e06a831c service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Received event network-vif-plugged-88eef59e-6d3b-4e18-bc57-869cfe96ccd0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:13:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3fa9d5b2-c9ba-44c7-be6d-1ff0780616dd req-1425b04d-f6c6-45b9-8ad9-fc48e06a831c service nova] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:13:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3fa9d5b2-c9ba-44c7-be6d-1ff0780616dd req-1425b04d-f6c6-45b9-8ad9-fc48e06a831c service nova] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:13:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3fa9d5b2-c9ba-44c7-be6d-1ff0780616dd req-1425b04d-f6c6-45b9-8ad9-fc48e06a831c service nova] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:13:22 user nova-compute[74980]: DEBUG nova.compute.manager [req-3fa9d5b2-c9ba-44c7-be6d-1ff0780616dd req-1425b04d-f6c6-45b9-8ad9-fc48e06a831c service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] No waiting events found dispatching network-vif-plugged-88eef59e-6d3b-4e18-bc57-869cfe96ccd0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:13:22 user nova-compute[74980]: WARNING nova.compute.manager [req-3fa9d5b2-c9ba-44c7-be6d-1ff0780616dd req-1425b04d-f6c6-45b9-8ad9-fc48e06a831c service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Received unexpected event network-vif-plugged-88eef59e-6d3b-4e18-bc57-869cfe96ccd0 for instance with vm_state building and task_state spawning.
Nov 02 18:13:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:22 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Instance event wait completed in 0 seconds for  {{(pid=74980) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 18:13:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Guest created on hypervisor {{(pid=74980) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 18:13:24 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Instance spawned successfully.
Nov 02 18:13:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 18:13:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Found default for hw_cdrom_bus of ide {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:13:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Found default for hw_disk_bus of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:13:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Found default for hw_input_bus of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:13:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Found default for hw_pointer_model of None {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:13:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Found default for hw_video_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:13:24 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Found default for hw_vif_model of virtio {{(pid=74980) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 18:13:24 user nova-compute[74980]: INFO nova.compute.manager [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 02 18:13:24 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Checking state {{(pid=74980) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 18:13:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-8e40dba1-9133-4f8d-8340-764640fa4f48 req-c02c3f79-3910-4799-87cc-61f5e2d9d1bb service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Received event network-vif-plugged-88eef59e-6d3b-4e18-bc57-869cfe96ccd0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:13:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8e40dba1-9133-4f8d-8340-764640fa4f48 req-c02c3f79-3910-4799-87cc-61f5e2d9d1bb service nova] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:13:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8e40dba1-9133-4f8d-8340-764640fa4f48 req-c02c3f79-3910-4799-87cc-61f5e2d9d1bb service nova] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:13:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-8e40dba1-9133-4f8d-8340-764640fa4f48 req-c02c3f79-3910-4799-87cc-61f5e2d9d1bb service nova] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:13:24 user nova-compute[74980]: DEBUG nova.compute.manager [req-8e40dba1-9133-4f8d-8340-764640fa4f48 req-c02c3f79-3910-4799-87cc-61f5e2d9d1bb service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] No waiting events found dispatching network-vif-plugged-88eef59e-6d3b-4e18-bc57-869cfe96ccd0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:13:24 user nova-compute[74980]: WARNING nova.compute.manager [req-8e40dba1-9133-4f8d-8340-764640fa4f48 req-c02c3f79-3910-4799-87cc-61f5e2d9d1bb service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Received unexpected event network-vif-plugged-88eef59e-6d3b-4e18-bc57-869cfe96ccd0 for instance with vm_state building and task_state spawning.
Nov 02 18:13:24 user nova-compute[74980]: INFO nova.compute.manager [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Took 6.42 seconds to build instance.
Nov 02 18:13:24 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cfb3b340-2926-46f1-8023-139f7406c358 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.509s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:13:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:13:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:13:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:13:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:13:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:13:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:46 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:13:46 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:13:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:13:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:13:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:13:46 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:13:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:13:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:13:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:13:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:13:47 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:47 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:13:47 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:13:47 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8824MB free_disk=24.980804443359375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:13:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:13:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:13:47 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 5f62bd0c-f1c1-453c-b457-549268f07c66 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:13:47 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:13:47 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:13:47 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing inventories for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 18:13:47 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating ProviderTree inventory for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 18:13:47 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating inventory in ProviderTree for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 18:13:47 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing aggregate associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, aggregates: None {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 18:13:47 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing trait associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 18:13:47 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:13:47 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:13:47 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:13:47 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:13:49 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:13:49 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:13:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:51 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:13:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:13:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:13:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:13:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:13:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:13:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 18:13:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] There are 0 instances to clean {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 18:14:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:14:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:14:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:14:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:14:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:14:03 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:14:03 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:14:03 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:14:04 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating instance_info_cache with network_info: [{"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:14:04 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:14:04 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:14:04 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:14:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:14:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:14:12 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:14:12 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:14:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:14:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:14:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:14:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:14:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:14:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:14:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:14:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:14:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:14:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:14:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:14:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:14:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:14:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:14:33 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:14:33 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74980) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 18:14:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:14:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:14:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:14:46 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:14:48 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:14:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:14:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:14:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:14:48 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:14:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:14:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:14:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:14:48 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:14:49 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:14:49 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:14:49 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8956MB free_disk=24.979698181152344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:14:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:14:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:14:49 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 5f62bd0c-f1c1-453c-b457-549268f07c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:14:49 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:14:49 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:14:49 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:14:49 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:14:49 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:14:49 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:14:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:14:51 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:14:51 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:14:51 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:14:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:14:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:14:56 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:14:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:15:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:15:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:15:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:15:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:15:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:15:05 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:15:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:15:05 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:15:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:15:05 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:15:05 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:15:05 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:15:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:15:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:15:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:15:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:15:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:05 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating instance_info_cache with network_info: [{"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:15:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:15:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:15:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-5229a9c1-c6e0-443d-847b-16672e520999 req-7eaec4b1-7c5d-4ba5-80bd-4eb12c4af3e9 service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Received event network-changed-88eef59e-6d3b-4e18-bc57-869cfe96ccd0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:15:09 user nova-compute[74980]: DEBUG nova.compute.manager [req-5229a9c1-c6e0-443d-847b-16672e520999 req-7eaec4b1-7c5d-4ba5-80bd-4eb12c4af3e9 service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Refreshing instance network info cache due to event network-changed-88eef59e-6d3b-4e18-bc57-869cfe96ccd0. {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 02 18:15:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5229a9c1-c6e0-443d-847b-16672e520999 req-7eaec4b1-7c5d-4ba5-80bd-4eb12c4af3e9 service nova] Acquiring lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:15:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5229a9c1-c6e0-443d-847b-16672e520999 req-7eaec4b1-7c5d-4ba5-80bd-4eb12c4af3e9 service nova] Acquired lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:15:09 user nova-compute[74980]: DEBUG nova.network.neutron [req-5229a9c1-c6e0-443d-847b-16672e520999 req-7eaec4b1-7c5d-4ba5-80bd-4eb12c4af3e9 service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Refreshing network info cache for port 88eef59e-6d3b-4e18-bc57-869cfe96ccd0 {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 18:15:09 user nova-compute[74980]: DEBUG nova.network.neutron [req-5229a9c1-c6e0-443d-847b-16672e520999 req-7eaec4b1-7c5d-4ba5-80bd-4eb12c4af3e9 service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updated VIF entry in instance network info cache for port 88eef59e-6d3b-4e18-bc57-869cfe96ccd0. {{(pid=74980) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 18:15:09 user nova-compute[74980]: DEBUG nova.network.neutron [req-5229a9c1-c6e0-443d-847b-16672e520999 req-7eaec4b1-7c5d-4ba5-80bd-4eb12c4af3e9 service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating instance_info_cache with network_info: [{"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:15:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-5229a9c1-c6e0-443d-847b-16672e520999 req-7eaec4b1-7c5d-4ba5-80bd-4eb12c4af3e9 service nova] Releasing lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:15:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:15:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:15:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:15 user nova-compute[74980]: DEBUG nova.objects.instance [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lazy-loading 'flavor' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:15:15 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:15:16 user nova-compute[74980]: INFO nova.compute.manager [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Attaching volume 54b9a9e4-77b9-48e4-ba05-5213ea2bb71e to /dev/vdb
Nov 02 18:15:16 user nova-compute[74980]: DEBUG os_brick.utils [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ffa7bc-0dcc-48e4-858f-54e8632dbcd2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3ff907-2b81-4854-9098-c3a7061fac11]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d17fcb-f8a9-4230-b469-aa496a3ef5e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac5308a-fbc1-467f-bc5f-8704345c10e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:15:16 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 18:15:16 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b498d4-daf7-4349-9e05-14d94c4820dc]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG os_brick.utils [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:15:16 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating existing volume attachment record: 6f86ae6c-be40-44da-95ee-8b937a4c1099 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 18:15:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:25 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:15:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwSYkWxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:15:34 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:15:34 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:15:34 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8298277c-5c82-42ea-a213-2ce38a41f038]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 18:15:34 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[18529d92-04ae-44c0-8008-333e9a303500]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e] added
Nov 02 18:15:34 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb0b6f3-dd4d-4e35-be0a-f85368b00c96]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cecb52-2563-41c5-aa4b-f1f478f9a731]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cwSYkWxd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cwSYkWxd" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0202ff-3501-4424-9f20-5dad5404e45f]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cwSYkWxd'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4570cd84-ec48-4852-89f5-63e9057f3c29]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf1edfc-a34a-4d38-be99-ea3fd8b54121]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 18:15:34 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 18:15:34 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:15:34 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 18:15:34 user nova-compute[74980]: 
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f810774f-338f-4d7d-b8e2-5ee903422607]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e, portal: 172.16.0.220,3260]
Nov 02 18:15:34 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e, portal: 172.16.0.220,3260] successful.
Nov 02 18:15:34 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d94f258-54c2-43a1-a988-dff7d128b3c6]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[27044998-c281-4ecd-be94-84788251c16d]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e (non-flash)
Nov 02 18:15:34 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e (non-flash)
Nov 02 18:15:34 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ae55b2-2a80-4d74-a327-280943d4de52]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:15:34 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 18:15:35 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 18:15:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwSYkWxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 18:15:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:15:35 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '26133663831646531', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:15:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133663831646531', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 18:15:35 user nova-compute[74980]: DEBUG nova.objects.instance [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lazy-loading 'flavor' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:15:35 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 18:15:35 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:15:35 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 18:15:35 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 18:15:35 user nova-compute[74980]:   <serial>54b9a9e4-77b9-48e4-ba05-5213ea2bb71e</serial>
Nov 02 18:15:35 user nova-compute[74980]: </disk>
Nov 02 18:15:35 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 18:15:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:15:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:15:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:15:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:15:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:15:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:15:36 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] No VIF found with MAC fa:16:3e:6c:20:b3, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 18:15:36 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-08d8b440-2bad-4e2c-9b31-efbf50accfa7 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.157s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:15:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:15:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:15:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:15:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:15:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:44 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:15:44 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Triggering sync for uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 02 18:15:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:15:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:15:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:15:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:48 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:15:50 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:15:50 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:15:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:15:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:15:50 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:15:50 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:15:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:15:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:15:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74980) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 18:15:51 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:15:51 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:15:51 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8947MB free_disk=24.978466033935547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:15:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:15:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:15:51 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 5f62bd0c-f1c1-453c-b457-549268f07c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:15:51 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:15:51 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:15:51 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:15:51 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:15:51 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:15:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:15:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:15:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:15:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:15:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:15:57 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:15:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:16:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:16:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:16:05 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:16:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:16:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:16:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:16:06 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:16:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:16:06 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:16:06 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:16:06 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:16:07 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating instance_info_cache with network_info: [{"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:16:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:16:07 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:16:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:16:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:16:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:16:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:16:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:16:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:16:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:16:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:16:11 user nova-compute[74980]: INFO nova.compute.manager [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Detaching volume 54b9a9e4-77b9-48e4-ba05-5213ea2bb71e
Nov 02 18:16:11 user nova-compute[74980]: INFO nova.virt.block_device [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Attempting to driver detach volume 54b9a9e4-77b9-48e4-ba05-5213ea2bb71e from mountpoint /dev/vdb
Nov 02 18:16:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Attempting to detach device vdb from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 18:16:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 18:16:11 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:16:11 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 18:16:11 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 18:16:11 user nova-compute[74980]:   <serial>54b9a9e4-77b9-48e4-ba05-5213ea2bb71e</serial>
Nov 02 18:16:11 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 18:16:11 user nova-compute[74980]: </disk>
Nov 02 18:16:11 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 18:16:11 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Successfully detached device vdb from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the persistent domain config.
Nov 02 18:16:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 18:16:11 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 18:16:11 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:16:11 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 18:16:11 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 18:16:11 user nova-compute[74980]:   <serial>54b9a9e4-77b9-48e4-ba05-5213ea2bb71e</serial>
Nov 02 18:16:11 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 18:16:11 user nova-compute[74980]: </disk>
Nov 02 18:16:11 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 18:16:12 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 18:16:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:16:18 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:16:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:16:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:16:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:16:32 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 is timed out.
Nov 02 18:16:32 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Successfully detached device vdb from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the live domain config.
Nov 02 18:16:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwSYkWxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:16:32 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89d4b3c-48d2-4b32-8ea1-1d74246223ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 18:16:32 user nova-compute[74980]: No targets found.
Nov 02 18:16:32 user nova-compute[74980]: iSNS:
Nov 02 18:16:32 user nova-compute[74980]: No targets found.
Nov 02 18:16:32 user nova-compute[74980]: STATIC:
Nov 02 18:16:32 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e
Nov 02 18:16:32 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 18:16:32 user nova-compute[74980]:                 Iface Name: default
Nov 02 18:16:32 user nova-compute[74980]: FIRMWARE:
Nov 02 18:16:32 user nova-compute[74980]: No targets found.
Nov 02 18:16:32 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 18:16:32 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 18:16:32 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca55b5ca-74ff-4dd5-a535-5f5b7713bf24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09d408c-3525-4783-b1cf-25d5fdc3bb8d]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e (non-flash)
Nov 02 18:16:32 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e (non-flash)
Nov 02 18:16:32 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f599475a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[894f753c-998d-4353-bf79-3f3891d66dc3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afb75f6-a7e2-49ed-a4d3-52b157b6866b]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4e28e2-0770-4ebb-a9f1-bacdc3362219]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2e285a-045a-4b51-9056-9bcdd773539e]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd31ba4c-8cad-4dce-b404-fc73f5f5012b]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76baa36-426a-4432-b684-8bf6b834e46e]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e, portal: 172.16.0.220,3260]
Nov 02 18:16:32 user nova-compute[74980]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e, portal: 172.16.0.220,3260] successful.
Nov 02 18:16:32 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54b9a9e4-77b9-48e4-ba05-5213ea2bb71e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[800ee117-5e3c-4ee5-ae79-a6f18f4c2315]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] <== disconnect_volume: return (283ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:16:32 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 18:16:33 user nova-compute[74980]: DEBUG nova.objects.instance [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lazy-loading 'flavor' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:16:33 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d063c8b5-4b65-4776-8d81-aa927a2026a4 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.738s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:16:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:16:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:16:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:16:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:16:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:16:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:16:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:16:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:16:50 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:16:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:16:51 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:16:51 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:16:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:16:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:16:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:16:51 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:16:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:16:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:16:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:16:51 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:16:52 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:16:52 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:16:52 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8946MB free_disk=24.977649688720703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:16:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:16:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:16:52 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 5f62bd0c-f1c1-453c-b457-549268f07c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:16:52 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:16:52 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:16:52 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:16:52 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:16:52 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:16:52 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:16:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:16:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:16:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:16:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:16:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:16:59 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:17:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:17:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:17:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:17:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:17:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:17:07 user nova-compute[74980]: DEBUG nova.objects.instance [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lazy-loading 'flavor' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:17:07 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:17:08 user nova-compute[74980]: INFO nova.compute.manager [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Attaching volume 494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb to /dev/vdb
Nov 02 18:17:08 user nova-compute[74980]: DEBUG os_brick.utils [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10b71d4-a6b2-48c1-827e-8d7b5457ea6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbb7c24-81d7-4497-a38e-bed58a5f8594]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d38fb23-a735-4176-8364-b96f61a58238]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa90903-b225-47a1-adad-8ee9c7bdbadb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:17:08 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a9dde0-486c-43e1-9fc3-96f6a4c1733a]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG os_brick.utils [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating existing volume attachment record: d423f715-7779-44bd-94ab-8f0956b1bfec {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:17:08 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:17:09 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating instance_info_cache with network_info: [{"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:17:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:17:09 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:17:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:17:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:17:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:17:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:17:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:17:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:17:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:17:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:17:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:17:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:17:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:17:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:17:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:17:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:17:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gWVsXUAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:17:26 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:17:26 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:17:26 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[91df0181-ff89-458c-a665-717d0350d1ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 18:17:26 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0a493e-2859-4d6a-82bc-6170e0193ae9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb] added
Nov 02 18:17:26 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa05dd5-d7cc-425a-a170-6bcb50fecb37]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44ad26f-233b-48e8-a7cb-4b7e33893453]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gWVsXUAY {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gWVsXUAY" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f184321-a649-4abc-b8b0-6f204caf0398]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gWVsXUAY'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7b158b-2f0f-4995-aecd-5c74442d29a2]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[42834e1d-c452-4ba0-8cfc-64f60f4d30c1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 18:17:26 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 18:17:26 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:17:26 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 18:17:26 user nova-compute[74980]: 
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9173154c-d2e0-42f8-acd6-91d30ed7429a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb, portal: 172.16.0.220,3260]
Nov 02 18:17:26 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb, portal: 172.16.0.220,3260] successful.
Nov 02 18:17:26 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[87011692-bd45-4a4d-976c-9047589edd15]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44ffff9-e5e1-4620-a9a6-993149070a4f]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb (non-flash)
Nov 02 18:17:26 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb (non-flash)
Nov 02 18:17:26 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc453257-214e-422f-a023-9c3deef82900]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 18:17:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gWVsXUAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 18:17:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:17:27 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '23734316630653665', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:17:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734316630653665', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 18:17:27 user nova-compute[74980]: DEBUG nova.objects.instance [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lazy-loading 'flavor' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:17:27 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 18:17:27 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:17:27 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 18:17:27 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 18:17:27 user nova-compute[74980]:   <serial>494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb</serial>
Nov 02 18:17:27 user nova-compute[74980]: </disk>
Nov 02 18:17:27 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 18:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:17:28 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] No VIF found with MAC fa:16:3e:6c:20:b3, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 18:17:28 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-dd3581c5-89e6-44c6-b2b8-c396b97d211b tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.063s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:17:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:17:29 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:17:29 user nova-compute[74980]: INFO nova.compute.manager [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Detaching volume 494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb
Nov 02 18:17:29 user nova-compute[74980]: INFO nova.virt.block_device [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Attempting to driver detach volume 494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb from mountpoint /dev/vdb
Nov 02 18:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Attempting to detach device vdb from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 18:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 18:17:30 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:17:30 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 18:17:30 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 18:17:30 user nova-compute[74980]:   <serial>494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb</serial>
Nov 02 18:17:30 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 18:17:30 user nova-compute[74980]: </disk>
Nov 02 18:17:30 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 18:17:30 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Successfully detached device vdb from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the persistent domain config.
Nov 02 18:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 18:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 18:17:30 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:17:30 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 18:17:30 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 18:17:30 user nova-compute[74980]:   <serial>494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb</serial>
Nov 02 18:17:30 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 18:17:30 user nova-compute[74980]: </disk>
Nov 02 18:17:30 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 18:17:30 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 18:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:17:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:17:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:17:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:17:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:17:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:17:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:17:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:17:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:17:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:17:50 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 is timed out.
Nov 02 18:17:50 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Successfully detached device vdb from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the live domain config.
Nov 02 18:17:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gWVsXUAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:17:50 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[872beae8-5027-4357-84f1-f319e2b6686e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 18:17:50 user nova-compute[74980]: No targets found.
Nov 02 18:17:50 user nova-compute[74980]: iSNS:
Nov 02 18:17:50 user nova-compute[74980]: No targets found.
Nov 02 18:17:50 user nova-compute[74980]: STATIC:
Nov 02 18:17:50 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb
Nov 02 18:17:50 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 18:17:50 user nova-compute[74980]:                 Iface Name: default
Nov 02 18:17:50 user nova-compute[74980]: FIRMWARE:
Nov 02 18:17:50 user nova-compute[74980]: No targets found.
Nov 02 18:17:50 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 18:17:50 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 18:17:50 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dad852-59c6-4376-b173-d9bfdeeb21d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[53efc27b-36ce-497f-a0de-2cf2aa4ea138]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb (non-flash)
Nov 02 18:17:50 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb (non-flash)
Nov 02 18:17:50 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b46ad990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be0f683-4deb-4d22-888b-635302c35acd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8777e383-89d7-4546-a332-6dbd0de43478]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75701f4-703e-4b66-b747-7f8a35c276f4]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac3de39-3cec-458e-89d1-9da5a15d1dbf]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fa7d20-eaa0-4217-9065-bbd362dfcbd1]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ea8027-cd7e-4a09-8dce-29d2e1f69955]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb, portal: 172.16.0.220,3260]
Nov 02 18:17:50 user nova-compute[74980]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb, portal: 172.16.0.220,3260] successful.
Nov 02 18:17:50 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:494c7f34-5ae3-4ad5-b8af-ccbe4a120ceb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4656db94-6500-4514-b178-9ff52afb9f87]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] <== disconnect_volume: return (271ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 18:17:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:17:51 user nova-compute[74980]: DEBUG nova.objects.instance [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lazy-loading 'flavor' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:17:51 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-f99cd250-e2d8-4574-9e1c-eaca82d6b09d tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.690s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:17:52 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:17:53 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:17:53 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:17:53 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:17:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:17:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:17:53 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:17:53 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:17:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:17:53 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:17:54 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:17:54 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:17:54 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8925MB free_disk=24.976547241210938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:17:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:17:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:17:54 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 5f62bd0c-f1c1-453c-b457-549268f07c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:17:54 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:17:54 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:17:54 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:17:54 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:17:54 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:17:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:17:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:17:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:17:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:17:59 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:18:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:18:01 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:18:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:18:06 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:18:08 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:18:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:18:08 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:18:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:18:08 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:18:08 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:18:08 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:18:09 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating instance_info_cache with network_info: [{"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:18:09 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:18:09 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:18:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:18:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:18:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:18:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:18:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG nova.objects.instance [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lazy-loading 'flavor' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:18:26 user nova-compute[74980]: INFO nova.compute.manager [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Attaching volume 34353a58-dce6-4db2-a025-3fe8b769c0bd to /dev/vdb
Nov 02 18:18:26 user nova-compute[74980]: DEBUG os_brick.utils [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[42075ff9-437e-4edc-b987-22d8bf459288]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee568445-42f3-4e26-9f77-62e966349043]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fd4752-e78a-479a-9a50-54f72e6e9fae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25fee59-c9cd-4e1b-9448-80a0b8e66204]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:18:26 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 18:18:26 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[604307c7-1004-4366-9932-3447481524d4]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG os_brick.utils [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:18:26 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating existing volume attachment record: 9c70b2d2-4fa7-4611-993d-fda0b3e2c0b5 {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 18:18:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:18:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:18:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:18:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glAzUTLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:18:44 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:18:44 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:18:44 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[848db105-63fe-4583-988a-2b0ce057b018]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 18:18:44 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f102d1a8-632b-4cfe-aabe-b4b1c303e7e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd] added
Nov 02 18:18:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9329ba23-4ec9-44fb-b40d-5ffb830f7bdb]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b6f9b4-3dde-4c58-a394-bf7062114cc4]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v glAzUTLd {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v glAzUTLd" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10a7321-e91a-496f-9eae-e450efe02f47]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'glAzUTLd'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3c0ccf-5c59-4fb0-8cda-6855d5bb0f87]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dbba17-23b7-4a2b-a55f-15cdc2af1c44]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 18:18:44 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 18:18:44 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:18:44 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 18:18:44 user nova-compute[74980]: 
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[488db312-1942-4590-8a0c-9415ee3237ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd, portal: 172.16.0.220,3260]
Nov 02 18:18:44 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd, portal: 172.16.0.220,3260] successful.
Nov 02 18:18:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9820fceb-b5c4-449a-8250-b9c18e02e602]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a4b4dc-489a-4027-9e29-7f177146d127]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd (non-flash)
Nov 02 18:18:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd (non-flash)
Nov 02 18:18:44 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b58235-d48a-4f3b-9533-83bf66034147]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 18:18:44 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glAzUTLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 18:18:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:18:45 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23839326635363235', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:18:45 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839326635363235', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 18:18:45 user nova-compute[74980]: DEBUG nova.objects.instance [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lazy-loading 'flavor' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:18:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:18:45 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 18:18:45 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:18:45 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 18:18:45 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 18:18:45 user nova-compute[74980]:   <serial>34353a58-dce6-4db2-a025-3fe8b769c0bd</serial>
Nov 02 18:18:45 user nova-compute[74980]: </disk>
Nov 02 18:18:45 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 18:18:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:18:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:18:46 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] No VIF found with MAC fa:16:3e:6c:20:b3, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 18:18:46 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-02bfb02d-51bd-471e-9c56-152621866372 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.871s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:18:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:18:48 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:18:48 user nova-compute[74980]: INFO nova.compute.manager [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Detaching volume 34353a58-dce6-4db2-a025-3fe8b769c0bd
Nov 02 18:18:48 user nova-compute[74980]: INFO nova.virt.block_device [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Attempting to driver detach volume 34353a58-dce6-4db2-a025-3fe8b769c0bd from mountpoint /dev/vdb
Nov 02 18:18:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Attempting to detach device vdb from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 18:18:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 18:18:48 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:18:48 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 18:18:48 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 18:18:48 user nova-compute[74980]:   <serial>34353a58-dce6-4db2-a025-3fe8b769c0bd</serial>
Nov 02 18:18:48 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 18:18:48 user nova-compute[74980]: </disk>
Nov 02 18:18:48 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 18:18:48 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Successfully detached device vdb from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the persistent domain config.
Nov 02 18:18:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 18:18:48 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 18:18:48 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:18:48 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 18:18:48 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 18:18:48 user nova-compute[74980]:   <serial>34353a58-dce6-4db2-a025-3fe8b769c0bd</serial>
Nov 02 18:18:48 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 18:18:48 user nova-compute[74980]: </disk>
Nov 02 18:18:48 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 18:18:49 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 18:18:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:18:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:18:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:18:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:18:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:18:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:18:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:18:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:18:54 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:18:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:18:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:18:54 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:18:54 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:18:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:18:54 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:18:55 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:18:55 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:18:55 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8924MB free_disk=24.975601196289062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:18:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:18:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:18:55 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 5f62bd0c-f1c1-453c-b457-549268f07c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:18:55 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:18:55 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:18:55 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing inventories for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 18:18:55 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating ProviderTree inventory for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 18:18:55 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Updating inventory in ProviderTree for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 18:18:55 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing aggregate associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, aggregates: None {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 18:18:55 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Refreshing trait associations for resource provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=74980) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 18:18:55 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:18:55 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:18:55 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:18:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:18:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:18:56 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:18:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:18:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:18:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 02 18:18:58 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] There are 0 instances to clean {{(pid=74980) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 02 18:18:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:18:59 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:19:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:19:01 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:19:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:19:08 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:19:09 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 is timed out.
Nov 02 18:19:09 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Successfully detached device vdb from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the live domain config.
Nov 02 18:19:09 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glAzUTLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:19:09 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5bf722-6787-48d2-b3de-b1991374ca08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 18:19:09 user nova-compute[74980]: No targets found.
Nov 02 18:19:09 user nova-compute[74980]: iSNS:
Nov 02 18:19:09 user nova-compute[74980]: No targets found.
Nov 02 18:19:09 user nova-compute[74980]: STATIC:
Nov 02 18:19:09 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd
Nov 02 18:19:09 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 18:19:09 user nova-compute[74980]:                 Iface Name: default
Nov 02 18:19:09 user nova-compute[74980]: FIRMWARE:
Nov 02 18:19:09 user nova-compute[74980]: No targets found.
Nov 02 18:19:09 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 18:19:09 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 18:19:09 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3417a4a1-0fb7-4980-9297-080f45dff269]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3e97df-9585-4a1f-acfc-97ecfa563a7f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd (non-flash)
Nov 02 18:19:09 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd (non-flash)
Nov 02 18:19:09 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f59b47c13f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68d6e14-4916-47f7-9206-f3d5f44b2ac2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[96577885-8c1d-4bea-a230-3e2efe434473]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae2da84-1fec-4e70-8067-f0b07292c4b1]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[362512bb-9d8c-4016-8f4b-b645e89cabbc]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4401c2-db73-4ee3-92ed-df802a4a3ebf]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3ee6b3-79b9-49fc-b0dd-a192ee238809]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd, portal: 172.16.0.220,3260]
Nov 02 18:19:09 user nova-compute[74980]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd, portal: 172.16.0.220,3260] successful.
Nov 02 18:19:09 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34353a58-dce6-4db2-a025-3fe8b769c0bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[80748214-6369-4d67-95d0-8cd158772a1d]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] <== disconnect_volume: return (281ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:19:09 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 18:19:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lazy-loading 'flavor' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:19:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-4c066a5f-404b-493b-be5c-cb917d479272 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.713s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:19:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:19:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:19:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:19:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:19:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:19:10 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:19:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:19:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:19:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:19:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:19:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:19:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:19:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:19:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating instance_info_cache with network_info: [{"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:19:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:19:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:19:13 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:19:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:19:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:19:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:19:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:19:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:19:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:19:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:19:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:19:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:19:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:19:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:19:44 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:19:44 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74980) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 02 18:19:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:19:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:19:44 user nova-compute[74980]: DEBUG nova.objects.instance [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lazy-loading 'flavor' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:19:44 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:19:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:19:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:19:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:19:45 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:19:45 user nova-compute[74980]: INFO nova.compute.manager [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Attaching volume 5985532a-9e7c-4fe4-a076-3105a3232fc2 to /dev/vdb
Nov 02 18:19:46 user nova-compute[74980]: DEBUG os_brick.utils [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e805dc95-9379-4bfb-ab0d-7a51a0f81fa2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a72bb5a8265\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0b6119-e8d0-404c-bbd6-03f1e5ab6754]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbcd37b-3cca-439e-930f-d96d40d2889d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cb86ac-5280-48ed-820c-a2ec631a176f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Running cmd (subprocess): nvme version {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] 'nvme version' failed. Not Retrying. {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] nvme not present on system {{(pid=74980) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 18:19:46 user nova-compute[74980]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 18:19:46 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b99d6c-86ae-424b-bf5c-16152a1f5bc3]: (4, '') {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74980) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.lightos [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] LIGHTOS: no hostnqn found. {{(pid=74980) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG os_brick.utils [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a72bb5a8265', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:19:46 user nova-compute[74980]: DEBUG nova.virt.block_device [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating existing volume attachment record: aa17ad7b-6c6f-4ccc-999a-213ae419bc9f {{(pid=74980) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 18:19:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:19:55 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:19:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:19:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:19:55 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:19:55 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:19:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:19:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:19:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:19:55 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:19:56 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:19:56 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:19:56 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8937MB free_disk=24.974754333496094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:19:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:19:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:19:56 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 5f62bd0c-f1c1-453c-b457-549268f07c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:19:56 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:19:56 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:19:56 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:19:56 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:19:56 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:19:56 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:19:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:19:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:19:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:19:58 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:20:00 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:20:00 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:20:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:20:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:20:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:20:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:20:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:20:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:20:02 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:20:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:20:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:20:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:20:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:20:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:20:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:20:10 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:20:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:20:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:20:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating instance_info_cache with network_info: [{"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:20:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:20:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:20:11 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Calling os-brick to attach iSCSI Volume {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DIGRZEXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:20:14 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:20:14 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:20:14 user nova-compute[74980]: INFO os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc75dfb-42be-483f-816d-bac595d5e82f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 18:20:14 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fb18f5-be4f-45dc-8693-2369fdbb1d7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2] added\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2] added
Nov 02 18:20:14 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9546963e-a56e-4694-9fdf-d84c413a6e92]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacaae49-83c7-48b9-aa54-88da1704edc1]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DIGRZEXq {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DIGRZEXq" returned: 0 in 0.028s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c0138d-9e44-4864-8a58-7f4cb697e294]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DIGRZEXq'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[300ef37f-8306-45fc-a0c9-da00547a05fa]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a937f6bf-08c8-4b39-9843-51d731ea8699]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 18:20:14 user nova-compute[74980]:  {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 18:20:14 user nova-compute[74980]:  {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:20:14 user nova-compute[74980]: WARNING os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 18:20:14 user nova-compute[74980]: 
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --login {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8954d6f-6485-4f8e-8067-1bd5325b4281]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2, portal: 172.16.0.220,3260]
Nov 02 18:20:14 user nova-compute[74980]: Login to [iface: default, target: iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2, portal: 172.16.0.220,3260] successful.
Nov 02 18:20:14 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2367ee27-67b3-495c-9adb-2797e0bd8f3c]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b918fd2-db7d-4dce-9e8c-ca2cb5e3fac9]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 (non-flash)
Nov 02 18:20:14 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 (non-flash)
Nov 02 18:20:14 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Connected to 172.16.0.220:3260 {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74980) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74980) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f74b525-b7bb-4137-a5a4-56ef77e37c9a]: (4, ('- - 0', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74980) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 18:20:14 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DIGRZEXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74980) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 18:20:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:20:15 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26666333666326230', 'path': '/dev/sdb'} {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:20:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666333666326230', 'path': '/dev/sdb'} {{(pid=74980) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 18:20:15 user nova-compute[74980]: DEBUG nova.objects.instance [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lazy-loading 'flavor' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:20:15 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 18:20:15 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:20:15 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 18:20:15 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 18:20:15 user nova-compute[74980]:   <serial>5985532a-9e7c-4fe4-a076-3105a3232fc2</serial>
Nov 02 18:20:15 user nova-compute[74980]: </disk>
Nov 02 18:20:15 user nova-compute[74980]:  {{(pid=74980) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 18:20:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:20:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:20:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:20:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:20:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:20:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:20:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] No BDM found with device name vda, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:20:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74980) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 18:20:16 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] No VIF found with MAC fa:16:3e:6c:20:b3, not building metadata {{(pid=74980) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 18:20:16 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-46bc43b3-a1ed-4191-8a2f-6f292784b23e tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.227s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:20:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:20:18 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:20:18 user nova-compute[74980]: INFO nova.compute.manager [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Detaching volume 5985532a-9e7c-4fe4-a076-3105a3232fc2
Nov 02 18:20:18 user nova-compute[74980]: INFO nova.virt.block_device [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Attempting to driver detach volume 5985532a-9e7c-4fe4-a076-3105a3232fc2 from mountpoint /dev/vdb
Nov 02 18:20:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Attempting to detach device vdb from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the persistent domain config. {{(pid=74980) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 18:20:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 18:20:18 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:20:18 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 18:20:18 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 18:20:18 user nova-compute[74980]:   <serial>5985532a-9e7c-4fe4-a076-3105a3232fc2</serial>
Nov 02 18:20:18 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 18:20:18 user nova-compute[74980]: </disk>
Nov 02 18:20:18 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 18:20:18 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Successfully detached device vdb from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the persistent domain config.
Nov 02 18:20:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the live domain config. {{(pid=74980) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 18:20:18 user nova-compute[74980]: DEBUG nova.virt.libvirt.guest [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 18:20:18 user nova-compute[74980]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 18:20:18 user nova-compute[74980]:   <source dev="/dev/sdb"/>
Nov 02 18:20:18 user nova-compute[74980]:   <target dev="vdb" bus="virtio"/>
Nov 02 18:20:18 user nova-compute[74980]:   <serial>5985532a-9e7c-4fe4-a076-3105a3232fc2</serial>
Nov 02 18:20:18 user nova-compute[74980]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 18:20:18 user nova-compute[74980]: </disk>
Nov 02 18:20:18 user nova-compute[74980]:  {{(pid=74980) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 18:20:19 user nova-compute[74980]: DEBUG nova.virt.libvirt.driver [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 18:20:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:20:20 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:20:21 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:20:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:20:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:20:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:20:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:20:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:20:25 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:20:30 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:20:35 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:20:39 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 is timed out.
Nov 02 18:20:39 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Successfully detached device vdb from instance 5f62bd0c-f1c1-453c-b457-549268f07c66 from the live domain config.
Nov 02 18:20:39 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] calling os-brick to detach iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f59b46c40d0>, {'target_iqn': 'iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DIGRZEXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 18:20:39 user nova-compute[74980]: WARNING os_brick.initiator.connectors.base [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16f6a1f-edaa-4168-9d3a-9dc5d86ff50c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 18:20:39 user nova-compute[74980]: No targets found.
Nov 02 18:20:39 user nova-compute[74980]: iSNS:
Nov 02 18:20:39 user nova-compute[74980]: No targets found.
Nov 02 18:20:39 user nova-compute[74980]: STATIC:
Nov 02 18:20:39 user nova-compute[74980]: Target: iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2
Nov 02 18:20:39 user nova-compute[74980]:         Portal: 172.16.0.220:3260,-1
Nov 02 18:20:39 user nova-compute[74980]:                 Iface Name: default
Nov 02 18:20:39 user nova-compute[74980]: FIRMWARE:
Nov 02 18:20:39 user nova-compute[74980]: No targets found.
Nov 02 18:20:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 18:20:39 user nova-compute[74980]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 18:20:39 user nova-compute[74980]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74980) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2', 0)] {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[047c465e-76b2-4253-a629-b18316f17f90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2efb98f-f173-47f6-91f9-892aa3220b09]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 (non-flash)\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 (non-flash)
Nov 02 18:20:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 (non-flash)
Nov 02 18:20:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5994446050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2'): ({'sdb'}, set())}) {{(pid=74980) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Removing single pathed devices sdb {{(pid=74980) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f469f3be-a364-4ea2-9869-85cc13ace1b6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[658fc2b5-da96-481f-9f7b-649c371380c0]: (4, ('ok\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Flushing IO for device /dev/sdb {{(pid=74980) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[21929dfd-d45e-4076-9e6e-93090a7e5473]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74980) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a239b8af-0002-44a2-9994-5f8a7ebd8fb5]: (4, ('1', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.linuxscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] SCSI volumes sdb have been removed. {{(pid=74980) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2')] {{(pid=74980) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7f1467-d10c-4069-a2fc-524c43c54ebb]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --logout {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c1880d-80c3-4eab-9ec5-1e172f877576]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2, portal: 172.16.0.220,3260]
Nov 02 18:20:39 user nova-compute[74980]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2, portal: 172.16.0.220,3260] successful.
Nov 02 18:20:39 user nova-compute[74980]:  stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --op delete {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5985532a-9e7c-4fe4-a076-3105a3232fc2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86001) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee39cc4-a0cc-4042-892a-a99b0407daec]: (4, ('', '')) {{(pid=86001) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74980) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.base [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] <== disconnect_volume: return (301ms) None {{(pid=74980) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 18:20:39 user nova-compute[74980]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Disconnected iSCSI Volume {{(pid=74980) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 18:20:40 user nova-compute[74980]: DEBUG nova.objects.instance [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lazy-loading 'flavor' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:20:40 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-d89b9b99-1ff5-4bcd-9cc6-8b0ccf1e60cf tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.890s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:20:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:20:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:20:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:20:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:20:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:20:40 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:20:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:20:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:20:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:20:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:20:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:20:45 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:20:50 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:20:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:20:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:20:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:20:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:20:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:20:55 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:20:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:20:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:20:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:20:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:20:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:20:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:20:57 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:20:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:20:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:20:58 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:20:58 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:20:58 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8918MB free_disk=24.973899841308594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:20:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:20:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:20:58 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 5f62bd0c-f1c1-453c-b457-549268f07c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:20:58 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:20:58 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:20:58 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:20:58 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:20:58 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:20:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:20:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:20:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:21:00 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:21:01 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:21:01 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:21:04 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:21:05 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:21:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:21:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:21:10 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:21:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:21:10 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:21:10 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:21:10 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:21:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:21:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:21:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:21:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:21:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:21:10 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:21:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating instance_info_cache with network_info: [{"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:21:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:21:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:21:11 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:21:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:21:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:21:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:21:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:21:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:21:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:21:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:21:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:21:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:21:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:21:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:21:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:21:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:21:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:21:57 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:21:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:21:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:21:57 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:21:57 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:21:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:21:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:21:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 18:21:57 user nova-compute[74980]: DEBUG oslo_concurrency.processutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74980) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 18:21:58 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:21:58 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:21:58 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=8966MB free_disk=24.965160369873047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:21:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:21:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:21:58 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Instance 5f62bd0c-f1c1-453c-b457-549268f07c66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74980) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 18:21:58 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:21:58 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:21:58 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:21:58 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:21:58 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:21:58 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:21:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:21:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:21:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:22:00 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:22:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:22:01 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:22:01 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:22:04 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:22:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:22:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:22:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:22:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:22:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:22:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:22:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:22:11 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:22:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:22:11 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:22:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 18:22:11 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquired lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 18:22:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Forcefully refreshing network info cache for instance {{(pid=74980) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 18:22:11 user nova-compute[74980]: DEBUG nova.objects.instance [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lazy-loading 'info_cache' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:22:11 user nova-compute[74980]: DEBUG nova.network.neutron [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating instance_info_cache with network_info: [{"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:22:12 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Releasing lock "refresh_cache-5f62bd0c-f1c1-453c-b457-549268f07c66" {{(pid=74980) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 18:22:12 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updated the network info_cache for instance {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 02 18:22:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:22:21 user nova-compute[74980]: INFO nova.compute.manager [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Terminating instance
Nov 02 18:22:21 user nova-compute[74980]: DEBUG nova.compute.manager [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Start destroying the instance on the hypervisor. {{(pid=74980) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG nova.compute.manager [req-3e1ccca7-0014-4671-87b1-0bd1f455f80f req-0d4d8d39-0a5c-46de-8ca9-69accabd3f03 service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Received event network-vif-unplugged-88eef59e-6d3b-4e18-bc57-869cfe96ccd0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3e1ccca7-0014-4671-87b1-0bd1f455f80f req-0d4d8d39-0a5c-46de-8ca9-69accabd3f03 service nova] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3e1ccca7-0014-4671-87b1-0bd1f455f80f req-0d4d8d39-0a5c-46de-8ca9-69accabd3f03 service nova] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-3e1ccca7-0014-4671-87b1-0bd1f455f80f req-0d4d8d39-0a5c-46de-8ca9-69accabd3f03 service nova] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG nova.compute.manager [req-3e1ccca7-0014-4671-87b1-0bd1f455f80f req-0d4d8d39-0a5c-46de-8ca9-69accabd3f03 service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] No waiting events found dispatching network-vif-unplugged-88eef59e-6d3b-4e18-bc57-869cfe96ccd0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG nova.compute.manager [req-3e1ccca7-0014-4671-87b1-0bd1f455f80f req-0d4d8d39-0a5c-46de-8ca9-69accabd3f03 service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Received event network-vif-unplugged-88eef59e-6d3b-4e18-bc57-869cfe96ccd0 for instance with task_state deleting. {{(pid=74980) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 02 18:22:21 user nova-compute[74980]: INFO nova.virt.libvirt.driver [-] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Instance destroyed successfully.
Nov 02 18:22:21 user nova-compute[74980]: DEBUG nova.objects.instance [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lazy-loading 'resources' on Instance uuid 5f62bd0c-f1c1-453c-b457-549268f07c66 {{(pid=74980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG nova.virt.libvirt.vif [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T18:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1548367667',display_name='tempest-SnapshotDataIntegrityTests-server-1548367667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1548367667',id=52,image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSIr/6DHcmDgpVgLe0kWFEULVfCWjfSk3N4J/GITG37I1ZHBU6L+OGLTIkgdXvSZAMOXHd4bCzqPK+3QNR16izbhxdeaYh0ec0XJ2J8y9/94c3p9vcuWwPb03pwNlFdPg==',key_name='tempest-keypair-313247149',keypairs=<?>,launch_index=0,launched_at=2023-11-02T18:13:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd7458959e4b414eb3a4e3ca771b6b19',ramdisk_id='',reservation_id='r-dry7mfp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36a97702-8b81-46fe-8b9c-8c3e2e69141f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1934669581',owner_user_name='tempest-SnapshotDataIntegrityTests-1934669581-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T18:13:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbd858fb198c42e2bb3c0e68620995db',uuid=5f62bd0c-f1c1-453c-b457-549268f07c66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Converting VIF {"id": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "address": "fa:16:3e:6c:20:b3", "network": {"id": "7d519358-da34-4482-b807-e99e6a8b2d46", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1272548799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd7458959e4b414eb3a4e3ca771b6b19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88eef59e-6d", "ovs_interfaceid": "88eef59e-6d3b-4e18-bc57-869cfe96ccd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG nova.network.os_vif_util [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:20:b3,bridge_name='br-int',has_traffic_filtering=True,id=88eef59e-6d3b-4e18-bc57-869cfe96ccd0,network=Network(7d519358-da34-4482-b807-e99e6a8b2d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88eef59e-6d') {{(pid=74980) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG os_vif [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:20:b3,bridge_name='br-int',has_traffic_filtering=True,id=88eef59e-6d3b-4e18-bc57-869cfe96ccd0,network=Network(7d519358-da34-4482-b807-e99e6a8b2d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88eef59e-6d') {{(pid=74980) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88eef59e-6d, bridge=br-int, if_exists=True) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67e2b6a2-c11f-4fc9-bbb6-650f3d2ace1e) {{(pid=74980) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:22:21 user nova-compute[74980]: INFO os_vif [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:20:b3,bridge_name='br-int',has_traffic_filtering=True,id=88eef59e-6d3b-4e18-bc57-869cfe96ccd0,network=Network(7d519358-da34-4482-b807-e99e6a8b2d46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88eef59e-6d')
Nov 02 18:22:21 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Deleting instance files /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66_del
Nov 02 18:22:21 user nova-compute[74980]: INFO nova.virt.libvirt.driver [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Deletion of /opt/stack/data/nova/instances/5f62bd0c-f1c1-453c-b457-549268f07c66_del complete
Nov 02 18:22:22 user nova-compute[74980]: INFO nova.compute.manager [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 02 18:22:22 user nova-compute[74980]: DEBUG oslo.service.loopingcall [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74980) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 18:22:22 user nova-compute[74980]: DEBUG nova.compute.manager [-] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Deallocating network for instance {{(pid=74980) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 18:22:22 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] deallocate_for_instance() {{(pid=74980) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 18:22:22 user nova-compute[74980]: DEBUG nova.network.neutron [-] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Updating instance_info_cache with network_info: [] {{(pid=74980) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 18:22:22 user nova-compute[74980]: INFO nova.compute.manager [-] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Took 0.73 seconds to deallocate network for instance.
Nov 02 18:22:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:22:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:22:22 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:22:22 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:22:22 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:22:22 user nova-compute[74980]: INFO nova.scheduler.client.report [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Deleted allocations for instance 5f62bd0c-f1c1-453c-b457-549268f07c66
Nov 02 18:22:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-6147d120-5d06-42d3-a2b4-7793f7c5b352 tempest-SnapshotDataIntegrityTests-1934669581 tempest-SnapshotDataIntegrityTests-1934669581-project-member] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.901s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:22:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-81cb49fa-7a89-4f6f-860f-b6b35cf2cb87 req-e63444e9-9cc0-49f5-8b5c-bc0a671c7ee9 service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Received event network-vif-plugged-88eef59e-6d3b-4e18-bc57-869cfe96ccd0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:22:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-81cb49fa-7a89-4f6f-860f-b6b35cf2cb87 req-e63444e9-9cc0-49f5-8b5c-bc0a671c7ee9 service nova] Acquiring lock "5f62bd0c-f1c1-453c-b457-549268f07c66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:22:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-81cb49fa-7a89-4f6f-860f-b6b35cf2cb87 req-e63444e9-9cc0-49f5-8b5c-bc0a671c7ee9 service nova] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:22:23 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [req-81cb49fa-7a89-4f6f-860f-b6b35cf2cb87 req-e63444e9-9cc0-49f5-8b5c-bc0a671c7ee9 service nova] Lock "5f62bd0c-f1c1-453c-b457-549268f07c66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:22:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-81cb49fa-7a89-4f6f-860f-b6b35cf2cb87 req-e63444e9-9cc0-49f5-8b5c-bc0a671c7ee9 service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] No waiting events found dispatching network-vif-plugged-88eef59e-6d3b-4e18-bc57-869cfe96ccd0 {{(pid=74980) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 18:22:23 user nova-compute[74980]: WARNING nova.compute.manager [req-81cb49fa-7a89-4f6f-860f-b6b35cf2cb87 req-e63444e9-9cc0-49f5-8b5c-bc0a671c7ee9 service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Received unexpected event network-vif-plugged-88eef59e-6d3b-4e18-bc57-869cfe96ccd0 for instance with vm_state deleted and task_state None.
Nov 02 18:22:23 user nova-compute[74980]: DEBUG nova.compute.manager [req-81cb49fa-7a89-4f6f-860f-b6b35cf2cb87 req-e63444e9-9cc0-49f5-8b5c-bc0a671c7ee9 service nova] [instance: 5f62bd0c-f1c1-453c-b457-549268f07c66] Received event network-vif-deleted-88eef59e-6d3b-4e18-bc57-869cfe96ccd0 {{(pid=74980) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 02 18:22:26 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:22:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:22:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:22:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:46 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:22:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:22:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74980) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 18:22:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:22:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74980) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 18:22:51 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:22:56 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:22:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:22:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:22:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:22:59 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:22:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:22:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:22:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:22:59 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74980) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 18:22:59 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:22:59 user nova-compute[74980]: WARNING nova.virt.libvirt.driver [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 18:22:59 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Hypervisor/Node resource view: name=user free_ram=9086MB free_disk=24.99245834350586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74980) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 18:22:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 18:22:59 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 18:22:59 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 18:22:59 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74980) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 18:22:59 user nova-compute[74980]: DEBUG nova.compute.provider_tree [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed in ProviderTree for provider: 8bc01c9c-03f1-416d-b5bd-b94d64739bca {{(pid=74980) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 18:22:59 user nova-compute[74980]: DEBUG nova.scheduler.client.report [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Inventory has not changed for provider 8bc01c9c-03f1-416d-b5bd-b94d64739bca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74980) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 18:23:00 user nova-compute[74980]: DEBUG nova.compute.resource_tracker [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Compute_service record updated for user:user {{(pid=74980) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 18:23:00 user nova-compute[74980]: DEBUG oslo_concurrency.lockutils [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=74980) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 18:23:01 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:23:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:23:03 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:23:03 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74980) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 02 18:23:04 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:23:06 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:23:10 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:23:11 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:23:12 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:23:13 user nova-compute[74980]: DEBUG oslo_service.periodic_task [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74980) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 18:23:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Starting heal instance info cache {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 02 18:23:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Rebuilding the list of instances to heal {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 02 18:23:13 user nova-compute[74980]: DEBUG nova.compute.manager [None req-cdbf969f-724c-4890-9076-b2ebe96615f6 None None] Didn't find any instances for network info cache update. {{(pid=74980) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 02 18:23:15 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:23:16 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:23:18 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:23:21 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:23:26 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 18:23:31 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:23:36 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 18:23:41 user nova-compute[74980]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74980) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}